Papers by Nikolas Rieke
2 paper(s) by this author
· All BibTeX
Benchmarks in Leipzig
Between April 1 and May 15, 2026, a group of 49 mathematicians compiled a dataset of research-level mathematics questions with known answers. Most of the work was done during the three-day workshop Benchmarks in Leipzig with 35 participants at the Max Planck Institute for Mathematics in the Sciences in Leipzig, Germany. We present the resulting collection of 100~questions. We evaluated these questions in three stages: a single attempt by five state-of-the-art LLMs and their predecessors, followed by a 20-runs-per-model evaluation with three of these models, and finally a 3-run attempt with two heavy-thinking models. After Stage 1, 41 questions remained completely unsolved; after Stage 2, this count dropped to 16; and we concluded Stage 3 with only 2 unsolved questions. This demonstrates that the mathematical reasoning capabilities of LLMs are becoming impressive.
In September 2026, we added a fourth stage in which the next generation of models attempted all 100 questions once more, after which only 1 question remains unsolved.
The Euler Stratification for $\mathbb{P}^1 \times \mathbb{P}^1 \times \mathbb{P}^n$
We study the Euler characteristic of a hypersurface in $(\mathbb{C}^*)^2 \times (\mathbb{C}^*)^n$ defined by a polynomial whose monomial support corresponds to lattice points in $Δ_1 \times Δ_1 \times Δ_n$ as the coefficients of the defining polynomial vary. Each member of this hypersurface family corresponds to a three-way independence model from algebraic statistics, and the (signed) Euler characteristic is equal to the maximum likelihood degree (ML degree) of the model. We show in the case of $Δ_1 \times Δ_1 \times Δ_1$ this Euler characteristic depends only on the vanishing patterns of the factors of the principal $A$-determinant, but this fails for $Δ_1 \times Δ_1 \times Δ_n$ with $n \geq 2$. We prove that, for all $n\geq 1$, all positive integers up to the maximum possible ML degree can be realized as the Euler characteristic. Furthermore, we completely determine the Euler stratification for $\mathbb{P}^1 \times \mathbb{P}^1 \times \mathbb{P}^1$ and provide partial information for $\mathbb{P}^1 \times \mathbb{P}^1 \times \mathbb{P}^2$.