Benchmark design
Mathematical problems and grading standards for evaluating AI.
- Original problems and reference solutions
- Grading rubrics and error categories
- Checks for ambiguity and unintended shortcuts
Independent consulting · Strasbourg, France
I help research teams evaluate AI reasoning, design mathematical benchmarks, and review complex proofs.
Research mathematician · CNRS
PhD · HDR · 30+ invited talks
What I do
Original benchmarks for AI teams. Independent reviews of difficult arguments.
Mathematical problems and grading standards for evaluating AI.
Independent review of proofs and arguments from people or models.
About
I am a CNRS research mathematician at IRMA in Strasbourg, working in arithmetic geometry. I previously held fellowships at IMJ–PRG in Paris and the Max Planck Institute for Mathematics in Bonn.
My consulting draws on the same habits as my research: question the assumptions, check each step, and make the conclusion precise.
How I work
Agree on the question, the standard, and the deliverable.
Test the assumptions, logic, and edge cases.
Separate what is established from what remains uncertain.
Present the conclusions and recommend the next steps.
Have a project in mind?
Send me the question, the result you need, and your timeline. I’ll let you know how I can help.
daddezio.math@gmail.com