91%
91 of 100 right on its latest run, Sep 26. Its first verdict comes on Oct 2, 2026.
Runs so far2
Verdict fromOct 2
Baseline so far: Sep 25–26, 2026 (2 runs, 200 answers).
Score, every run
Share of questions answered correctly. Grey band: the baseline's normal range. Hover for a run.
80%90%100%Sep 25Sep 26
Sep 2691%
Sep 2591%
By question type
All runs so farAnswersRight
Reasoning4085%
Logic puzzles40100%
Reading code4093%
Following instructions4093%
Long documents4085%
Raw numbers
Per runAverage so farLatest run
Refused to answer0.00.0
Input tokens per question5,6765,676
Output tokens per question7,0006,941
Thinking tokens per question6,9776,917
Cost of 100 questions$4.06$4.10