← All leaderboardsOpen tier · reference

Open leaderboard

Models on the fully-open question set — prompt and ground truth are public, so it’s reproducible but gameable. Live from the eval DB: every model is graded over the same bench, and a question a model didn’t validly answer is imputed with the worst Cramér any other model got on it (marked ).

Each board is an edition— a frozen snapshot of the question set. Every model shown answered that same set, so it’s a like-for-like campaign, not runs from different weeks stitched together. Adding questions doesn’t change a live edition; they roll into the next one, which a maintainer cuts deliberately. Older editions stay selectable as permanent snapshots.

Tier

Loading the board…