BenchMIRT: What are LLM benchmarks actually measuring?

Source: Ai2 Blog·2026-09-01 16:00Publish time unverified

BenchMIRT is a new method for auditing LLM benchmarks question by question, revealing which capabilities they actually measure and helping researchers build smaller, more focused, and easier-to-interpret evaluations.