The distance between what an evaluation measures and the real-world capability users actually care about; closing it means building evals that mirror the true distribution of valuable tasks.
Tensions
Academic benchmarks such as Olympiad math are easy to state but wholly disconnected from enterprise value, while realistic rubric-graded task evals are expensive to build. Foody frames the eval as the product's PRD, which makes eval design, not model access, the scarce skill.