World Model · podcast knowledge graph

Benchmarks 201: Why Leaderboards > Arenas >> LLM-as-Judge

2024-07-12 · 58 min · 6 entities

Asserted relationships

  • → discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • → discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science

Entities found in this episode

concepts 4

  • mentioned Science concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Science
  • 0.42 · ×2
    evidence rules-v4
    Benchmarks 201: Why Leaderboards > Arenas >> LLM-as-Judge
  • discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • mentioned LLM concept
    0.35 · ×2
    evidence rules-v4
    LLM

companys 2

  • mentioned Technology company
    0.50 · ×2
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
Episode description as stored
The first AI Engineer World’s Fair talks from OpenAI and Cognition are up! In our Benchmarks 101 episode back in April 2023 we covered the history of AI benchmarks, their shortcomings, and our hopes for better ones. Fast forward 1.5 years, the pace of model development has far exceeded the speed at which benchmarks are updated. Frontier labs are still using MMLU and HumanEval for model marketing, even though most models are reaching their natural plateau at a ~90% success rate (any higher and they’re probably just memorizing/overfitting). From Benchmarks to Leaderboards Outside of being stale, lab-reported benchmarks also suffer from non-reproducibility. The models served through the API also change over time, so at different points in time it might return different scores. Today’s guest, Clémentine Fourrier , is the lead maintainer of HuggingFace’s OpenLLM Leaderboard . Their goal is standardizing how models are evaluated by curating a set of high quality benchmarks, and then publishing the results in a reproducible way with tools like EleutherAI’s Harness . The leaderboard was first launched summer 2023 and quickly became the de facto standard for open source LLM performance. To give you a sense for the scale: * Over 2 million unique visitors * 300,000 active community members * Over 7,500 models evaluated Last week they announced the second version of the leaderboard. Why? Because models were getting too good! The new version of the leaderboard is based on 6 benchmarks: * 📚 MMLU-Pro (Massive Multitask Language Understanding - Pro version, paper ) * 📚 GPQA (Google-Proof Q&A Benchmark, paper ) * 💭 MuSR (Multistep Soft Reasoning, paper ) * 🧮 MATH (Mathematics Aptitude Test of Heuristics, Level 5 subset, paper ) * 🤝 IFEval (Instruction Following Evaluation, paper ) * 🧮 🤝 BBH (Big Bench Hard, paper ) You can read the reasoning behind each of them on their announcement blog post . These updates had some clear winners and losers, with models jumping up or down up to 50 spots at once; the most likely reason for this is that the models were overfit to the benchmarks, or had some contamination in their training dataset. But the most important change is in the absolute scores. All models score much lower on v2 than they do on v1, which now creates a lot more room for models to show improved performance. On Arenas Another high-signal platform for AI Engineers is the LMSys Arena , which asks users to rank the output of two different models on the same prompt, and then give them an ELO score based on the outcomes. Clémentine called arenas “sociological experiments”: it tells you a lot about the users preference , but not always much about the model capabilities . She pointed to Anthropic’s sycophancy paper as early research in this space: We find that when a response matches a user’s views, it is more likely to be preferred. Moreover, both humans and preference models (PMs) prefer convincingly-written sycophantic responses over correct ones a non-negligible fraction of the time. The other issue is that Arena rankings aren’t reproducible, as you don’t know who ranked what and what exactly the outcome was at the time of ranking. They are still quite helpful as tools, but they aren’t a rigorous way to rank capabilities of the models. Her advice for both arena and leaderboard is to use these tools as ranges; find 3-4 models that fit your needs (speed, cost, capabilities, etc) and then do vibe checks to figure out which one is best for your specific task. LLMs aren’t good judges In the last ~6 months, there has been an increased interest in using LLMs as Judges: rather than asking a person to evaluate the outcome of a model, you can ask a more powerful LLM to score it. We covered this a bit in our Brightwave episode last month as well. HuggingFace also has a cookbook on it, but Clémentine was actually not a fan of this approach: * Mode collapse: if you are asking a model to choose which output is better, it will just self-reinforce its