World Model · podcast knowledge graph

Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI

2024-11-21 · 107 min · 25 entities

episode page audio

Asserted relationships

  • → appeared on "The Cognitive Revolution" podcast
    0.68
    evidence rules-v4
    Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
  • → appeared on "The Cognitive Revolution" podcast
    0.63
    evidence rules-v4
    Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
  • → hosted by Erik Torenberg, Nathan Labenz person
    0.55
    evidence rules-v4
    Feed author/publisher: Erik Torenberg, Nathan Labenz
  • → discusses Society & Culture concept
    0.40
    evidence rules-v4
    Feed category: Society & Culture
  • → discusses Technology concept
    0.40
    evidence rules-v4
    Feed category: Technology
  • → discusses Business concept
    0.40
    evidence rules-v4
    Feed category: Business
  • → discusses Entrepreneurship concept
    0.40
    evidence rules-v4
    Feed category: Entrepreneurship
  • → hosted by Turpentine company
    0.40
    evidence rules-v4
    Feed author/publisher: Turpentine
  • → references natolambert.com website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://natolambert.com/
  • → references interconnects.ai website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://interconnects.ai/
  • → references CognitiveRevolution website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://notion.com/cognitiverevolution
  • → references Exclusiveaccess website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://turpentine.co/exclusiveaccess

Entities found in this episode

concepts 9

  • mentioned Society & Culture concept
    0.50
    evidence rules-v4
    Feed category: Society & Culture
  • mentioned Technology concept
    0.50
    evidence rules-v4
    Feed category: Technology
  • mentioned Business concept
    0.50
    evidence rules-v4
    Feed category: Business
  • mentioned Entrepreneurship concept
    0.50
    evidence rules-v4
    Feed category: Entrepreneurship
  • discusses Society & Culture concept
    0.40
    evidence rules-v4
    Feed category: Society & Culture
  • discusses Technology concept
    0.40
    evidence rules-v4
    Feed category: Technology
  • discusses Business concept
    0.40
    evidence rules-v4
    Feed category: Business
  • discusses Entrepreneurship concept
    0.40
    evidence rules-v4
    Feed category: Entrepreneurship
  • mentioned LLM concept
    0.35
    evidence rules-v4
    LLM

websites 8

  • mentioned natolambert.com website
    0.45
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://natolambert.com/
  • mentioned interconnects.ai website
    0.45
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://interconnects.ai/
  • mentioned CognitiveRevolution website
    0.45
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://notion.com/cognitiverevolution
  • mentioned Exclusiveaccess website
    0.45
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://turpentine.co/exclusiveaccess
  • references natolambert.com website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://natolambert.com/
  • references interconnects.ai website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://interconnects.ai/
  • references CognitiveRevolution website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://notion.com/cognitiverevolution
  • references Exclusiveaccess website
    0.38
    evidence rules-v4
    Link in episode "Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI": https://turpentine.co/exclusiveaccess

persons 4

  • mentioned Nathan La person
    0.72
    evidence rules-v4
    Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
  • 0.70
    evidence rules-v4
    Feed author/publisher: Erik Torenberg, Nathan Labenz
  • 0.66
    evidence rules-v4
    Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
  • 0.55
    evidence rules-v4
    Feed author/publisher: Erik Torenberg, Nathan Labenz

companys 2

  • mentioned Turpentine company
    0.70
    evidence rules-v4
    Feed author/publisher: Turpentine
  • hosted by Turpentine company
    0.40
    evidence rules-v4
    Feed author/publisher: Turpentine

podcasts 2

  • appeared on "The Cognitive Revolution" podcast
    0.68
    evidence rules-v4
    Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
  • appeared on "The Cognitive Revolution" podcast
    0.63
    evidence rules-v4
    Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI
Episode description as stored
In this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one of our most detailed and valuable discussions on state-of-the-art AI model development. Check out Nathan's Lambert newsletter: https://www.natolambert.com https://www.interconnects.ai Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:00:59) Sponsors: Incogni (00:02:20) About the Episode (00:05:56) Introducing AI2 (00:09:56) Tulu: Deep Dive (Part 1) (00:17:43) Sponsors: Shopify | Oracle Cloud Infrastructure (OCI) (00:20:38) Open vs. Closed Recipes (00:29:48) Compute & Value (Part 1) (00:34:22) Sponsors: 80,000 Hours | Notion (00:37:02) Compute & Value (Part 2) (00:42:41) Model Weight Evolution (00:53:16) DPO vs. PPO (01:06:36) Project Trajectory (01:20:39) Synthetic Data & LLM Judge (01:27:39) Verifiable RL (01:38:17) Advice for Practitioners (01:44:01) Open Source vs. Closed (01:49:18) Outro