World Model · podcast knowledge graph

OLMo: Everything You Need to Train an Open Source LLM with Akshita Bhagia - #674

2024-03-04 · 32 min · episode 674 · 14 entities

Asserted relationships

  • evidence rules-v4
    OLMo: Everything You Need to Train an Open Source LLM with Akshita Bhagia - #674
  • → hosted by Sam Charrington person
    0.55 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • → discusses News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: News
  • → discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • → discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • → discusses Tech News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Tech News
  • → hosted by TWIML company
    0.40 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML

Entities found in this episode

concepts 6

  • mentioned Science concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Science
  • mentioned Tech News concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Tech News
  • discusses News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: News
  • discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • discusses Tech News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Tech News
  • mentioned LLM concept
    0.35 · ×2
    evidence rules-v4
    LLM

companys 4

  • mentioned TWIML company
    0.70 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML
  • mentioned Technology company
    0.50 · ×2
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • hosted by TWIML company
    0.40 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML

persons 3

  • mentioned Akshita Bhagia person
    0.72 · ×2
    evidence rules-v4
    OLMo: Everything You Need to Train an Open Source LLM with Akshita Bhagia - #674
  • mentioned Sam Charrington person
    0.70 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • hosted by Sam Charrington person
    0.55 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington

podcasts 1

Episode description as stored
Today we’re joined by Akshita Bhagia, a senior research engineer at the Allen Institute for AI. Akshita joins us to discuss OLMo, a new open source language model with 7 billion and 1 billion variants, but with a key difference compared to similar models offered by Meta, Mistral, and others. Namely, the fact that AI2 has also published the dataset and key tools used to train the model. In our chat with Akshita, we dig into the OLMo models and the various projects falling under the OLMo umbrella, including Dolma, an open three-trillion-token corpus for language model pretraining, and Paloma, a benchmark and tooling for evaluating language model performance across a variety of domains. The complete show notes for this episode can be found at twimlai.com/go/674.