World Model · podcast knowledge graph

Genie: Generative Interactive Environments with Ashley Edwards - #696

2024-08-05 · 47 min · episode 696 · 13 entities

Asserted relationships

  • evidence rules-v4
    Genie: Generative Interactive Environments with Ashley Edwards - #696
  • → hosted by Sam Charrington person
    0.55 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • → discusses News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: News
  • → discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • → discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • → discusses Tech News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Tech News
  • → hosted by TWIML company
    0.40 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML

Entities found in this episode

concepts 5

  • mentioned Science concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Science
  • mentioned Tech News concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Tech News
  • discusses News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: News
  • discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • discusses Tech News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Tech News

companys 4

  • mentioned TWIML company
    0.70 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML
  • mentioned Technology company
    0.50 · ×2
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • hosted by TWIML company
    0.40 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML

persons 3

  • mentioned Ashley Edwards person
    0.72 · ×2
    evidence rules-v4
    Genie: Generative Interactive Environments with Ashley Edwards - #696
  • mentioned Sam Charrington person
    0.70 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • hosted by Sam Charrington person
    0.55 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington

podcasts 1

Episode description as stored
Today, we're joined by Ashley Edwards, a member of technical staff at Runway, to discuss Genie: Generative Interactive Environments, a system for creating ‘playable’ video environments for training deep reinforcement learning (RL) agents at scale in a completely unsupervised manner. We explore the motivations behind Genie, the challenges of data acquisition for RL, and Genie’s capability to learn world models from videos without explicit action data, enabling seamless interaction and frame prediction. Ashley walks us through Genie’s core components—the latent action model, video tokenizer, and dynamics model—and explains how these elements collaborate to predict future frames in video sequences. We discuss the model architecture, training strategies, benchmarks used, as well as the application of spatiotemporal transformers and the MaskGIT techniques used for efficient token prediction and representation. Finally, we touched on Genie’s practical implications, its comparison to other video generation models like “Sora,” and potential future directions in video generation and diffusion models. The complete show notes for this episode can be found at https://twimlai.com/go/696.