World Model · podcast knowledge graph

#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]

2022-12-06 · 28 min · episode 84 · 15 entities

episode page audio

Asserted relationships

  • → references VJFdjigzmcXMhNTsx concept
    0.77
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators
  • → references Horse Rides Astronaut person
    0.77
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://garymarcus.substack.com/p/horse-rides-astronaut
  • → discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology
  • 0.38
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://technologyreview.com/2020/08/22/1007539/gpt3-openai-language-generator-artificial-intelligence-ai-opinion
  • → references lauraruis.com website
    0.38
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://lauraruis.com/
  • → references Bloom website
    0.38
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://bigscience.huggingface.co/blog/bloom

Entities found in this episode

websites 6

  • 0.45
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://technologyreview.com/2020/08/22/1007539/gpt3-openai-language-generator-artificial-intelligence-ai-opinion
  • mentioned lauraruis.com website
    0.45
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://lauraruis.com/
  • mentioned Bloom website
    0.45
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://bigscience.huggingface.co/blog/bloom
  • 0.38
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://technologyreview.com/2020/08/22/1007539/gpt3-openai-language-generator-artificial-intelligence-ai-opinion
  • references lauraruis.com website
    0.38
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://lauraruis.com/
  • references Bloom website
    0.38
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://bigscience.huggingface.co/blog/bloom

concepts 4

  • mentioned VJFdjigzmcXMhNTsx concept
    0.90
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators
  • references VJFdjigzmcXMhNTsx concept
    0.77
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators
  • mentioned LAURA concept
    0.35
    evidence rules-v4
    LAURA
  • mentioned RUIS concept
    0.35
    evidence rules-v4
    RUIS

persons 2

  • mentioned Horse Rides Astronaut person
    0.90
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://garymarcus.substack.com/p/horse-rides-astronaut
  • references Horse Rides Astronaut person
    0.77
    evidence rules-v4
    Link in episode "#84 LAURA RUIS - Large language models are not zero-shot communicators [NEURIPS UNPLUGGED]": https://garymarcus.substack.com/p/horse-rides-astronaut

companys 2

  • mentioned Technology company
    0.50
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology

podcasts 1

Episode description as stored
In this NeurIPSs interview, we speak with Laura Ruis about her research on the ability of language models to interpret language in context. She has designed a simple task to evaluate the performance of widely used state-of-the-art language models and has found that they struggle to make pragmatic inferences (implicatures). Tune in to learn more about her findings and what they mean for the future of conversational AI. Laura Ruis https://www.lauraruis.com/ https://twitter.com/LauraRuis BLOOM https://bigscience.huggingface.co/blog/bloom Large language models are not zero-shot communicators [Laura Ruis, Akbir Khan, Stella Biderman, Sara Hooker, Tim Rocktäschel, Edward Grefenstette] https://arxiv.org/abs/2210.14986 [Zhang et al] OPT: Open Pre-trained Transformer Language Models https://arxiv.org/pdf/2205.01068.pdf [Lampinen] Can language models handle recursively nested grammatical structures? A case study on comparing models and humans https://arxiv.org/pdf/2210.15303.pdf [Gary Marcus] Horse rides astronaut https://garymarcus.substack.com/p/horse-rides-astronaut [Gary Marcus] GPT-3, Bloviator: OpenAI’s language generator has no idea what it’s talking about https://www.technologyreview.com/2020/08/22/1007539/gpt3-openai-language-generator-artificial-intelligence-ai-opinion/ [Bender et al] On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? https://dl.acm.org/doi/10.1145/3442188.3445922 [janus] Simulators (Less Wrong) https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators