Are LLMs Good at Causal Reasoning? with Robert Osazuwa Ness - #638
2023-07-17 · 48 min · episode 638 · 13 entities
Asserted relationships
-
→ appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast0.68 · ×2
evidence rules-v4
Are LLMs Good at Causal Reasoning? with Robert Osazuwa Ness - #638
-
0.55 · ×2
evidence rules-v4
Feed author/publisher: Sam Charrington
-
0.40 · ×2
evidence rules-v4
Feed category: Science
-
0.40 · ×2
evidence rules-v4
Feed category: Technology
-
0.40 · ×2
evidence rules-v4
Feed category: News
-
0.40 · ×2
evidence rules-v4
Feed category: Tech News
-
0.40 · ×2
evidence rules-v4
Feed author/publisher: TWIML
Entities found in this episode
concepts 5
-
0.50 · ×2
evidence rules-v4
Feed category: Science
-
0.50 · ×2
evidence rules-v4
Feed category: Tech News
-
0.40 · ×2
evidence rules-v4
Feed category: Science
-
0.40 · ×2
evidence rules-v4
Feed category: News
-
0.40 · ×2
evidence rules-v4
Feed category: Tech News
companys 4
-
0.70 · ×2
evidence rules-v4
Feed author/publisher: TWIML
-
0.50 · ×2
evidence rules-v4
Feed category: Technology
-
0.40 · ×2
evidence rules-v4
Feed category: Technology
-
0.40 · ×2
evidence rules-v4
Feed author/publisher: TWIML
persons 3
-
0.72 · ×2
evidence rules-v4
Are LLMs Good at Causal Reasoning? with Robert Osazuwa Ness - #638
-
0.70 · ×2
evidence rules-v4
Feed author/publisher: Sam Charrington
-
0.55 · ×2
evidence rules-v4
Feed author/publisher: Sam Charrington
podcasts 1
-
appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast0.68 · ×2
evidence rules-v4
Are LLMs Good at Causal Reasoning? with Robert Osazuwa Ness - #638
Episode description as stored
Today we’re joined by Robert Osazuwa Ness, a senior researcher at Microsoft Research, Professor at Northeastern University, and Founder of Altdeep.ai. In our conversation with Robert, we explore whether large language models, specifically GPT-3, 3.5, and 4, are good at causal reasoning. We discuss the benchmarks used to evaluate these models and the limitations they have in answering specific causal reasoning questions, while Robert highlights the need for access to weights, training data, and architecture to correctly answer these questions. The episode discusses the challenge of generalization in causal relationships and the importance of incorporating inductive biases, explores the model's ability to generalize beyond the provided benchmarks, and the importance of considering causal factors in decision-making processes.
The complete show notes for this episode can be found at twimlai.com/go/638.