World Model · podcast knowledge graph

#64 Prof. Gary Marcus 3.0

2022-02-24 · 52 min · episode 64 · 5 entities

Asserted relationships

  • → discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology
  • → references HNnAwSduud website
    0.38
    evidence rules-v4
    Link in episode "#64 Prof. Gary Marcus 3.0": https://discord.gg/HNnAwSduud

Entities found in this episode

companys 2

  • mentioned Technology company
    0.50
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology

websites 2

  • mentioned HNnAwSduud website
    0.45
    evidence rules-v4
    Link in episode "#64 Prof. Gary Marcus 3.0": https://discord.gg/HNnAwSduud
  • references HNnAwSduud website
    0.38
    evidence rules-v4
    Link in episode "#64 Prof. Gary Marcus 3.0": https://discord.gg/HNnAwSduud

podcasts 1

Episode description as stored
Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/HNnAwSduud YT: https://www.youtube.com/watch?v=ZDY2nhkPZxw We have a chat with Prof. Gary Marcus about everything which is currently top of mind for him, consciousness [00:00:00] Gary intro [00:01:25] Slightly conscious [00:24:59] Abstract, compositional models [00:32:46] Spline theory of NNs [00:36:17] Self driving cars / algebraic reasoning [00:39:43] Extrapolation [00:44:15] Scaling laws [00:49:50] Maximum likelihood estimation References: Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets https://arxiv.org/abs/2201.02177 DEEP DOUBLE DESCENT: WHERE BIGGER MODELS AND MORE DATA HURT https://arxiv.org/pdf/1912.02292.pdf Bayesian Deep Learning and a Probabilistic Perspective of Generalization https://arxiv.org/pdf/2002.08791.pdf