World Model · podcast knowledge graph

#94 – Ilya Sutskever: Deep Learning

2020-05-08 · 98 min · 20 entities

Asserted relationships

  • → appeared on Lex Fridman Podcast podcast
    0.68 · ×4
    evidence rules-v4
    #94 – Ilya Sutskever: Deep Learning
  • → hosted by Lex Fridman person
    0.55 · ×4
    evidence rules-v4
    Feed author/publisher: Lex Fridman
  • → founded OpenAI company
    0.54 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • → founded OpenAI company
    0.54 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • → works at OpenAI company
    0.50 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • → works at OpenAI company
    0.50 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • → discusses Society & Culture concept
    0.40 · ×4
    evidence rules-v4
    Feed category: Society & Culture
  • → discusses Technology company
    0.40 · ×4
    evidence rules-v4
    Feed category: Technology
  • → discusses Science concept
    0.40 · ×4
    evidence rules-v4
    Feed category: Science
  • → discusses Philosophy company
    0.40 · ×4
    evidence rules-v4
    Feed category: Philosophy
  • → references ~Ilya website
    0.38 · ×4
    evidence rules-v4
    Link in episode "#94 – Ilya Sutskever: Deep Learning": https://cs.toronto.edu/~ilya

Entities found in this episode

companys 9

  • mentioned OpenAI company
    0.68 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • founded OpenAI company
    0.54 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • founded OpenAI company
    0.54 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • mentioned Technology company
    0.50 · ×4
    evidence rules-v4
    Feed category: Technology
  • mentioned Philosophy company
    0.50 · ×4
    evidence rules-v4
    Feed category: Philosophy
  • works at OpenAI company
    0.50 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • works at OpenAI company
    0.50 · ×4
    evidence rules-v4
    co-founder of OpenAI
  • discusses Technology company
    0.40 · ×4
    evidence rules-v4
    Feed category: Technology
  • discusses Philosophy company
    0.40 · ×4
    evidence rules-v4
    Feed category: Philosophy

concepts 5

  • mentioned Society & Culture concept
    0.50 · ×4
    evidence rules-v4
    Feed category: Society & Culture
  • mentioned Science concept
    0.50 · ×4
    evidence rules-v4
    Feed category: Science
  • discusses Society & Culture concept
    0.40 · ×4
    evidence rules-v4
    Feed category: Society & Culture
  • discusses Science concept
    0.40 · ×4
    evidence rules-v4
    Feed category: Science
  • mentioned Deep Learning concept
    0.40 · ×4
    evidence rules-v4
    #94 – Ilya Sutskever: Deep Learning

persons 3

  • mentioned Lex Fridman person
    0.70 · ×4
    evidence rules-v4
    Feed author/publisher: Lex Fridman
  • mentioned Ilya Sutskever person
    0.70 · ×4
    evidence rules-v4
    #94 – Ilya Sutskever: Deep Learning
  • hosted by Lex Fridman person
    0.55 · ×4
    evidence rules-v4
    Feed author/publisher: Lex Fridman

websites 2

  • mentioned ~Ilya website
    0.45 · ×4
    evidence rules-v4
    Link in episode "#94 – Ilya Sutskever: Deep Learning": https://cs.toronto.edu/~ilya
  • references ~Ilya website
    0.38 · ×4
    evidence rules-v4
    Link in episode "#94 – Ilya Sutskever: Deep Learning": https://cs.toronto.edu/~ilya

podcasts 1

  • appeared on Lex Fridman Podcast podcast
    0.68 · ×4
    evidence rules-v4
    #94 – Ilya Sutskever: Deep Learning
Episode description as stored
Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic. Support this podcast by signing up with these sponsors: – Cash App – use code “LexPodcast” and download: – Cash App (App Store):  https://apple.co/2sPrUHe – Cash App (Google Play):  https://bit.ly/2MlvP5w EPISODE LINKS: Ilya’s Twitter: https://twitter.com/ilyasut Ilya’s Website: https://www.cs.toronto.edu/~ilya/ This conversation is part of the Artificial Intelligence podcast.  If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter , LinkedIn , Facebook , Medium , or YouTube where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts , follow on Spotify , or support it on Patreon . Here’s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time. OUTLINE: 00:00 – Introduction 02:23 – AlexNet paper and the ImageNet moment 08:33 – Cost functions 13:39 – Recurrent neural networks 16:19 – Key ideas that led to success of deep learning 19:57 – What’s harder to solve: language or vision? 29:35 – We’re massively underestimating deep learning 36:04 – Deep double descent 41:20 – Backpropagation 42:42 – Can neural networks be made to reason? 50:35 – Long-term memory 56:37 – Language models 1:00:35 – GPT-2 1:07:14 – Active learning 1:08:52 – Staged release of AI systems 1:13:41 – How to build AGI? 1:25:00 – Question to AGI 1:32:07 – Meaning of life