World Model · podcast knowledge graph

The Lottery Ticket Hypothesis with Jonathan Frankle

2020-05-19 · 87 min · 11 entities

Asserted relationships

  • → appeared on Machine Learning Street Talk (MLST podcast
    0.68 · ×2
    evidence rules-v4
    The Lottery Ticket Hypothesis with Jonathan Frankle
  • → authored Lottery Ticket Hypothesis book
    0.62 · ×2
    evidence rules-v4
    author of The Lottery Ticket Hypothesis
  • → discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • → references Block Sparse Gpu Kernels person
    0.38 · ×2
    evidence rules-v4
    Link in episode "The Lottery Ticket Hypothesis with Jonathan Frankle": https://openai.com/blog/block-sparse-gpu-kernels
  • 0.38 · ×2
    evidence rules-v4
    Link in episode "The Lottery Ticket Hypothesis with Jonathan Frankle": https://reddit.com/r/MachineLearning/comments/g9jqe0/d_lottery_ticket_hypothesis_ask_the_author_a

Entities found in this episode

persons 3

  • mentioned Jonathan Frankle person
    0.72 · ×2
    evidence rules-v4
    The Lottery Ticket Hypothesis with Jonathan Frankle
  • mentioned Block Sparse Gpu Kernels person
    0.45 · ×2
    evidence rules-v4
    Link in episode "The Lottery Ticket Hypothesis with Jonathan Frankle": https://openai.com/blog/block-sparse-gpu-kernels
  • references Block Sparse Gpu Kernels person
    0.38 · ×2
    evidence rules-v4
    Link in episode "The Lottery Ticket Hypothesis with Jonathan Frankle": https://openai.com/blog/block-sparse-gpu-kernels

podcasts 2

books 2

companys 2

  • mentioned Technology company
    0.50 · ×2
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology

websites 2

  • 0.45 · ×2
    evidence rules-v4
    Link in episode "The Lottery Ticket Hypothesis with Jonathan Frankle": https://reddit.com/r/MachineLearning/comments/g9jqe0/d_lottery_ticket_hypothesis_ask_the_author_a
  • 0.38 · ×2
    evidence rules-v4
    Link in episode "The Lottery Ticket Hypothesis with Jonathan Frankle": https://reddit.com/r/MachineLearning/comments/g9jqe0/d_lottery_ticket_hypothesis_ask_the_author_a
Episode description as stored
In this episode of Machine Learning Street Talk, we chat with Jonathan Frankle, author of The Lottery Ticket Hypothesis. Frankle has continued researching Sparse Neural Networks, Pruning, and Lottery Tickets leading to some really exciting follow-on papers! This chat discusses some of these papers such as Linear Mode Connectivity, Comparing and Rewinding and Fine-tuning in Neural Network Pruning, and more (full list of papers linked below). We also chat about how Jonathan got into Deep Learning research, his Information Diet, and work on developing Technology Policy for Artificial Intelligence! This was a really fun chat, I hope you enjoy listening to it and learn something from it! Thanks for watching and please subscribe! Huge thanks to everyone on r/MachineLearning who asked questions! Paper Links discussed in the chat: The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks: https://arxiv.org/abs/1803.03635 Linear Mode Connectivity and the Lottery Ticket Hypothesis: https://arxiv.org/abs/1912.05671 Dissecting Pruned Neural Networks: https://arxiv.org/abs/1907.00262 Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs: https://arxiv.org/abs/2003.00152 What is the State of Neural Network Pruning? https://arxiv.org/abs/2003.03033 The Early Phase of Neural Network Training: https://arxiv.org/abs/2002.10365 Comparing Rewinding and Fine-tuning in Neural Network Pruning: https://arxiv.org/abs/2003.02389 (Also Mentioned) Block-Sparse GPU Kernels: https://openai.com/blog/block-sparse-gpu-kernels/ Balanced Sparsity for Efficient DNN Inference on GPU: https://arxiv.org/pdf/1811.00206.pdf Playing the Lottery with Rewards and Multiple Languages: Lottery Tickets in RL and NLP: https://arxiv.org/pdf/1906.02768.pdf r/MachineLearning question list: https://www.reddit.com/r/MachineLearning/comments/g9jqe0/d_lottery_ticket_hypothesis_ask_the_author_a/ (edited) #machinelearning #deeplearning