Context windows, computer constraints, and energy consumption with Sarah and Elad
2024-05-09 · 29 min · episode 63 · 12 entities
Asserted relationships
-
0.68
evidence rules-v4
Context windows, computer constraints, and energy consumption with Sarah and Elad
-
0.40
evidence rules-v4
Feed category: Science
-
0.40
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed category: Business
-
0.40
evidence rules-v4
Feed category: Entrepreneurship
-
0.40
evidence rules-v4
Feed author/publisher: Conviction
Entities found in this episode
concepts 8
-
0.50
evidence rules-v4
Feed category: Science
-
0.50
evidence rules-v4
Feed category: Technology
-
0.50
evidence rules-v4
Feed category: Business
-
0.50
evidence rules-v4
Feed category: Entrepreneurship
-
0.40
evidence rules-v4
Feed category: Science
-
0.40
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed category: Business
-
0.40
evidence rules-v4
Feed category: Entrepreneurship
companys 2
-
0.70
evidence rules-v4
Feed author/publisher: Conviction
-
0.40
evidence rules-v4
Feed author/publisher: Conviction
persons 1
-
0.72
evidence rules-v4
Context windows, computer constraints, and energy consumption with Sarah and Elad
podcasts 1
-
0.68
evidence rules-v4
Context windows, computer constraints, and energy consumption with Sarah and Elad
Episode description as stored
This week on No Priors hosts, Sarah and Elad are catching up on the latest AI news. They discuss the recent developments in AI like Meta’s new AI assistant and the latest in music generation, and if you’re interested in generative AI music, stay tuned for next week’s interview! Sarah and Elad also get into device-resident models, AI hardware, and ask just how smart smaller models can really get. These hardware constraints were compared to the hurdles AI platforms are continuing to face including computing constraints, energy consumption, context windows, and how to best integrate these products in apps that users are familiar with.
Have a question for our next host-only episode or feedback for our team? Reach out to show@no-priors.com
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil
Show Notes:
(0:00) Intro
(1:25) Music AI generation
(4:02) Apple’s LLM
(11:39) The role of AI-specific hardware
(15:25) AI platform updates
(18:01) Forward thinking in investing in AI
(20:33) Unlimited context
(23:03) Energy constraints