Infrastructure Scaling and Compound AI Systems with Jared Quincy Davis - #740
2025-07-22 · 73 min · episode 740 · 16 entities
Asserted relationships
-
→ appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast0.68
evidence rules-v4
Infrastructure Scaling and Compound AI Systems with Jared Quincy Davis - #740
-
0.55
evidence rules-v4
Feed author/publisher: Sam Charrington
-
0.50
evidence rules-v4
CEO at Foundry
-
0.50
evidence rules-v4
CEO at Foundry
-
0.40
evidence rules-v4
Feed category: Science
-
0.40
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed category: News
-
0.40
evidence rules-v4
Feed category: Tech News
-
0.40
evidence rules-v4
Feed author/publisher: TWIML
Entities found in this episode
companys 7
-
0.70
evidence rules-v4
Feed author/publisher: TWIML
-
0.62
evidence rules-v4
CEO at Foundry
-
0.50
evidence rules-v4
Feed category: Technology
-
0.50
evidence rules-v4
CEO at Foundry
-
0.50
evidence rules-v4
CEO at Foundry
-
0.40
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed author/publisher: TWIML
concepts 5
-
0.50
evidence rules-v4
Feed category: Science
-
0.50
evidence rules-v4
Feed category: Tech News
-
0.40
evidence rules-v4
Feed category: Science
-
0.40
evidence rules-v4
Feed category: News
-
0.40
evidence rules-v4
Feed category: Tech News
persons 3
-
0.72
evidence rules-v4
Infrastructure Scaling and Compound AI Systems with Jared Quincy Davis - #740
-
0.70
evidence rules-v4
Feed author/publisher: Sam Charrington
-
0.55
evidence rules-v4
Feed author/publisher: Sam Charrington
podcasts 1
-
appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast0.68
evidence rules-v4
Infrastructure Scaling and Compound AI Systems with Jared Quincy Davis - #740
Episode description as stored
In this episode, Jared Quincy Davis, founder and CEO at Foundry, introduces the concept of "compound AI systems," which allows users to create powerful, efficient applications by composing multiple, often diverse, AI models and services. We discuss how these "networks of networks" can push the Pareto frontier, delivering results that are simultaneously faster, more accurate, and even cheaper than single-model approaches. Using examples like "laconic decoding," Jared explains the practical techniques for building these systems and the underlying principles of inference-time scaling. The conversation also delves into the critical role of co-design, where the evolution of AI algorithms and the underlying cloud infrastructure are deeply intertwined, shaping the future of agentic AI and the compute landscape.
The complete show notes for this episode can be found at https://twimlai.com/go/740.