Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714

2025-01-13 · 58 min · episode 714 · 13 entities

episode page audio

Asserted relationships

→ appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast

0.68

evidence rules-v4
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714
→ hosted by Sam Charrington person

0.55

evidence rules-v4
Feed author/publisher: Sam Charrington
→ discusses Science concept

0.40

evidence rules-v4
Feed category: Science
→ discusses Technology company

0.40

evidence rules-v4
Feed category: Technology
→ discusses News concept

0.40

evidence rules-v4
Feed category: News
→ discusses Tech News concept

0.40

evidence rules-v4
Feed category: Tech News
→ hosted by TWIML company

0.40

evidence rules-v4
Feed author/publisher: TWIML

Entities found in this episode

concepts 5

mentioned Science concept

0.50

evidence rules-v4
Feed category: Science
mentioned Tech News concept

0.50

evidence rules-v4
Feed category: Tech News
discusses Science concept

0.40

evidence rules-v4
Feed category: Science
discusses News concept

0.40

evidence rules-v4
Feed category: News
discusses Tech News concept

0.40

evidence rules-v4
Feed category: Tech News

companys 4

mentioned TWIML company

0.70

evidence rules-v4
Feed author/publisher: TWIML
mentioned Technology company

0.50

evidence rules-v4
Feed category: Technology
discusses Technology company

0.40

evidence rules-v4
Feed category: Technology
hosted by TWIML company

0.40

evidence rules-v4
Feed author/publisher: TWIML

persons 3

mentioned Abhijit Bose person

0.72

evidence rules-v4
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714
mentioned Sam Charrington person

0.70

evidence rules-v4
Feed author/publisher: Sam Charrington
hosted by Sam Charrington person

0.55

evidence rules-v4
Feed author/publisher: Sam Charrington

podcasts 1

appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast

0.68

evidence rules-v4
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714

Episode description as stored

Today, we're joined by Abhijit Bose, head of enterprise AI and ML platforms at Capital One to discuss the evolution of the company’s approach and insights on Generative AI and platform best practices. In this episode, we dig into the company’s platform-centric approach to AI, and how they’ve been evolving their existing MLOps and data platforms to support the new challenges and opportunities presented by generative AI workloads and AI agents. We explore their use of cloud-based infrastructure—in this case on AWS—to provide a foundation upon which they then layer open-source and proprietary services and tools. We cover their use of Llama 3 and open-weight models, their approach to fine-tuning, their observability tooling for Gen AI applications, their use of inference optimization techniques like quantization, and more. Finally, Abhijit shares the future of agentic workflows in the enterprise, the application of OpenAI o1-style reasoning in models, and the new roles and skillsets required in the evolving GenAI landscape. The complete show notes for this episode can be found at https://twimlai.com/go/714.