Is RAG Dead? Lessons from Building AI for Tax Law with Alex Bowcut - #769
2026-06-09 · 52 min · episode 769 · 14 entities
Asserted relationships
-
→ appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast0.68
evidence rules-v4
Is RAG Dead? Lessons from Building AI for Tax Law with Alex Bowcut - #769
-
0.55
evidence rules-v4
Feed author/publisher: Sam Charrington
-
0.40
evidence rules-v4
Feed category: Science
-
0.40
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed category: News
-
0.40
evidence rules-v4
Feed category: Tech News
-
0.40
evidence rules-v4
Feed author/publisher: TWIML
Entities found in this episode
concepts 6
-
0.50
evidence rules-v4
Feed category: Science
-
0.50
evidence rules-v4
Feed category: Tech News
-
0.40
evidence rules-v4
Feed category: Science
-
0.40
evidence rules-v4
Feed category: News
-
0.40
evidence rules-v4
Feed category: Tech News
-
0.35
evidence rules-v4
RAG
companys 4
-
0.70
evidence rules-v4
Feed author/publisher: TWIML
-
0.50
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed category: Technology
-
0.40
evidence rules-v4
Feed author/publisher: TWIML
persons 3
-
0.72
evidence rules-v4
Is RAG Dead? Lessons from Building AI for Tax Law with Alex Bowcut - #769
-
0.70
evidence rules-v4
Feed author/publisher: Sam Charrington
-
0.55
evidence rules-v4
Feed author/publisher: Sam Charrington
podcasts 1
-
appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast0.68
evidence rules-v4
Is RAG Dead? Lessons from Building AI for Tax Law with Alex Bowcut - #769
Episode description as stored
As context windows grow into the millions of tokens, many AI practitioners are questioning whether retrieval-augmented generation (RAG) is still necessary. If modern models can ingest entire libraries of documents, why bother with retrieval at all?
In this episode, Alex Bowcut, Head of Engineering at Sphere, explains why the answer depends on the application. Sphere uses AI to automate global tax compliance—an environment where getting the answer right isn’t enough. Every conclusion must be backed by the correct legal citation, and every decision must withstand expert review.
We explore how Sphere built TRAM (Tax Review and Assessment Model), a production AI system that combines retrieval, reasoning models, legal review workflows, reinforcement learning, and deterministic systems to help tax experts move nearly two orders of magnitude faster while maintaining accuracy.
Along the way, we discuss why RAG remains critical in high-stakes domains, how Sphere processes legal and regulatory documents from jurisdictions around the world, retrieval architectures, semantic chunking, dense versus sparse retrieval, expert feedback loops, and the challenges of building AI systems that people can actually trust.
🗒️ Full show notes: https://twimlai.com/go/769.