Nested Learning: Ali Behrouz on the Quest for Continual Learning & Illusion of AI Architectures

2026-06-03 · 180 min · 12 entities

episode page audio

Asserted relationships

→ hosted by Erik Torenberg, Nathan Labenz person

0.55

evidence rules-v4
Feed author/publisher: Erik Torenberg, Nathan Labenz
→ discusses Society & Culture concept

0.40

evidence rules-v4
Feed category: Society & Culture
→ discusses Technology concept

0.40

evidence rules-v4
Feed category: Technology
→ discusses Business concept

0.40

evidence rules-v4
Feed category: Business
→ discusses Entrepreneurship concept

0.40

evidence rules-v4
Feed category: Entrepreneurship
→ hosted by Turpentine company

0.40

evidence rules-v4
Feed author/publisher: Turpentine

Entities found in this episode

concepts 8

mentioned Society & Culture concept

0.50

evidence rules-v4
Feed category: Society & Culture
mentioned Technology concept

0.50

evidence rules-v4
Feed category: Technology
mentioned Business concept

0.50

evidence rules-v4
Feed category: Business
mentioned Entrepreneurship concept

0.50

evidence rules-v4
Feed category: Entrepreneurship
discusses Society & Culture concept

0.40

evidence rules-v4
Feed category: Society & Culture
discusses Technology concept

0.40

evidence rules-v4
Feed category: Technology
discusses Business concept

0.40

evidence rules-v4
Feed category: Business
discusses Entrepreneurship concept

0.40

evidence rules-v4
Feed category: Entrepreneurship

persons 2

mentioned Erik Torenberg, Nathan Labenz person

0.70

evidence rules-v4
Feed author/publisher: Erik Torenberg, Nathan Labenz
hosted by Erik Torenberg, Nathan Labenz person

0.55

evidence rules-v4
Feed author/publisher: Erik Torenberg, Nathan Labenz

companys 2

mentioned Turpentine company

0.70

evidence rules-v4
Feed author/publisher: Turpentine
hosted by Turpentine company

0.40

evidence rules-v4
Feed author/publisher: Turpentine

Episode description as stored

Ali Behrouz, grad student at Cornell and Google researcher, discusses his potentially transformative work on new architectures for continual learning in AI. His paper "Nested Learning," praised by Jeff Dean as a possible paradigm shift, enables models to adapt to new context while preserving core knowledge by updating different layers at different frequencies, inspired by human memory systems. The conversation also covers his latest work on AI "sleep" for memory consolidation, why he sees all deep learning as associative memory, and the profound implications of continual learning for privacy, alignment, and the path to AGI. Mercury: The fintech trusted by ambitious companies and individuals to run their finances, with virtual cards, spending limits, merchant/category locks, and AI-friendly tools like API keys, MCP, and CLI. Check out Mercury at mercury.com Sponsor: Claude: Claude by Anthropic is an AI collaborator that understands your workflow and helps you tackle research, writing, coding, and organization with deep context. Get started with Claude and explore Claude Pro at https://claude.ai/tcr