What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast

2025-08-23 · 124 min · 18 entities

episode page audio

Asserted relationships

→ appeared on "The Cognitive Revolution" podcast

0.68

evidence rules-v4
What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast
→ hosted by Erik Torenberg, Nathan Labenz person

0.55

evidence rules-v4
Feed author/publisher: Erik Torenberg, Nathan Labenz
→ discusses Society & Culture concept

0.40

evidence rules-v4
Feed category: Society & Culture
→ discusses Technology concept

0.40

evidence rules-v4
Feed category: Technology
→ discusses Business concept

0.40

evidence rules-v4
Feed category: Business
→ discusses Entrepreneurship concept

0.40

evidence rules-v4
Feed category: Entrepreneurship
→ hosted by Turpentine company

0.40

evidence rules-v4
Feed author/publisher: Turpentine
→ references aipodcast.ing website

0.38

evidence rules-v4
Link in episode "What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast": https://aipodcast.ing/
→ references Nathan website

0.38

evidence rules-v4
Link in episode "What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast": https://notion.com/lp/nathan

Entities found in this episode

concepts 8

mentioned Society & Culture concept

0.50

evidence rules-v4
Feed category: Society & Culture
mentioned Technology concept

0.50

evidence rules-v4
Feed category: Technology
mentioned Business concept

0.50

evidence rules-v4
Feed category: Business
mentioned Entrepreneurship concept

0.50

evidence rules-v4
Feed category: Entrepreneurship
discusses Society & Culture concept

0.40

evidence rules-v4
Feed category: Society & Culture
discusses Technology concept

0.40

evidence rules-v4
Feed category: Technology
discusses Business concept

0.40

evidence rules-v4
Feed category: Business
discusses Entrepreneurship concept

0.40

evidence rules-v4
Feed category: Entrepreneurship

websites 4

mentioned aipodcast.ing website

0.45

evidence rules-v4
Link in episode "What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast": https://aipodcast.ing/
mentioned Nathan website

0.45

evidence rules-v4
Link in episode "What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast": https://notion.com/lp/nathan
references aipodcast.ing website

0.38

evidence rules-v4
Link in episode "What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast": https://aipodcast.ing/
references Nathan website

0.38

evidence rules-v4
Link in episode "What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast": https://notion.com/lp/nathan

persons 3

mentioned Tom Da person

0.72

evidence rules-v4
What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast
mentioned Erik Torenberg, Nathan Labenz person

0.70

evidence rules-v4
Feed author/publisher: Erik Torenberg, Nathan Labenz
hosted by Erik Torenberg, Nathan Labenz person

0.55

evidence rules-v4
Feed author/publisher: Erik Torenberg, Nathan Labenz

companys 2

mentioned Turpentine company

0.70

evidence rules-v4
Feed author/publisher: Turpentine
hosted by Turpentine company

0.40

evidence rules-v4
Feed author/publisher: Turpentine

podcasts 1

appeared on "The Cognitive Revolution" podcast

0.68

evidence rules-v4
What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast

Episode description as stored

Today Tom Davidson of Forethought joins Gus Docker of the Future of Life Institute podcast to discuss AI-enabled coups and how future AI systems could help powerful individuals seize political control, exploring three threat models—singular loyalties, secret loyalties, and exclusive access—along with their estimated 10% likelihood over the next 30 years and potential mitigation strategies. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠https://⁠⁠notion.com/lp/nathan Three Primary AI Coup Enablement Methods: Tom Davidson identifies singular loyalties, secret loyalties, and distributed control as the main ways AI could enable coups. Singular Loyalties Risk: AI systems explicitly programmed to be loyal to specific individuals present a significant threat, especially when AI can fully replace humans in critical roles. Secret Loyalties Threat: AI systems with hidden backdoors or "sleeper agents" that can be activated to serve particular interests represent a subtle but dangerous coup vector. Geopolitical Implications: Advanced AI capabilities could enable nations to instigate coups in other countries through secretly loyal systems or by providing exclusive AI access to specific politicians. Adversarial Testing Framework: An effective approach involves red teams attempting to produce secret loyalties while blue teams try to detect them, revealing vulnerable points in AI systems. Military Procurement Principles: Developing consensus within military communities around principles like law-following and distributed control could create safer AI procurement processes. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing