World Model · podcast knowledge graph

EP 38: The Local AI Stack Nobody Talks About (But Should)

2026-04-22 · 41 min · episode 38 · 9 entities

episode page audio

Asserted relationships

  • → references Benjamin Trent Rossiter Mba person
    0.77
    evidence rules-v5
    Link in episode "EP 38: The Local AI Stack Nobody Talks About (But Should)": https://linkedin.com/in/benjamin-trent-rossiter-mba-0157945
  • → hosted by Soumava Dey person
    0.55
    evidence rules-v5
    Feed author/publisher: Soumava Dey
  • → discusses Technology company
    0.40
    evidence rules-v5
    Feed category: Technology
  • → references logicdatasolutions.com website
    0.38
    evidence rules-v5
    Link in episode "EP 38: The Local AI Stack Nobody Talks About (But Should)": https://logicdatasolutions.com/

Entities found in this episode

persons 4

  • mentioned Benjamin Trent Rossiter Mba person
    0.90
    evidence rules-v5
    Link in episode "EP 38: The Local AI Stack Nobody Talks About (But Should)": https://linkedin.com/in/benjamin-trent-rossiter-mba-0157945
  • references Benjamin Trent Rossiter Mba person
    0.77
    evidence rules-v5
    Link in episode "EP 38: The Local AI Stack Nobody Talks About (But Should)": https://linkedin.com/in/benjamin-trent-rossiter-mba-0157945
  • mentioned Soumava Dey person
    0.70
    evidence rules-v5
    Feed author/publisher: Soumava Dey
  • hosted by Soumava Dey person
    0.55
    evidence rules-v5
    Feed author/publisher: Soumava Dey

companys 2

  • mentioned Technology company
    0.50
    evidence rules-v5
    Feed category: Technology
  • discusses Technology company
    0.40
    evidence rules-v5
    Feed category: Technology

websites 2

  • mentioned logicdatasolutions.com website
    0.45
    evidence rules-v5
    Link in episode "EP 38: The Local AI Stack Nobody Talks About (But Should)": https://logicdatasolutions.com/
  • references logicdatasolutions.com website
    0.38
    evidence rules-v5
    Link in episode "EP 38: The Local AI Stack Nobody Talks About (But Should)": https://logicdatasolutions.com/

concepts 1

Episode description as stored
You want to run AI locally. You have questions: What hardware do I actually need? Which framework should I use? How much will this cost? What's the realistic performance? In this episode, Sam brings back Trent Rossiter, founder of Logical Data Solutions, for a practical walkthrough of building a production-grade local AI lab. Trent has built real systems for enterprise clients, tested frameworks on multiple hardware stacks, and made the hardware choices that matter. This is not theory. This is what actually works. WHAT WE COVER: ▪ Hardware & Framework Choices: VRAM is the critical metric (not all VRAM is equal — memory throughput matters as much as capacity). ▪ Model Architecture & Capability: Mixture of Experts (MoE) lets you fit more power into less VRAM by using fewer active parameters. ▪ Real Enterprise Applications: Computer vision for quality assurance on assembly lines. Proprietary data handling without cloud exposure. ▪ Your Starter Stack (All Free): Langflow (agentic workflow builder), Goose (MCP-enabled chat), AnythingLLM (with vector stores for RAG), MCP servers (Model Context Protocol — standardised tool integration). ▪ Agentic AI & Security: OpenClaw is powerful but controversial — manages email, Telegram, calendars, creates sub-agents. Trent runs it in Docker on an isolated machine for safety. NVIDIA's NemoClaw is the enterprise version (security-first, nothing-allowed-by-default, explicit permissions). HARDWARE TRENT MENTIONS: NVIDIA DGX Spark — 128GB unified memory, CUDA stack Apple MacBook Pro/Mac mini — up to 512GB unified memory, market leader for personal AI AMD integrated AI PCs — emerging competitor NVIDIA RTX gaming cards (30/40/50/60 series) — high VRAM, high power consumption, complex FIND TRENT ROSSITER: LinkedIn: https://www.linkedin.com/in/benjamin-trent-rossiter-mba-0157945/ Logic Data Solutions: https://logicdatasolutions.com/ Contact: BenjaminRossiter@LogicDataSolutions.com