World Model · podcast knowledge graph

Building Real-World LLM Products with Fine-Tuning and More with Hamel Husain - #694

2024-07-23 · 80 min · episode 694 · 19 entities

episode page audio

Asserted relationships

  • 0.68
    evidence rules-v4
    Building Real-World LLM Products with Fine-Tuning and More with Hamel Husain - #694
  • → hosted by Sam Charrington person
    0.55
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • → founded Parlance Labs company
    0.54
    evidence rules-v4
    founder of Parlance Labs
  • → founded Parlance Labs company
    0.54
    evidence rules-v4
    founder of Parlance Labs
  • → works at Parlance Labs company
    0.50
    evidence rules-v4
    founder of Parlance Labs
  • → works at Parlance Labs company
    0.50
    evidence rules-v4
    founder of Parlance Labs
  • → discusses Science concept
    0.40
    evidence rules-v4
    Feed category: Science
  • → discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology
  • → discusses News concept
    0.40
    evidence rules-v4
    Feed category: News
  • → discusses Tech News concept
    0.40
    evidence rules-v4
    Feed category: Tech News
  • → hosted by TWIML company
    0.40
    evidence rules-v4
    Feed author/publisher: TWIML

Entities found in this episode

companys 9

  • mentioned TWIML company
    0.70
    evidence rules-v4
    Feed author/publisher: TWIML
  • mentioned Parlance Labs company
    0.68
    evidence rules-v4
    founder of Parlance Labs
  • founded Parlance Labs company
    0.54
    evidence rules-v4
    founder of Parlance Labs
  • founded Parlance Labs company
    0.54
    evidence rules-v4
    founder of Parlance Labs
  • mentioned Technology company
    0.50
    evidence rules-v4
    Feed category: Technology
  • works at Parlance Labs company
    0.50
    evidence rules-v4
    founder of Parlance Labs
  • works at Parlance Labs company
    0.50
    evidence rules-v4
    founder of Parlance Labs
  • discusses Technology company
    0.40
    evidence rules-v4
    Feed category: Technology
  • hosted by TWIML company
    0.40
    evidence rules-v4
    Feed author/publisher: TWIML

concepts 6

  • mentioned Science concept
    0.50
    evidence rules-v4
    Feed category: Science
  • mentioned Tech News concept
    0.50
    evidence rules-v4
    Feed category: Tech News
  • discusses Science concept
    0.40
    evidence rules-v4
    Feed category: Science
  • discusses News concept
    0.40
    evidence rules-v4
    Feed category: News
  • discusses Tech News concept
    0.40
    evidence rules-v4
    Feed category: Tech News
  • mentioned LLM concept
    0.35
    evidence rules-v4
    LLM

persons 3

  • 0.72
    evidence rules-v4
    Building Real-World LLM Products with Fine-Tuning and More with Hamel Husain - #694
  • mentioned Sam Charrington person
    0.70
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • hosted by Sam Charrington person
    0.55
    evidence rules-v4
    Feed author/publisher: Sam Charrington

podcasts 1

Episode description as stored
Today, we're joined by Hamel Husain, founder of Parlance Labs, to discuss the ins and outs of building real-world products using large language models (LLMs). We kick things off discussing novel applications of LLMs and how to think about modern AI user experiences. We then dig into the key challenge faced by LLM developers—how to iterate from a snazzy demo or proof-of-concept to a working LLM-based application. We discuss the pros, cons, and role of fine-tuning LLMs and dig into when to use this technique. We cover the fine-tuning process, common pitfalls in evaluation—such as relying too heavily on generic tools and missing the nuances of specific use cases, open-source LLM fine-tuning tools like Axolotl, the use of LoRA adapters, and more. Hamel also shares insights on model optimization and inference frameworks and how developers should approach these tools. Finally, we dig into how to use systematic evaluation techniques to guide the improvement of your LLM application, the importance of data generation and curation, and the parallels to traditional software engineering practices. The complete show notes for this episode can be found at https://twimlai.com/go/694.