World Model · podcast knowledge graph

Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657

2023-11-28 · 43 min · episode 657 · 14 entities

Asserted relationships

  • evidence rules-v4
    Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657
  • → hosted by Sam Charrington person
    0.55 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • → discusses News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: News
  • → discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • → discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • → discusses Tech News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Tech News
  • → hosted by TWIML company
    0.40 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML

Entities found in this episode

concepts 6

  • mentioned Science concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Science
  • mentioned Tech News concept
    0.50 · ×2
    evidence rules-v4
    Feed category: Tech News
  • discusses News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: News
  • discusses Science concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Science
  • discusses Tech News concept
    0.40 · ×2
    evidence rules-v4
    Feed category: Tech News
  • mentioned LLM concept
    0.35 · ×2
    evidence rules-v4
    LLM

companys 4

  • mentioned TWIML company
    0.70 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML
  • mentioned Technology company
    0.50 · ×2
    evidence rules-v4
    Feed category: Technology
  • discusses Technology company
    0.40 · ×2
    evidence rules-v4
    Feed category: Technology
  • hosted by TWIML company
    0.40 · ×2
    evidence rules-v4
    Feed author/publisher: TWIML

persons 3

  • mentioned Azure Op person
    0.72 · ×2
    evidence rules-v4
    Building LLM-Based Applications with Azure OpenAI with Jay Emery - #657
  • mentioned Sam Charrington person
    0.70 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington
  • hosted by Sam Charrington person
    0.55 · ×2
    evidence rules-v4
    Feed author/publisher: Sam Charrington

podcasts 1

Episode description as stored
Today we’re joined by Jay Emery, director of technical sales & architecture at Microsoft Azure. In our conversation with Jay, we discuss the challenges faced by organizations when building LLM-based applications, and we explore some of the techniques they are using to overcome them. We dive into the concerns around security, data privacy, cost management, and performance as well as the ability and effectiveness of prompting to achieve the desired results versus fine-tuning, and when each approach should be applied. We cover methods such as prompt tuning and prompt chaining, prompt variance, fine-tuning, and RAG to enhance LLM output along with ways to speed up inference performance such as choosing the right model, parallelization, and provisioned throughput units (PTUs). In addition to that, Jay also shared several intriguing use cases describing how businesses use tools like Azure Machine Learning prompt flow and Azure ML AI Studio to tailor LLMs to their unique needs and processes. The complete show notes for this episode can be found at twimlai.com/go/657.