Episode

Armchair Architects: LLMs & Vector Databases (Part 2)

with David Blank-Edelman, Uli Homann, Eric Charran

Azure Essentials Show

In this episode of the #AzureEnablementShow, Uli, Eric and David continue their discussion of vector databases and LLMS, including when to use prompt engineering, and the importance of fine-tuning your data. Uli suggests that there are two things that LLMs aren’t good at, then offers tips on workarounds. The conversation wraps up with a discussion of some of the pros and cons of vectorization. This is part two of a two-part series.

Chapters

  • 00:00 - Introduction
  • 00:15 - Recap on Embedding
  • 00:39 - Consider prompt engineering first
  • 02:06 - Fine tune your data
  • 02:58 - Help with hallucinations
  • 04:49 - LLMs and math
  • 04:59 - LLMs and structured data
  • 05:19 - Add code to prompts
  • 05:52 - Pipeline based programming
  • 07:54 - Vector database vs. vector Index
  • 09:00 - Arriving at vectorization
  • 09:52 - Vectorization alone isn’t the answer

Azure