OctoAI Logo
Live Webinar
September 17 - Join our panel of experts and learn how to create AI Agents for the Enterprise
Register now
Back to demos & webinarsOptimizing LLMs for cost and quality
SolutionsOctoAI Text Gen
Format30min discussion and demo then 20min Q&A
Key Learnings1. Know why fine tuning is critical, 2. Learn steps to model optimization, 3. Learn how DevOps cycles might look for LLM apps, 4. Live demo of fine tuned LLama 3.1-8B outperforms GPT-4o at redacting PII data.
Date PublishedAug 7, 2024
PublishersAlyss Noland, Thierry Moreau

Optimizing LLMs for cost and quality

This technical webinar will review fine tuning models for performance, model quality optimization, devops for LLM apps, and a full demo showing how to fine tune Llama 3.1-8B to outperform a GPT-4o model at redacting personally identifiable information (PII) from your datasets.

Webinar preview image for Optimizing LLMs for cost and quality with a chart showing starting GenAI projects with high costs, and moving to lower costs and improved quality

Learn with our crawl, walk, run approach to scale production GenAI applications. Low quality and high costs are some of the biggest blockers for scaling LLMs. In this technical session we will show a path to using open source to achieve better quality with faster and cheaper models for your apps.

In the on-demand webinar you will:

  • Learn why fine tuning models is critically important

  • Lean a proven "crawl, walk, run" approach for model quality optimization

  • See what the continuous development cycle looks like for LLM apps

  • See a demo showing a fine tuned Llama 3.1-8B outperforms GPT-4o at redacting personally identifiable information (PII) from datasets

This 50 minute session is for engineers, product leaders, and technical founders. You can take and apply learnings to your prototype or optimize your existing GenAI app.

Watch now

Webinar preview image for Optimizing LLMs for cost and quality with a chart showing starting GenAI projects with high costs, and moving to lower costs and improved quality