Welcome to the OctoAI Blog
Explore the latest OctoAI product updates, TVM updates, and overall machine learning news.
New LLMs available Gemma 7B, Smaug 72B, and Nous Hermes 2 Mixtral
We introduced three new text-generation models to OctoAI: Gemma 7B Instruct, Smaug 72B, and Nous Herems 2 Mixtral.
Latitude Games lowers costs by 5x and unlocks new game experiences with Mixtral on OctoAI
The switch to Mixtral on OctoAI has also reduced Latitude’s inference costs by over 5x, enabling them to accelerate planned product enhancements and add new AI-powered experiences for players.
Reduce LLM costs for text summarization by over 50% with Mixtral on OctoAI
We show how switching to Mixtral on OctoAI can deliver a 1.5x to 3x lower LLM usage bill for your solution compared to GPT 3.5 on OpenAI and over an order of magnitude lower costs compared to GPT 4.
Start building with ease in minutes using OctoAI
Our mission is empowering developers to build AI applications that delight users by leveraging fast models running on the most efficient hardware. Sign up and start building in minutes.