OctoAI product updates and release notes for November 2023
AddedNovember 27, 2023
OctoAI launches it’s new Text Gen Solution with Llama 2, Code Llama, and Mistral models.
-
Run inference against multiple sizes of Llama2 Chat, Code Llama Instruct, and Mistral Instruct all via one unified API.
-
Reliably scale your app with OctoAI, which is already processing millions of inferences daily.
AddedNovember 20, 2023
SDXL image generation has greatly been improved with the addition of SSD-1B, a distilled SDXL that is 50% faster, and LCM-LoRA, which enables image generation in less than 1 second.
-
SSD-1B is an OSS distilled SDXL that is 50% faster due to is smaller size. OctoAI applied our proprietary ML compiler to the model, and are able to generate SDXL images in 1.4 seconds using SSD-1B.
-
LCM-LoRA is a custom asset that enables high-quality image output requiring as few as 4 steps to generate images in less than 1 second.
ImprovedNovember 16, 2023
Image Gen Solution fine-tuning for SD 1.5 and SDXL via API or web UI now available.
- Customers can create their own unique fine-tunes in the web UI with at least 3-6 images, or import custom assets from popular sources to generate one of a kind images.
AddedNovember 8, 2023
OctoAI Image Gen Solution launched.
- The fastest and most customizable GenAI stack for production-grade image generation applications. The new solutions boasts SDXL images in less than 3 seconds, the ability to create or import fine-tuning assets, and reliable scale from a few to thousands of images.