Quickstart

Pricing & billing

Only pay for what you use.

At OctoAI you only pay for what you use. Upon sign up you will receive $10 of free credit in your account, and these credits don’t expire. That is equivalent of:

  • Over a million words of output with the largest Llama 3 70B model and Mixtral 8x7B model.
  • 1,000 SDXL default images and about 66 Stable Video Diffusion animations

How does billing work?

OctoAI uses post-paid billing - add a credit card and pay for your use at the end of each month. All existing credits will remain available within your account and will be used before any post-paid billing is applied.

On the 1st day of each month, we’ll send an invoice so you can see the upcoming charge. On the 7th day of each month, we’ll charge the card on file for the prior billing period. If there’s an issue charging your credit card, you can manually pay via the invoice.

Where can I find my billing data?

You can view your plan tier, invoices, and itemized usage for all OctoAI services in Billing & Usage in your account at anytime.

What are the rate limits for each solution?

See rate limits for details, and feel free to contact us to discuss higher limits to meet your needs. You will recieve an HTTP 429 response code if you reach the limit cap.

Media Gen Solution

Below is a full feature breakdown of the Media Gen Solution tiers.

TrialProEnterprise
SDXL and SD 1.5 text2img, SVD image animation, img2img, Inpainting, ControlNetCost-optimizedCost-optimizedOption for Cost-optimized or Latency-optimized
Custom Assets (checkpoints, loras, inversions, VAEs)
Upscaler
Option for SLA guarantees
Option for Private Deployment (at higher price)
Dedicated Customer Success Manager

Pro pricing for Media Gen Solution

Pricing for default image features and configurations are below:

Feature TypeStepsResolutionSamplerPrice
Juggernaut v9 and XI30all supportedN/A$0.01/image
Juggernaut v9 and XI Lighting4all supportedN/A$0.007/image
SD330all supportedN/A$0.03/image
SVD 1.125all supportedN/A$0.15/animation
SDXL301024x1024DDIM (and any not listed below as premium)$0.004/image
SDXL with Custom Asset (Fine-tuned)301024x1024DDIM (and any not listed below as premium)$0.008/image
SDXL Lightning base41024x1024DDIM (and any not listed below as premium)$0.001/image
SDXL Lightning Custom Asset (Fine-tuned)41024x1024DDIM (and any not listed below as premium)$0.005/image
SDXL Fine-tuning500N/AN/A$0.25/tune
SD 1.5 with Base or Custom Asset (Fine-tuned)30512x512DDIM (and any not listed below as premium)$0.0015/image
SD1.5 Fine-tuning500N/AN/A$0.1/tune
Asset library (storage)N/AN/AN/A$0.05/GB stored per month, after the first 50GB
UpscalingN/AN/AN/A$0.004/request
Background RemovalN/AN/AN/A$0.002/request
Photo Merge301024x1024N/A$0.015/image
AdetailerN/AN/AN/A$0.0004/object
Image Prompt (IP) Adapter301024x1024N/A$0.015/image

The price for each feature type changes as listed below for non-default configurations:

Configuration TypePrice Formula
Image Animation StepsDefault price * (step_count/25)
Image Generation StepsDefault price * (step_count/30)
SDXL ResolutionsDefault price *(pixel_count/(1024*1024))
SD1.5 ResolutionsDefault price * (pixel_count/(512*512))
Premium Samplers: DPM_2, DPM_2_ANCESTRAL, DPM_PLUS_PLUS_SDE_KARRAS, HEUN, KLMSDefault price *2
Fine-tuning StepsDefault price * (step_count/500)

Here are a few examples to illustrate how this works to assist you in applying to your own use case:

Feature TypeStepsResolutionSamplerPrice
SDXL401024x1024DDIM (default)$.0053
SDXL401024x1024DPM_2_ANCESTRAL (premium)$.0107
SDXL Lightning base41024x1024DDIM (default)$.001
SDXL Lightning with Custom Asset41024x1024DDIM (default)$.005
SDXL with Custom Asset (Fine-tuned)601024x1024DDIM (default)$.016
SDXL with Custom Asset (Fine-tuned)601024x1024DPM_2 (premium)$.032
SDXL Fine-tuning1000N/AN/A$.5
SD 1.540512x512DDIM (default)$.002
SD1.5601024x1024DDIM (default)$.003
SD1.5401024x1024DPM_2 (premium)$.009

Text Gen Solution

We offer simple, competitive token-based pricing for text gen endpoints, with prices varying depending on parameter size and quantization level:

Model SizesPer M Tokens
GTE-large$0.05
7B and 8B models$0.15
13B models$0.20
Mixtral-8x7B models$0.45
32B models$0.75
34B models$0.75
70B models$0.90
Mixtral-8x22B models$1.20

If you would like to explore pricing for other models, quantization levels, or specific fine tunes, contact us.

Compute Service

TrialProEnterprise
Deploy endpoint from any container (private or public registry)
Example models from community
CLI and SDK for containerizing + deploying Python models
Max endpoints per account210No limit
Max replicas per endpoint310No limit
Auto-acceleration of PyTorch modelsEarly access
Dedicated Customer Success Manager

Pro pricing for Compute Service

  1. Large 80: A100 GPU with 80GB memory @ $0.00145 per second (~$5.20 per hour)
  2. Large 40: A100 GPU with 40GB memory @ $0.00114 per second (~$4.10 per hour)
  3. Medium: A10 GPU with 24GB memory @ $0.00032 per second (~$1.15 per hour)
  4. Small: T4 GPU with 16GB memory @ $0.00011 per second (~$0.40 per hour)

Billing is by the second of compute usage, starting at the time when the endpoint is ready for inferences. The time when the endpoint is ready for inferences is when either the healtcheck on your end point begins returning 200, or if there is no healthcheck, the time you see the “Replica is running” log line in your events tab.

  • You will be billed for the total inference duration and timeout duration
  • You will not be billed for the duration of cold start

Example models in the platform have a pre-set hardware / pricing tier. If you create an endpoint from a custom model, you can choose the tier best suited to your needs.