Sign up
Log in
Sign up
Log in
Live Webinar: June 25th
Join our Builder's Roundtable to learn all about fine-tuning LLMs
Register now

Apache TVM is the backbone of OctoAI

Apache TVM is an open-source deep-learning compiler framework that empowers engineers to optimize and run computations efficiently, on any hardware backend.

Apache TVM hero image showing TVM logo and compilation for deep learning models

Open-source for optimal performance

yellow Apache TVM logo icon

TVM Unity

Empowering developers to optimize machine learning models and universally deploy them on any hardware backend.

WHY OCTOAI?

Meet the fastest growing open-source ML community

Started as a research project at the SAMPL group of Paul G. Allen School of Computer Science & Engineering, University of Washington, TVM is now in incubation at The Apache Software Foundation (ASF). With 500+ contributors and 6,000+ members using the framework for optimizations — including Amazon, Facebook, Arm and Qualcomm, and more — it is quickly becoming the standard for deep learning compilation.

Why OctoML Apache TVM and Apache logos

See who’s putting TVM to work

SiMa AI
Microsoft
AMD
Arm
Huawei
Qualcomm
AWS
Alibaba Cloud
Facebook
Intel
Nvidia
Edgecortix
HOW IT WORKS

TVM enables two kinds of optimizations

  • Computational graph optimization performs tasks such as high-level operator fusion, layout transformation, and memory management.

  • Tensor operator optimization and code generation layer that optimizes tensor operators.

Learn more
empower users blue icon
TVM Community

It's easy to get involved

blue icon for learning TVM tutorials

Learn from the tutorials

Compile PyTorch, TensorFlow, or CoreML models, and deploy pre-trained models on Android.

red Apache TVM logo icon

See the current TVM roadmap

Discover what's next with TVM — auto scheduling, quantization, auto tensorization, and more.

yellow join TVM forums icon

Join the discussion forums

Tap into the collective knowledge and expertise of over over 3,000 users (and counting!).

blue design documents for TVM icon

Design and developer guide

Jump into the core and help us build the future of MLOps.

Your choice of models on our SaaS or in your environment

Run any model or checkpoint on our efficient, reliable, and customizable API endpoints. Sign up and start building in minutes.

Sign Up Today