Qualcomm® AI Runtime SDK (QAIRT)

Build Once, Deploy Everywhere with Qualcomm AI Runtime

Qualcomm^® AI Runtime SDK (QAIRT) is a suite of tools and runtimes to build, optimize, and run ML models generated by TensorFlow, PyTorch, and ONNX across the CPU, GPU, NPU, and Qualcomm Sensing Hub on mobile phones, tablets, Windows PCs, automotive systems, IoT devices, and embedded platforms powered by Snapdragon and Dragonwing platforms.

Product license agreement

Featured ResourcesQAIRT Overview

Discord

Use QAIRT Directly or Through Popular ML Framework Runtimes

There are two ways to use QAIRT:

Use QAIRT Directly

Build your own end-to-end native pipelines for building, deploying, debugging, and benchmarking ML models where you need to minimize inference latency in real-time applications, or optimize for power efficiency.

The QAIRT runtime API for C/C++ and Python provides various levels of control over model execution. Start by simply loading and running models and then add granular performance and efficiency enhancements as you delve deeper into model graph optimization, hardware-specific operators, and quantization strategies (e.g., FP32/16, INT8).

QAIRT also includes Qualcomm® Generative AI Inference Extensions (GENIE), a software library specifically for deploying Gen AI models comprised of multiple binaries that require a specific order of execution.

For developers familiar with the Qualcomm® AI Stack, QAIRT combines features previously available on the Snapdragon Neural Processing Engine (SNPE) SDK and the Qualcomm AI Engine Direct (QNN) SDK into a single, comprehensive solution.

Use Popular ML Framework

Use popular ML framework runtimes built on QAIRT including:

Each runtime abstracts the model execution details on Snapdragon® or Qualcomm Dragonwing™ processors. This approach lets you work with your models in your preferred framework without having to work directly with QAIRT but limits you to the features supported by your chosen framework. See QAIRT Overview for more information.

For Windows developers adding AI to a Windows on Snapdragon applications, find more detailed information here.
For IoT and embedded developers, find more detailed information here.
More information on the Qualcomm AI Stack and ecosystem can be found here.

Flexible Levels of Control

Work at a level that is right for you. The QAIRT runtime API provides various levels of control that you can choose for performance and optimization based on your requirements.

Flexible Workflows

Download a single SDK that supports ML model pipelines and runtime integrations across multiple ML frameworks or use an ML framework that is built on QAIRT but abstracts away its details.

Stability Across Releases

Simplify your testing and reduce churn with built-in Op versioning. Compile and run AI models through stable interfaces across SDK updates and new hardware releases, so you decide when to adopt newer versions.

Compile Once, Test Once

API versioning ensures application binary interface (ABI) compatibility with different library versions. Query for a specific interface at runtime, so you don’t have to recompile when you update the QAIRT library or you can run on other supported devices powered by Snapdragon or Dragonwing processors.