OnQ Blog

QTI announces support for ONNX, simplifying AI choices for developers

Oct 10, 2017

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

So you’ve started working with neural networks and artificial intelligence (AI), but did you find it hard to choose one machine learning framework over another — like Caffe2, Caffe, TensorFlow, Microsoft Cognitive Toolkit or PyTorch? Whether you’re training your own models or using freely available ones, you’ll want to choose a framework that you stick with all the way through production.

Qualcomm Technologies (QTI) joins ONNX

In September, Facebook and Microsoft introduced the Open Neural Network Exchange (ONNX) format. ONNX is an interchange format intended to make it possible to transfer deep learning models between the frameworks used to create them.

With ONNX, Facebook can acquire a trained model created elsewhere with PyTorch, for example, and use it with Caffe2 Facebook’s preferred framework - for the inference stage of machine learning. Microsoft, in turn, has announced that its own Cognitive Toolkit will support ONNX, initially for inference.

This initiative aligns with our goal of supporting neural network execution on Qualcomm Snapdragon mobile platforms that can be accelerated by the Snapdragon Neural Processing Engine (NPE) SDK. As such, QTI welcomes the opportunity to participate in ONNX, which helps make it easier for developers to utilize multiple frameworks.

What ONNX means for OEMs, ODMs and developers

Openness generally works in favor of the developer, so there are several ways that your AI applications can benefit from ONNX:

  • If you’ve started using the NPE SDK to run applications like object tracking, natural language processing and speaker recognition on mobile devices at the network edge, ONNX is designed to give you more latitude in the models you can deploy.
  • If you’ve optimized the performance of your neural networks and want to share them, ONNX helps widen the field of AI developers who can use them. It also helps widen the field of models you can borrow from other developers.
  • Let’s face it: every time a new technology opens up, developers have to make platform choices. Programming language, architecture, development environment, machine learning tool... you’re always making a choice that you and your team have to live with for a long time. ONNX helps you reduce the risk of painting yourself and your app into a corner because of the machine learning framework you chose.

ONNX holds the promise of smoothing the path between research and production.

Next steps

Curious? You’ll find ONNX source code, documentation, binaries, Docker images and tutorials available right now on GitHub. Test-drive ONNX. We’ll keep you posted on progress of ONNX integration into the Snapdragon portfolio.

 

Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.

 

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

Related News

©2020 Qualcomm Technologies, Inc. and/or its affiliated companies.

References to "Qualcomm" may mean Qualcomm Incorporated, or subsidiaries or business units within the Qualcomm corporate structure, as applicable.

Qualcomm Incorporated includes Qualcomm's licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm's engineering, research and development functions, and substantially all of its products and services businesses. Qualcomm products referenced on this page are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Materials that are as of a specific date, including but not limited to press releases, presentations, blog posts and webcasts, may have been superseded by subsequent events or disclosures.

Nothing in these materials is an offer to sell any of the components or devices referenced herein.