OnQ Blog

Qualcomm Snapdragon powering new mobile experiences on Snap [video]

Mar 30, 2020

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

Snapchat needs no introduction. It has become a truly global phenomenon thanks to its 218 million daily users creating over 3.5 billion Snaps per day, making it arguably the most widely-used social camera experience in the world.

The device camera is essential to the Snapchat experience, and the lenses filter creates a fun and engaging experience with friends and family. These lenses see and track your face, then apply various special effects called “style transferring.” Using this effect, users can see their faces morphed in real time on screen. The lenses filter is based on artificial Intelligence, and the inferencing performance of “neural nets” play a critical role in how smooth the video experience is in preview mode. In order for the video to qualify as smooth video (without lag), the frame rate should be at least 30 frames per second (FPS). That wasn’t always the case for this particular Snapchat filter, as the frame rate wasn’t optimal processing on the CPU.

Qualcomm Technologies debuted the Qualcomm Snapdragon 865 Mobile Platform at its annual Tech Summit in Hawaii in December 2019, and with it a new Qualcomm AI Engine featuring a beefed-up Qualcomm Hexagon digital signal processor. By accelerating the AI neural networks on the Hexagon processor, video capture sped up four times faster compared to processing on the CPU and 2.2 times faster compared to the GPU. This means this experience was able to hit “smooth video” at 30 FPS.  The science behind all of this is the Snapchat application accessing the Hexagon processor with a tool called Hexagon NN Direct, which allows Snapchat’s runtime and framework to directly access our specialized Qualcomm Technologies library and accelerate the Snapchat filters on the Hexagon hardware. You can see the difference in the video below. On the left, the video is being run on a CPU-based filter and on the right, it is being accelerated on Hexagon. Notice the smoothness of the filter that can critically enhance the user experience.

This is an early and compelling collaboration that Qualcomm Technologies has participated in with another leading tech company to help drive next-generation artificial intelligence experiences with the Snapdragon 865 mobile platform.

Snapchat performance comparison, Snapdragon vs competition.

Mar 17, 2020 | 0:27

 

 

Qualcomm Snapdragon, Qualcomm AI Engine, and Qualcomm Hexagon are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

 

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

Related News

©2020 Qualcomm Technologies, Inc. and/or its affiliated companies.

References to "Qualcomm" may mean Qualcomm Incorporated, or subsidiaries or business units within the Qualcomm corporate structure, as applicable.

Qualcomm Incorporated includes Qualcomm's licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm's engineering, research and development functions, and substantially all of its products and services businesses. Qualcomm products referenced on this page are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Materials that are as of a specific date, including but not limited to press releases, presentations, blog posts and webcasts, may have been superseded by subsequent events or disclosures.

Nothing in these materials is an offer to sell any of the components or devices referenced herein.