OnQ Blog

Redefining “Point and Shoot” with the Qualcomm AI Engine [video]

May 12, 2021

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

Getting your hands on a smartphone powered by a Qualcomm Snapdragon Mobile Platform with multiple cameras on the back will catapult you into the next era of “Point and Shoot.”

For years, Snapdragon has enabled incredible triple-camera smartphones that capture professional quality photos and videos. The Samsung Galaxy S21 Ultra 5G, the new OnePlus 9 Pro, and others  feature at least three cameras in the rear that take advantage of multiple sensor technologies. So what are the differences between older 3-camera phones and the ones built with the Snapdragon 888?

The latest Qualcomm Spectra 580 is our first triple ISP-enabled platform. Before this, we had a leading dual ISP solution that supported multiple cameras and a variety of functions on world-class smartphones. The number of ISPs dictate how many cameras can potentially capture videos and photos at the same time.  When you’re pinching and zooming between two distinct cameras to record that perfect moment, a 3-camera system using dual ISPs is intelligently predicting which camera you might be switching to.

But, with Qualcomm Spectra 580’s triple ISP system, all three cameras can now be on simultaneously so there is no guessing all cameras are locked, loaded, and ready for action. With triple ISPs, you can even enable a feature called “Director’s View,” like the one found in the Samsung Galaxy 21. With it, you can record yourself with the front camera while simultaneously capturing the scenery in front of you with the rear ones.

Snapdragon 888 is more than a triple ISP – it has a Qualcomm AI Engine that can improve the camera experience, too. When zooming with three cameras, the moment you switch from one camera to another, you might see a tiny bump or a slight change of color.  That’s due to the physical distance between these three camera lenses and a slight difference between the camera sensors. These are complex challenges, but we can use AI to solve them and smoothen the transition.

Thanks to the powerful 6th gen Qualcomm AI Engine, specifically on the new Qualcomm Hexagon 780 processor, it can run these clever AI neural networks to make virtually every experience better on your device. Our friends at Arcsoft, a longtime member in our Qualcomm Platform Solutions Ecosystem program, utilize an innovative AI neural network that is trained to eliminate these artifacts and differences between lenses and sensors so you can have a great multi-camera video recording experience without the glitches that comes with switching between cameras. Thanks to the Qualcomm Platform Solutions Ecosystem program, the team works closely with Arcsoft to make sure that they can leverage and optimize their software on our Qualcomm AI Engine to get the best performance and user experience out of it.

AI Camera Demo with Arcsoft

May 4, 2021 | 1:19

Learn how Arcsoft is able to advance their autozoom feature

Discover the Qualcomm Platform Solutions Ecosystem

Learn more

The Qualcomm AI Engine is so powerful that it can run multiple inference neural networks at the same time, also while running the smooth zoom neural networks. In addition, it can also run Arcsoft’s AutoZoom feature, which keeps the subject that you are shooting in the frame automatically even if you switch cameras between ultra-wide and telephoto. This creates a cool cinematic effect that you typically see only in movies. You can also add in AI-based bokeh effects to give you that more dramatic shot. All of these AI-based effects effortlessly turn you into a professional cinematographer.

Watch for a flurry of premium smartphones making waves in the next few months, many of which will be powered by the Snapdragon 888 Mobile Platform.

 

Qualcomm AI Engine, Qualcomm Spectra, Qualcomm Snapdragon and Qualcomm Hexagon are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

 

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

Judd Heape

Vice President, Product Management, Qualcomm Technologies

©2021 Qualcomm Technologies, Inc. and/or its affiliated companies.

References to "Qualcomm" may mean Qualcomm Incorporated, or subsidiaries or business units within the Qualcomm corporate structure, as applicable.

Qualcomm Incorporated includes Qualcomm's licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm's engineering, research and development functions, and substantially all of its products and services businesses. Qualcomm products referenced on this page are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Materials that are as of a specific date, including but not limited to press releases, presentations, blog posts and webcasts, may have been superseded by subsequent events or disclosures.

Nothing in these materials is an offer to sell any of the components or devices referenced herein.