How Snapdragon technology is revolutionizing smartphone photography with the Qualcomm Spectra ISP

Smartphone photography has transformed dramatically, and at the heart of this revolution is the Qualcomm Spectra™ Image Signal Processor (ISP) inside Snapdragon® chipsets. We know that Snapdragon Insiders are incredibly talented photography enthusiasts, so we wanted to take a deep dive into how smartphone cameras have changed over time, and how the Qualcomm Spectra ISP continues to change the game. 

As any Snapdragon Insider knows, the Qualcomm Spectra ISP vastly enhances the quality of your smartphone images and videos, fundamentally altering how you engage with, create, and consume digital imagery. To better understand the impact of the Qualcomm Spectra ISP, it’s helpful to take a closer look at its evolution alongside the evolution of mobile photography more broadly. (And don’t miss our Q&A with Judd Heape, Qualcomm Technologies’ resident camera expert, which you can read below 👇.) 

 

The critical role of the ISP

An ISP essentially functions as your camera's brain, transforming raw sensor data into beautiful, clear images. Without the ISP's sophisticated processing capabilities, smartphone photography as we know it today would not exist. The ISP performs numerous functions seamlessly, managing color correction, exposure, focus, and more. It’s similar to how your human brain processes electrical signals from your eyes. Without an ISP, raw image data from the camera’s sensor would be unintelligible.  

Early mobile cameras were primitive, capturing images that were often blurry with washed-out colors. Today, thanks to advancements in ISP technology, your smartphone can capture images up to 200 megapixels and record videos in breathtaking 8k resolution — vastly enhancing your creative potential. 

These improvements have elevated the quality of photos and videos and introduced capabilities that rival — and sometimes surpass — those of traditional cameras. For instance, you can now shoot sharp images in low-light conditions with a smartphone camera, capturing crisp, vibrant photos where once you could not. That is, at least not without a very expensive (and conspicuous) DSLR rig. The Qualcomm Spectra ISP has put the power of expensive professional cameras inside your smartphone. 

 

Introduction of the Qualcomm Spectra ISP

The release of the Qualcomm Spectra ISP in  2016 was a huge leap forward in the smartphone photography industry. This intelligent processor goes beyond basic image processing by understanding and interpreting the entire scene, helping you get the best shot in every situation. It can recognize elements like skin, textiles, and landscapes, applying specific enhancements to each to optimize the final image. This ability to process pictures contextually allows for real-time improvements in both photo and video modes, ensuring that every shot is your best shot. 

One of the Qualcomm Spectra ISP’s most significant technical enhancements is the expansion to 18-bit color depth. This expanded bit depth delivers extreme dynamic range, color, and sharpness, with speeds of up to 3.2 gigapixels per second. You won’t find an 18-bit ISP in most legacy and professional cameras, let alone most smartphone cameras. The Qualcomm Spectra ISP is also a triple-ISP, which means you can capture photos and videos from three separate cameras simultaneously. Capture one brilliant 200 MP photo, or combine three 36 MP cameras and take snapshots while simultaneously capturing 4K video at 30 frames per second. 

Before the Qualcomm Spectra ISP, our most advanced ISP was 14-bit. Four bits might not sound like a huge leap, but it translates to an ISP that captures 4,096 times the amount of data than its predecessor. For the photo gearheads out there, it also means you get an additional four stops — vastly increasing the dynamic range of your images. 

Capturing perfect color and resolution during the day is one thing, but low-light photography is inherently more difficult. The Qualcomm Spectra ISP makes shooting at night a breeze with a dedicated low light engine that captures 30 images in one second, combining them to make one perfect picture. And AI-accelerated features like a dedicated bokeh engine enable you to create painterly images with artfully blurred backgrounds. And that’s not all: Qualcomm Technologies’ collaboration with Visionary.AI allows users to capture videos in darkness with vivid color in stunning 4K at 30 frames per second. (Bonus: you can even up-convert the video to 4K at 60 frames per second.) 

 

The role AI plays 

One significant issue impacting smartphone photography in the era of generative AI is ensuring the authenticity of images. To address this, we’ve partnered with companies like Truepic to embed cryptographic proofs into images at the capture point, verifying their authenticity. Think of it like a ledger — generated by the Qualcomm®  Trusted Execution Environment (TEE) hardware onboard, meaning it’s inherently secure — that keeps track of your image's data, including the original timestamp and location information and all subsequent alterations. 

Furthermore, AI will also play an increasingly central role in enhancing ISP capabilities, improving the quality of your photos and videos while personalizing camera functions according to user preferences and regional aesthetic trends. For example, in regions where warmer tones are preferred, AI can automatically adjust settings to produce images that resonate more with local tastes. It can also help you frame an image, and even learn your shooting style to suggest filters and other stylistic or technical improvements. 

Simply put, the Qualcomm Spectra ISP and the power of AI will improve and enhance even the most advanced photographer’s skillset. And we know there are a lot of advanced photographers in the Snapdragon Insiders community. 

 

What it means for Snapdragon Insiders 

For Snapdragon Insiders — and consumers as a whole — these technological advancements mean that taking a high-quality photo or video is as simple as pointing and shooting. The Qualcomm Spectra ISP, with its automatic and intelligent settings, delivers consistently excellent results without requiring manual adjustments. Now, amateurs can achieve professional-level photography with ease. 

The Qualcomm Spectra ISP has transformed what's possible with smartphone photography. As we continue to innovate, we're not just enhancing how images and videos are processed — we’re shaping the future of mobile photography. And that future is bright. 

 

Your questions answered

Over on Discord, we asked you what you wanted to know about the present and future of Snapdragon mobile photography. And boy, you had some great questions. Here, Judd Heape (VP, Product Management, Camera, Computer Vision, and Video at Qualcomm Technologies, Inc.) provides the answers:

When will we be getting an optical zoom lens on devices with Snapdragon?

Optical zoom lenses are in development, with technologies like periscope setups allowing for greater zoom capabilities. I expect to see true optical zoom in the next few years, as actuator technology advances to facilitate lens movement within compact spaces.

What about multi-camera simultaneous RAW capture? Is it possible?

Technically, simultaneous RAW capture across multiple cameras is possible today. The main challenge is the large file sizes generated, which could impact storage and bandwidth. However, advancements continue to mitigate these issues.

Is there a possibility of incorporating an AI prompt in manual mode to help improve results?

Absolutely. AI can assist in manual mode, suggesting composition adjustments or optimal settings based on the scene. This integration of AI will help bridge the gap between professional and casual photographers.

Can Qualcomm create a preset that standardizes camera output across Android devices?

While Qualcomm Technologies provides the technology backbone in many devices, camera application is a key area where OEMs prefer to differentiate their products. Each OEM selects different sensors, lenses, and software, making a universal baseline challenging. However, Qualcomm Technologies continuously works to enhance the consistency and quality of camera outputs within the constraints of each OEM's customization.

Why do vendors often limit their devices to 12-megapixel outputs, despite having capable sensors for higher resolutions?

The preference for 12-megapixel outputs has traditionally been to optimize light sensitivity and reduce noise, particularly in low light conditions. However, with advances in sensor technology, higher resolutions are becoming more feasible without compromising image quality.

Can real-time semantic segmentation improve over time, or does it need pre-training?

Our current systems are pre-trained for specific categories like faces, foliage, or textiles. However, we are moving towards more adaptable systems that can learn and segment new objects in real-time based on user interactions.

Will we see Micro Four Thirds sensors in high-end phones?

Incorporating larger sensors like Micro Four Thirds into smartphones presents physical challenges due to the increased size and thickness. However, Snapdragon technology might also start appearing in non-smartphone cameras that utilize larger sensors, expanding the use of our technology in professional-grade equipment.

Are there plans for a Snapdragon camera app that utilizes both the ISP and AI NPU and will it be available in the Play Store?

As ISPs and NPUs evolve, they will work more seamlessly to improve image processing. While Qualcomm Technologies may not release a standalone camera app, our partners and OEMs can access AI algorithms via the Qualcomm® AI Hub. Essentially, we enable our OEM partners to leverage this integrated technology to create customized applications that could be available for consumers through platforms like the Google Play Store. 

What’s the future of anti-jitter and smooth lens transitions in devices with Snapdragon?

We are continuously improving technologies like spatial alignment and translation to ensure smooth transitions between different camera sensors. Our collaboration with image sensor manufacturers also helps optimize settings quickly and efficiently, reducing power consumption and enhancing the user experience.

 

How has the Qualcomm Spectra ISP improved your mobile photography? Head over to Discord to discuss.