Elevating AI in Capture One with DirectML and Qualcomm Hexagon NPU
Co-written with Gokul Tonpe.
The Snapdragon X Series platforms usher in a new era of AI on PCs by bringing in the powerful Qualcomm Hexagon Neural Processing Unit (NPU). The NPU enhances AI integration across various applications, from creative and collaborative projects to productivity and gaming. Our goal is to make AI accessible to everyone, one PC at a time.
To achieve this goal, we partnered with Microsoft to deliver scalable AI software solutions to improve time to market for developers. Additionally, collaborations with companies like CaptureOne bring AI experiences to life through easy-to-use APIs, such as DirectML.
How Snapdragon X Series platforms benefit from Qualcomm Hexagon NPU and DirectML integration
The Snapdragon X Series platforms, featuring the Qualcomm Hexagon NPU, brings unprecedented AI capabilities to PCs, delivering high-quality AI performance without compromising system responsiveness, battery life, or other critical functions. By offloading AI tasks to the Hexagon NPU, the Qualcomm Oryon CPU and Adreno GPU remain free to handle other essential activities such as web browsing, gaming and multimedia.
Qualcomm Technologies' work with Microsoft enhances both developer and user experiences by optimizing DirectML for the Hexagon NPU. This collaboration boosts scalability and efficiency for AI acceleration, empowering developers to fully utilize the NPU's capabilities and deliver superior AI-driven software solutions.
DirectML, known for its robust GPU support, now extends its versatility by adding Qualcomm Hexagon NPU support. This enhancement allows developers to transition from GPU to NPU deployment with minimal code modifications, simplifying the optimization of AI workloads. By leveraging the specialized capabilities of the NPU, developers can achieve enhanced performance and efficiency, ensuring their AI applications adapt effortlessly to the best available hardware.
How to use DirectML application to select NPU or GPU with a single line of code
The DirectML application can easily select the target DirectX device type as NPU or GPU with a single line of code.
DXCORE_ADAPTER_ATTRIBUTE_D3D12_GENERIC_ML --> Selects NPUDXCORE_ADAPTER_ATTRIBUTE_D3D12_CORE_COMPUTE --> Selects GPU
Head over to GitHub to reference this sample DML application that demonstrates executing a model using NPU and GPU device.
How CaptureOne enhances their photo editing experience with DirectML and Qualcomm Hexagon NPU
Capture One is a professional photo editing software known for its advanced tools, seamless RAW handling, and powerful tethering capabilities. Designed for photographers who demand precision and control, Capture One offers color accuracy, fast workflow, and creative freedom to bring creator’s vision to life.
Capture One leverages DirectML on the Qualcomm Hexagon NPU, enhancing its AI-driven features. Auto-Cropping and Match Look are standout features that especially benefit from leveraging the Hexagon NPU.
By using Match Look, you can match the style or edits of a reference image with a single click. This feature uses DirectML on the Qualcomm Hexagon NPU to accelerate the experience, ensuring that style matching is performed quickly and accurately. Match Look allows photographers to maintain a consistent aesthetic across their portfolio effortlessly, whether replicating the color grading of a specific image or achieving a uniform look for a series of photos. This tool simplifies the process, saving time and ensuring visual coherence.
Auto-Cropping is another feature that benefits from leveraging the Hexagon NPU. Capture One can now perform Auto Cropping with remarkable speed and accuracy, making sure that each image is perfectly framed without compromising on quality. This AI processing capability allows photographers to streamline their workflow, saving time and effort.
For developers, the addition of Qualcomm Hexagon NPU support in DirectML means the freedom to switch from GPU to NPU deployment with minimal code changes. This flexibility is crucial for Capture One, as it allows the software to optimize AI workloads efficiently. By using the specialized capabilities of the Qualcomm Hexagon NPU, Capture One ensures that its Auto Cropping and Match Look features deliver consistent, high-quality results, empowering photographers to focus more on their creative process and less on manual adjustments.
Capture One’s NPU powered AI experiences will be available commercially on Snapdragon X Series devices starting early 2025. Stay tuned for further announcements!
CaptureOne Demo
Oct 25, 2024 | 1:42
Getting started with DirectML on Hexagon NPU
This getting started article from Microsoft is a good place to kick off your process as it outlines system requirements and provides ESRGAN super-resolution model sample.
Helping you port your apps to Windows on Snapdragon is a big part of our developer-first focus. Visit the Windows on Snapdragon developer portal and take a look at the tools and resources we’ve made available.
Something is missing? Ask your questions, bring your suggestions and get prompt support from your technical team on Developer Discord.
