Today, most generative AI applications exist in the cloud. You ask your digital assistant a question, that question gets sent to a data center to get processed, and then the output is sent back to your device. Known as cloud AI processing, this is how generative AI applications work for most consumer devices, because only data centers are powerful enough to run these massive generative AI models.
This all changes with Snapdragon® X Elite Compute Platform. With an industry leading neural processing unit (NPU) that’s capable of 45 trillion operations per second (TOPS), this new compute platform has enough processing power to run generative AI models right on your PC. As more technologies, features, and apps adopt AI to create new user experiences and functionality, this on-device AI capability is incredibly important when it comes to performance, efficiency and privacy and security.
You’ve likely already heard from some Snapdragon Insiders about how excited they are about Snapdragon X Elite and its on-device AI prowess. Ahead of the first AI PCs powered by Snapdragon hitting store shelves later this year, let’s break down the three main benefits of on-device AI together with this new compute architecture.
Performance Reborn
The traditional cloud AI model is great in that all you need to access it is an internet connection. However, as generative AI grows in popularity, so do latency issues as more users access the great, but finite, compute resources of the cloud.
This is where the 45 TOPS NPU from Snapdragon X Elite has the potential to completely change the PC experience with on-device AI processing. With 3.5 times more performance than the next-best NPU out there today, Snapdragon X Elite NPU brings the data center to your device, handling AI-powered tasks, while freeing up the CPU and GPU for everything else. That means that you can do things like take advantage of AI video enhancements in Microsoft Teams, while multitasking in other apps without bogging the system down or completely draining your battery.
Efficiency Matters
Another benefit of on-device AI is that it can complement existing cloud AI in something known as hybrid AI. With the two working in tandem, your PC can use on-device processing for when latency really matters, and then utilize the cloud when it needs to draw on those much larger, more sophisticated models running only in a data center.
The end result is a PC that’s performant and, collectively, more efficient as it offloads work from the cloud. A recent analysis found that Snapdragon X Elite on-device AI capabilities can run generative AI 28 times more efficiently compared to similar data center generations. Hybrid AI will be crucial in bringing intelligent computing into the hands of more users, while potentially minimizing the environmental impact.
Improved Privacy and Security
When everything is processed on-device, your personal data stays on your PC, which means you get an unprecedented amount of security. It also means you can enjoy an unprecedented amount of personalization, opening up opportunities for your AI PC to train itself on personal datasets to better protect your privacy.
The Future of the AI PC is Now
The most exciting thing about on-device AI, is that you won’t have to wait for it. Recently, Snapdragon Insiders went hands-on with Snapdragon X Elite at our eXperience Day, and walked away impressed. Snapdragon Insiders like Devin Arthur were able to generate images in seconds, and experience smooth stable framerates in resource-intensive games.
We can’t wait to see what the wider Snapdragon Insiders community can do when the first devices with Snapdragon X Elite hit store shelves later this year.
How do you want to harness the power of Snapdragon X Elite on-device AI? Head over to Discord to discuss.
Join the conversation on Discord.
Do you have thoughts about this article? Join the conversation with fellow Snapdragon Insiders on Discord. Our Discord is the virtual lounge to talk shop about technology, Snapdragon events, and more with the community.
