Immersive Experiences

New era of immersive experiences

Immersive experiences stimulate our senses—they draw us in, transport us to another place, and keep us in the moment. Immersion enhances everyday experiences, making them more realistic, engaging, and satisfying, on  all our devices—whether we are playing a video game on our smartphone, video conferencing on our tablet, or watching sports on our virtual reality headset. Our goal is to provide the appropriate level of immersion based on the device form factor, activity, and context.

Qualcomm Immersive Experiences

Nov 10, 2015

1:28

Full immersion requires broader dimensions.

The three pillars of immersive experiences are visual quality, sound quality, and intuitive interactions. Full immersion can only be achieved by simultaneously focusing on the broader dimensions of these pillars.

Visual quality

Visual quality isn’t only about the quantity of pixels, such as the resolution and frame rate. It’s also about the quality of pixels—color accuracy, contrast, and the just right amount of brightness are equally critical to making experiences more immersive.

Resolution

Increased definition and sharpness

Frame rate

Reduced blurring and latency

Color accuracy

More realistic colors through an expanded color gamut, depth, and temperature

Contrast and brightness

Increased detail through a larger dynamic range and lighting enhancements

Sound quality

The two key dimensions of sound quality are high resolution audio and sound integrity. We are truly immersed in the experience only when the sound is realistic and matches the visual. In contrast, when the sound quality is compromised, we immediately notice it—think of a movie with muffled audio or mismatched lip movements.

High resolution audio

Sampling rate: Increased sampling rates to match human hearing

Precision: Increased bits-per-sample for improved audio fidelity

Sound integrity

3D surround sound: Accurate 3D capture and playback of audio

Clear audio: Zoom and focus on the important sound while filtering out the noise

Intuitive interactions

Intuitive interactions keep us immersed in an experience by stimulating our senses with realistic feedback. As humans, we immediately notice when things do not behave in natural ways. Natural user interfaces and contextual interactions are the two key dimensions for intuitive interactions.

Natural user interfaces

Seamlessly interact with devices through intuitive interfaces, such as gestures and voice.

Contextual interactions

Devices intelligently interact with us and provide personalized experiences based on context.

Efficiently enhancing the broader dimensions

Enabling immersive experiences within the power, thermal, and performance constraints of mobile devices is challenging. The optimal way to enhance the broader dimensions of immersion requires an end-to-end approach, heterogeneous computing, and utilizing cognitive technologies.

End-to-end approach
Heterogeneous computing
Cognitive technologies

End-to-end approach for system-level optimization

Taking an end-to-end approach means thinking holistically at the system level, understanding all the challenges, and working with other companies in the ecosystem to develop comprehensive solutions. For example, the end-to-end approach is essential for maintaining color accuracy—one of the key aspects of pixel quality—from camera to display.

Heterogeneous computing for efficiency

Heterogeneous computing uses specialized engines across the SoC to address the processing requirements of immersive experiences at low power and thermals. For example, image processing tasks like computational photography use the majority of the processing engines.

Cognitive technologies are making experiences more immersive

Cognitive technologies, like machine learning and computer vision, can make experiences more immersive. They enable devices to perceive, reason, and take intuitive actions so that devices can learn our preferences, personalize our experiences, and enable intuitive interactions.  For example, a cognitive camera is designed to improve visual experiences by automatically capturing better pixels. By understanding the scene through machine learning and computer vision, your device has the ability to automatically configure the camera settings, such as exposure time and white balance. 

Virtual reality is the ultimate level of immersion

To be truly immersive, virtual reality must stimulate our senses with realistic feedback. It can make everyday experiences, like playing games, watching movies & sports, video conferencing, and virtual travel, even more immersive.

 

Virtual reality places extreme requirements on several dimensions of visual quality, sound quality, and intuitive interactions. For example, we need tremendous pixel quality and quantity because the screen is so close to the eyes. We need realistic 3D positional audio so the sound is accurate to the real world. And we need interfaces so intuitive and responsive that you don’t realize you are even dealing with an interface. By focusing on all of these dimensions, a fully immersive experience can be achieved.

Qualcomm Technologies is leading the way.

Qualcomm Technologies is uniquely positioned to enhance the broader dimensions of immersive experiences by custom designing specialized engines across the SoC and offering comprehensive ecosystem support. Snapdragon processors are designed to provide an optimal heterogeneous computing solution by taking a system approach. We provide development and optimization tools to the ecosystem, designed to enable content creation and optimized devices.

Augmented Reality

Learn how AR is quickly becoming the next mobile computing platform.

Virtual Reality

Find out the latest on the ultimate level of immersion.

Extended Reality

Find out how XR encapsulates both AR and VR, and ultimately leads to a converged device.

Stay informed with our mobile computing newsletter.

Webinar: The Next-Gen Technologies Driving Immersion

Feb 13, 2017

58:59

The latest