Extended Reality

Extended reality: the future of mobile computing.

Extended Reality (XR) is an umbrella term encapsulating Augmented Reality (AR), Virtual Reality (VR), mixed reality (MR), and everything in between. Although drawing the line between AR and VR experiences can be challenging, it is clear that many of the same underlying technologies will power revolutionary XR experiences. XR will transform everyday consumer experiences and many market verticals from industrial manufacturing and healthcare to education and retail.

Convergence: one device to rule them all.

At some point in the future, we envision the convergence of the smartphone, mobile VR headset, and AR glasses into a single XR wearable. In this scenario, a single pair of XR glasses will primarily be used for AR but will also occasionally be used for VR. XR could replace all the other screens in your life, like that big TV in your living room. Mobile XR has the potential to become one of the world’s most ubiquitous and disruptive computing platforms, similar to the smartphone today.

Solving the key XR technology challenges ahead.

Achieving our vision of sleek, comfortable, and fashionable XR glasses that are immersive, cognitive, and always-connected is extremely challenging. There are various technical problems that need to be solved for XR to reach mainstream adoption, but let’s focus on five key ones.

Display
Common Illumination
Motion Tracking
Power and Thermal
Connectivity

Display

XR needs a disruptive revolution in display technology to show richer visual content and switch seamlessly between virtual and real worlds. Besides being comfortable and durable, XR displays will need to solve a myriad of challenges, such as the vergence-accommodation conflict, and to enable both transparency & opaqueness, a wide field of view (FoV), extreme pixel density, high frame rates, and increased screen brightness.

Common Illumination

Making virtual objects in augmented worlds indistinguishable from real objects is a tremendous challenge. We need further convergence between the disciplines of computer vision and 3D graphics to deliver “common illumination” between virtual and real objects. This way, for example, a virtual picture frame that you place on your table will be indistinguishable from a real one under any lighting condition.

Motion Tracking

Intelligent on-device tracking of our head, hands, and eyes is required to interact intuitively with our XR glasses and create immersion. For example, low-latency and precise inside-out 6 degrees of freedom (6 DoF) head tracking is required to meet the motion-to-photon latency of world-scale VR. Also, for most use cases, the best controller is no controller, so hand tracking in AR-mode and creating realistic virtual hands in VR-mode are essential.

Power and Thermal

Meeting the always-on, compute intensive workloads of XR within the power and thermal constraints of sleek XR glasses is very challenging. Improvements in performance per watt, battery technology, material science, software efficiency, and standardization are required across the ecosystem to meet our vision.

Connectivity

Seamless and ubiquitous connectivity to the internet and cloud services is required for XR to reach its full potential. The streaming of XR video, which requires up to gigabits of bandwidth and very low latency, is expected to become the killer 5G use case in the next decade. 5G enhanced mobile broadband will provide multi-gigabit throughputs, over the air latency down to 1 millisecond, and uniform experience of 100 megabits per second even at the cell edge to meet this demand.

XR market acceleration.

Achieving our XR vision will take significant R&D and cooperation amongst top technology companies. Similar to smartphone evolution, XR designs will progressively become sleeker while tremendously increasing functionality. We're currently in the early days of a multi-decade cycle.

 

Qualcomm Technologies is leading XR forward and is uniquely positioned to deliver superior mobile XR solutions at low power. We’re developing the foundational technology required for XR, such as immersive 3D graphics, computer vision, machine learning, intuitive security, and 5G technologies. We’re also working with the ecosystem and investing in leading XR companies — all in an effort to make our vision of XR a reality sooner.

Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.

Stay informed with our mobile computing newsletter.

The latest

Videos

Webinar - The Mobile Future of Extended Reality

May 14, 2018

57:25

Snapdragon 821 processor: powering the new ASUS ZenFone AR

Jan 4, 2017

1:05

Augmented Reality to Enhance Education in San Diego

Jun 7, 2013

3:26

MURALI: Engineer, R&D / Augmented Reality

Mar 8, 2012

1:36

The Future of Innovation: Steve Mollenkopf

Jan 20, 2012

1:53

CES Keynote Recap from Qualcomm's Paul Jacobs

Jan 12, 2012

4:05

CES 2012 Opening Keynote: Qualcomm Chairman and CEO Dr. Paul Jacobs

Jan 11, 2012

1:21:15

GA Tech: Qualcomm's Augmented Reality SDK

Nov 23, 2011

1:05

Qualcomm AR SDK Dominoes Sample App

Oct 7, 2011

1:07

Qualcomm AR SDK Virtual Buttons Sample App

Oct 7, 2011

0:51

Qualcomm AR SDK Multi Targets Sample App

Oct 7, 2011

0:48

Qualcomm AR SDK Frame Markers Sample App

Oct 7, 2011

1:03

Qualcomm AR SDK Image Target Sample App

Oct 7, 2011

0:46

Pixel Punch: Qualcomm's Augmented Reality SDK

Sep 16, 2011

1:16

Qualcomm's Augmented Reality at the Fleet Science Center - Balboa Park

Aug 11, 2011

1:43

Snapdragon Lab: Developing with the Qualcomm Augmented Reality SDK

Jul 26, 2011

21:08

Tutorial: Qualcomm's Augemented Reality SDK

Jul 25, 2011

31:11

Defiant Development: Qualcomm's Augmented Reality SDK

Jul 25, 2011

1:51

Developing with Qualcomm's Augmented Reality Platform

Jun 29, 2011

44:02

Qualcomm Augmented Reality Sample Apps

May 19, 2011

3:50

Qualcomm Augmented Reality Challenge Winners

Apr 12, 2011

2:21

Conversations with Paul – Live from MWC 2011

Mar 1, 2011

2:38

Rock 'Em Sock 'Em Robots Test Mobile AR App

Feb 16, 2011

0:55

Winning App: Augmented Reality Developer Challenge 2010

Feb 15, 2011

0:37

Augmented Reality Developer Challenge 2010 Sizzle Reel

Feb 14, 2011

3:12

Imagine All the Possibilities with Augmented Reality

Jan 7, 2011

2:29

Documents