OnQ Blog

Perception technologies and holographic telepresence

Jul 9, 2020

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

Mixed reality (XR) experiences like virtual meetings with holographic telepresence were once relegated to science fiction, but are now becoming a reality. This is due to the convergence of technologies like our recently-announced Qualcomm Snapdragon XR2 5G Platform, and new perception technologies that mimic how humans gain awareness and capture non-verbal communications (e.g., facial expressions and body language). Through the combination of these technologies, our vision is to provide such experiences through lightweight, comfortable glasses that dissipate heat from a limit of about one watt of power.

At this year’s Augmented World Expo (AWE), Prince Gupta, XR product manager at Qualcomm Technologies discussed the key elements necessary to realize this vision using devices built on the Snapdragon XR2 including:

  • body tracking including the head, hands, eyes, and face
  • realistic avatars
  • 3D reconstruction of scenes and objects
  • the importance of lighting techniques when rendering scenes and objects
  • semantic understanding of objects (i.e., knowing what an object is)

He also discussed three KPI’s that each of these elements must fulfill for effective experiences:

  • Accuracy: how well the perceived result compares to the perfect result (ground truth) (e.g., low motion-to-photon latency in XR headsets to handle head movements)
  • Robustness: how “edge cases” are handled (e.g., when sensors are blocked or a connection is lost)
  • Power efficiency: power and thermal efficiency of a technology or algorithm

If you would like to view Prince’s presentation, you can access it on our QDN On-Demand site.

Perception Technologies to Realize XR Vision

We hope you enjoy this presentation, and if you have an XR project that you’d like to show off, be sure to submit it to us for consideration as a possible feature on our projects page.

For additional information about XR, be sure to check out some of these other blogs:

Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.


Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

Hiren Bhinde

©2021 Qualcomm Technologies, Inc. and/or its affiliated companies.

References to "Qualcomm" may mean Qualcomm Incorporated, or subsidiaries or business units within the Qualcomm corporate structure, as applicable.

Qualcomm Incorporated includes Qualcomm's licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm's engineering, research and development functions, and substantially all of its products and services businesses. Qualcomm products referenced on this page are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Materials that are as of a specific date, including but not limited to press releases, presentations, blog posts and webcasts, may have been superseded by subsequent events or disclosures.

Nothing in these materials is an offer to sell any of the components or devices referenced herein.