OnQ Blog

Get immersed: scene-based audio with MPEG-H

Apr 20, 2017

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

Qualcomm Technologies has been working on audio technology for next generation television broadcasts using the new MPEG-H standards. The audio technology is designed to help content creators, content hosts, consumer electronics manufacturers, and broadcasters create, capture, and render true-to-life immersive 3D audio experiences and scene-based audio so the viewer feels immersed in sound.

At the upcoming National Association of Broadcasters (NAB) show, we’ll showcase a comprehensive live production of immersive audio for both traditional TV and VR. The production will use scene-based (Higher Order Ambisonic, or HOA) and object-based audio, while the transmission will be using the MPEG-H 3D audio standard. The audio production will use multiple audio sources, including ambisonic and spot microphones. The video production will be through traditional TV cameras as well as an Omnicast VR camera. The audio production can simultaneously feed into both OTA (for linear TV) and OTT (for both linear TV and VR consumption) transmission.

The production process will show monitoring using sound bars as well as immersive loudspeaker layouts. The playback process will show flexible rendering to any number of loudspeakers, audio-rotation over loudspeakers for 360 video, as well as live VR overhead mounted displays.

Qualcomm Technologies will also showcase its high-quality HEVC cloud and server-based encoder, which is engineered for over-the-top services and 4K real-time encoding with multi-threading on a single machine. The high-quality HEVC encoder has significantly lower complexity than x265 for the same coding efficiency.

Also at our booth (#SU11013) our friends at b<>com will demonstrate a live VR feed combining scene-based audio with a multiple camera VR system. HOA scene-based audio encoded using MPEG-H will be binauralized and delivered to a VR headset, where the essential component that scene-based audio provides to VR can be experienced with head-tracking. You can learn more about b<>com at NAB at booth #N2035-FP.

Check out the video below for a quick overview of scene-based audio, and please wear headphones for the best binaural audio experience:

Scene-based audio for highly immersive experiences

Jun 23, 2016 | 1:56

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

PJ Jacobowitz

Staff Manager, Marketing, Qualcomm Technologies