OnQ Blog

Get immersed: scene-based audio with MPEG-H

Apr 20, 2017

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

Qualcomm Technologies has been working on audio technology for next generation television broadcasts using the new MPEG-H standards. The audio technology is designed to help content creators, content hosts, consumer electronics manufacturers, and broadcasters create, capture, and render true-to-life immersive 3D audio experiences and scene-based audio so the viewer feels immersed in sound.

At the upcoming National Association of Broadcasters (NAB) show, we’ll showcase a comprehensive live production of immersive audio for both traditional TV and VR. The production will use scene-based (Higher Order Ambisonic, or HOA) and object-based audio, while the transmission will be using the MPEG-H 3D audio standard. The audio production will use multiple audio sources, including ambisonic and spot microphones. The video production will be through traditional TV cameras as well as an Omnicast VR camera. The audio production can simultaneously feed into both OTA (for linear TV) and OTT (for both linear TV and VR consumption) transmission.

The production process will show monitoring using sound bars as well as immersive loudspeaker layouts. The playback process will show flexible rendering to any number of loudspeakers, audio-rotation over loudspeakers for 360 video, as well as live VR overhead mounted displays.

Qualcomm Technologies will also showcase its high-quality HEVC cloud and server-based encoder, which is engineered for over-the-top services and 4K real-time encoding with multi-threading on a single machine. The high-quality HEVC encoder has significantly lower complexity than x265 for the same coding efficiency.

Also at our booth (#SU11013) our friends at b<>com will demonstrate a live VR feed combining scene-based audio with a multiple camera VR system. HOA scene-based audio encoded using MPEG-H will be binauralized and delivered to a VR headset, where the essential component that scene-based audio provides to VR can be experienced with head-tracking. You can learn more about b<>com at NAB at booth #N2035-FP.

Check out the video below for a quick overview of scene-based audio, and please wear headphones for the best binaural audio experience:

Scene-based audio for highly immersive experiences

Jun 23, 2016 | 1:56

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

PJ Jacobowitz

Staff Manager, Marketing

Related News

©2021 Qualcomm Technologies, Inc. and/or its affiliated companies.

References to "Qualcomm" may mean Qualcomm Incorporated, or subsidiaries or business units within the Qualcomm corporate structure, as applicable.

Qualcomm Incorporated includes Qualcomm's licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm's engineering, research and development functions, and substantially all of its products and services businesses. Qualcomm products referenced on this page are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Materials that are as of a specific date, including but not limited to press releases, presentations, blog posts and webcasts, may have been superseded by subsequent events or disclosures.

Nothing in these materials is an offer to sell any of the components or devices referenced herein.