OnQ Blog

Vision-based Augmented Reality

Feb 7, 2011

Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries.

Since releasing a beta of Qualcomm’s vision-based mobile augmented reality (AR) tools and software development kit (SDK) last year, we have seen high levels of interest from a variety of industries. A free SDK and extension for Unity enables developers to easily create apps using AR on current Android smartphones with suitable cameras and processors.

Mobile augmented reality comes in two forms: compass/GPS-based, which is generally used for navigation and vision-based, which is the technique of using a phone’s camera, processor and display to recognize and augment what the camera sees. This latter form of mobile augmented reality is a new type of interactivity which lets developers, publishers, advertisers and others create surprising and compelling experiences which had until now not been possible.

An example is being able to walk into a toy store and see a doll house come to life by merely pointing your smartphone at the outside of the package.

Previous generations of vision-based AR products were non-mobile and required users to hold the image target (such as cards, consumer product packages and magazine covers) in front of the computer’s camera. Mobile AR lets users intuitively move the camera wherever they want to look on whatever image target they’ve chosen.

This mobile interactivity will let consumers conveniently see AR while walking around town, while shopping at the store, wandering through a theme park, standing in front of a poster, etc. Consumers can use smartphones to look at AR-enabled images and to do surprising new things.

Today people are using mobile AR to create new types of games, advertising, magazines, toys, books and, well, it might be said, experiences that defy labeling. How does one describe an advertisement for clothing where the user touches “buttons” printed on paper to change the color of the displayed clothes? Similarly, can we call it a pop-up book when the “pop-ups” are 3D animated graphical characters, which emerge from the printed illustrations?

Qualcomm’s Corporate Research and Development Group is leading in the effort to create new tools, middleware and promotions to enable mobile augmented reality. As such, in June 2010, we announced the Qualcomm AR Developer Challenge to encourage developers to create effective, entertaining and functional AR apps. The awards, totaling $200,000, will be announced next week!

The Qualcomm AR SDK became available in early October 2010 and developers from around the world submitted apps by January 14, 2011. These developers had less than four months to create fun and compelling apps based on the Qualcomm AR SDK. Check back on February 15 when we’ll reveal the winners - $125,000 for first place; $50,000 for second; and $25,000 for third. In the meantime, take a look at the video of some of the compelling AR apps we received.

Mobile technology continues to undergo rapid development, and as we’ve seen from the AR Challenge submissions, we expect to be pleasantly surprised by what developers and content producers do with this new form of mobile interactivity.

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries ("Qualcomm"). Qualcomm products mentioned within this post are offered by Qualcomm Technologies, Inc. and/or its subsidiaries. The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

Peter Marx

Vice President, Business Development

Related News

©2021 Qualcomm Technologies, Inc. and/or its affiliated companies.

References to "Qualcomm" may mean Qualcomm Incorporated, or subsidiaries or business units within the Qualcomm corporate structure, as applicable.

Qualcomm Incorporated includes Qualcomm's licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm's engineering, research and development functions, and substantially all of its products and services businesses. Qualcomm products referenced on this page are products of Qualcomm Technologies, Inc. and/or its subsidiaries.

Materials that are as of a specific date, including but not limited to press releases, presentations, blog posts and webcasts, may have been superseded by subsequent events or disclosures.

Nothing in these materials is an offer to sell any of the components or devices referenced herein.