Would You like a feature Interview?
All Interviews are 100% FREE of Charge
Last week, Mark Zuckerberg announced that Meta and the BMW Group have partnered to develop a research project focused on integrating virtual and augmented reality (AR) into vehicles.
First announced in 2021, the partnership aims to explore how this technology can be used to improve passenger and driver experiences.
This isn’t the first time we’ve seen VR technology used in a passenger car. Hororide has already launched its own version of in-car VR entertainment. That said, in-vehicle VR technology still has significant limitations. For example, if your device moves while you are driving, you may see confusing and erratic content.
Overcome some speed bumps
Due to the design mismatch between current generation VR headsets and vehicles, it is not possible to display stable virtual content in a moving vehicle.
This has been a long-standing problem for the automotive industry, and the folks at Meta Reality Lab worked with the BMW team to solve it. Through this partnership, we were able to create a solution that precisely attaches virtual objects to the car and integrates the data collected by the BMW car’s sensor array. quest pro tracking system.


With this solution, we were able to leverage Meta’s data to accurately fix virtual objects to the car. Aria We will study glasses and demonstrate the use of Meta’s new tracking system and Meta Quest Pro in cars with MR and VR experiences. The next step was to add the car’s position to the system so that it could be rendered in a world-locked fashion.
exciting results
“Our research prototype shows that we can create fun and comfortable passenger experiences that are rooted in the car itself, such as VR and mixed reality games, entertainment, productivity and even meditation features,” said VP of Reality Research Science. said Richard Newcombe of Labs Research, official release.
“This technology has the potential to change the way we safely interact with our environment while traveling. As progress toward reliable world-locked content continues on the road to AR glasses, We expect that passengers will be able to see things like: Markers of landmarks, restaurants, points of interest, etc.”

the future looks bright
It’s too early to tell exactly when this technology will be available in cars. That being said, the BMW Group believes it can be used to improve the passenger experience. For example, it can be used by drivers to find their car in a parking lot and warn them of potential hazards.
“The impact of future AR glasses and VR devices is promising for drivers as well as passengers,” said Klaus Dohler, head of the BMW Group U.S. Technology Office in Mountain View. Our research partnership with Meta allows us to discover what the future of immersive in-vehicle XR experiences might look like and spearhead the seamless integration of such devices into the car. ”

Meta and BMW are working together to develop new use cases for in-vehicle technology. One of his is the ability to access his car’s 6D positioning system, which allows virtual content to be displayed outside the car. This could be useful in developing AR glasses and AI assistants.
The potential of this technology to transform travel will help shape the future as it potentially allows us to experience new forms of utility and communication without the need for screens or equipment.
For more information on the project, see the Meta official. blog post Or check the published press release. BMW.
Feature image credit: Meta