Information and Navigation Systems Through Augmented Reality (INSTAR)

Innovative visualization paradigm for vehicles based on Augmented Reality

Motivation 

The augmented reality (AR) research community has been developing a manifold of ideas and concepts to improve the depiction of virtual objects in a real scene. In contrast, current AR applications require the use of unwieldy equipment which discourages their use. In order to essentially ease the perception of digital information and to naturally interact with the pervasive computing landscape the required AR equipment has to be seamlessly integrated into the user’s natural environment. Considering this basic principle we propose the car as an augmented reality apparatus and present an innovative visualization paradigm for navigation systems that should enhance user interaction.

Goals

A car’s windshield can render the metaphor of the augmented reality paradigm and be used to superimpose virtual information in front of the real world outside the car. A camera detects the driver’s eye position and consequently enables the system to appropriately display the augmentation relative to the driver’s height and location on the seat. All the (hybrid) tracking equipment (GPS, wheel sensors, odometer, etc.) is included in the car’s navigation technology, making the car a big accessible and movable see-through display. The user just has to enter it as usual and is immediately able to perceive augmented reality information through the windshield and interact with the system without carrying additional electronic devices or changing any habits. Such a car serves as an example of an augmented reality apparatus that is pervasively integrated into the user’s natural environment and directly available there.

Results

By virtually painting the road in a semi-transparent color the new paradigm eliminates the ambiguity that might arise, e.g., when conventional navigation systems require the driver to turn left with two junctions back to back. Junctions that are hidden from the driver in the real world (e.g., because other vehicles or rises in the landscape restrict the driver’s view) can be made visible via augmented reality. Since the driver is no longer impeded by a constrained view of the current traffic and driving situation while diverting his eyes from the street and looking at the navigation display of conventional navigation systems, he always surveys the road ahead and is capable of recognizing hazards without any delay.

Partners: 

• Siemens Corporate Technology, Munich
• Ars Electronica Futurelab

Contact: Wolfgang Narzt

Publications