Benjamin Lok
University of Florida
Samir Naik
Disney VR Studio
Mary Whitton
University of North Carolina at Chapel Hill
Frederick P. Brooks, Jr.
University of North Carolina at Chapel Hill
Citation:
Lok, B., Naik, S., Whitton, M., and Brooks, F. (2003) Incorporating Dynamic Real Objects into Virtual Environments. To Appear in ACM 2003 Symposium on Interactive 3D Graphics.
Abstract:
Suppose one has a virtual model of a car engine and wants to use an immersive virtual environment (VE) to determine whether both a large man and a petite woman can readily replace the oil filter. This real world problem is difficult to solve efficiently with current modeling, tracking, and rendering techniques. Hybrid environments, systems that incorporate real and virtual objects within the VE, can greatly assist in studying this question.
We present algorithms to allow virtual objects to interact with and respond to virtual representations, avatars, of dynamic real objects. This allows dynamic real objects, such as the user, tools, and parts, to be visually and physically incorporated into the VE. The system uses image-based object reconstruction and a volume-querying mechanism to detect collisions and to determine plausible collision responses between virtual objects and the real-time avatars. This allows our system to provide the user natural interactions with the VE.
We have begun a collaboration with NASA Langley Research Center to apply the hybrid environment system to a satellite payload assembly verification task. In an informal case study, NASA LaRC payload designers and engineers conducted common assembly tasks on payload models. The results suggest that hybrid environments could provide significant advantages for assembly verification and layout evaluation tasks.
Downloads:
Final paper (2/7/03):
Presentation (4/28/03):
Microsoft PowerPoint w/o videos (8 Mb) (all video segments can be found in the video link below)
Video:
Sequence of images with the user interacting with virtual curtains
to look out the window.
NASA Payload Designers attempt an assembly verification
task in a hybrid environment.
The first step was to slide the pipe between the payloads
and then screw it into the fixture.
After the pipe was in place, the next step was to fish the power cable
down the pipe and plug it into the outlet on the table.
The insertion of the cable into the outlet was difficult without a tool.
Tongs were provided to assist in the plugging in the cable.