Dakota Pease



Download Project (238 KB)


Since its commercial release, virtual reality has opened a new world of possibilities, and continues to find its way into an increasing number of industries. One limitation of current virtual reality systems is the user’s inability to feel the objects they interact with. In order to tackle this problem a system was designed to track objects in a physical space and map them to a virtual world. This would allow a user to interact with objects in the real world and the virtual world at the same time. The system would combine three pieces of technology: a virtual reality engine (Unity3D) to manage the virtual world, a LeapMotion sensor to allow the system to track the users hands in the real world and project them into the virtual world, and a Kinect Camera Sensor that tracks the positions of objects in the real world and updates them in the virtual world. The system could be used as a proof of concept to study how this new form of interaction affects the user experience, and serve as a building block for more advanced virtual reality systems.

Publication Date


Project Designation

Independent Research

Primary Advisor

Ju Shen

Primary Advisor's Department

Computer Science


Stander Symposium project, College of Arts and Sciences

Physical to Virtual Reality Mapping