Free-Hand Gestural Control with Magic Leap One

Summary

This project illustrates the possibilities of combining a Magic Leap One device with Leap Motion Sensors.

Contributions

This work was created by Vik Parthiban and Mike Hao Jiang for Milestone 3 in Tod Machover’s and Zach Lieberman’s “Experiments in Art, Audio and Augmentation” class at MIT. Vik configured the hardware as well as setting up a web socket to stream the Leap Motion data to the Magic Leap device. Mike wrote a set of scripts to make use of this data including gesture recognition (e.g. hand flipping), finger point rendering and dynamic asset loading. Mike received an A for this project and class.

Skills

Unity3D, C#, Magic Leap, Leap Motion.