MIT Students Create The Future With An iPad And A Glove

MIT Students Create The Future With An iPad And A Glove

You’ve seen Stephen Spielberg’s film, Minority Report, right? Tom Cruise’s character stands in front of virtual screens, puts on a pair of gloves, and manipulates the data and the memories without touching a thing. Well, the super brains at MIT’s media lab have taken the first step toward that reality, using Apple’s magical device as a display screen and a special glove/attachment combo to interact with it.

The video the group has released shows some pretty fancy stuff, drawing objects in 3D real time, and then manipulating them in collaboration with others. There’s even some slick Minority Report-style interface there, with researches moving red and blue rectangles around in the virtual space they’ve created on the iPad.

According to the project website, T(ether) is a spatially aware display that allows people to interact intuitively with volumetric data. It looks like the iPad camera and that little square attached to the iPad take care of tracking the user’s head position and orientation to manage the virtual 3D space. We’ve seen this type of faux-3D before in augmented reality apps, but never put to such serious use as this.

Not only can you reach into the virtual world and manipulate the objects you create there, but there’s a way to connect with others, locally or remotely, to collaborate within a shared 3D virtual space. Looks like all that virtual reality stuff from the late 1990s is coming around again, only with the iPad, an off-the-shelf computing system with plenty of power for this application.

David Lakatos, one of the researchers involved with the T(ether) project, responded to our email asking about the system. He says, “The iPad is running an app compiled with the Cinder library, which is a C++ wrapper for openGL. We are not using the camera on the iPad – we use a Vicon motion-capture system (used in the film industry) to track the iPads location and orientation. The attached rectangle is what the motion-capture system tracks. By constantly tracking the 5 retroreflective dots on it, we can reconstruct the correct pose (position + orientation) of the iPad. We track the gloves with the same system.”

Check out the video below to be amazed and awed, and let us know what you think in the comments below. We’re ready for our close up, Mr. Spielberg.

httpvh://vimeo.com/42173010

Related
  • Benjamin Nødskouv

    Real Cool… did however see a product made on Aalborg University Esbjerg Department made by 3 third semester students for 5-6 years ago, that made something very simular.

    Only one big difference, was that they had the hands infront of the screen.

    But looks great, great work and cool presentation!

  • Benjamin Nødskouv

    and the last thing.. their solution did not have the awesome multiplayer hehehe

  • yahoo-GWLZICM54FUUZ656UXKFOWWL2M

About the author

Rob LeFebvreAnchorage, Alaska-based freelance writer and editor Rob LeFebvre is Cult of Mac's Culture Editor. He has contributed to various tech, gaming and iOS sites, including 148Apps, VentureBeat, and Paste Magazine. Feel free to find Rob on Twitter @roblef

(sorry, you need Javascript to see this e-mail address)| Read more posts by .

Posted in iPad, News, Top stories | Tagged: , , , , , , , |