"Kinect-based Telepresence with Room Sized 3D Capture and Life Sized Display", Includes Behind-the Scene "how-to" (UNC Chapel Hill)

Jim Spadaccini, of Open Exhibits, recently told me about a project that involves the real-time, interactive 3-D capture of people in a room.  As the viewer moves around the screens, the depth-detecting feature of the Kinect is harnessed to set the stage for a realistic telepresence experience.  


Take the time to view the video, which contains some interesting views of how the system works:





Thanks, Jim, for the link!

RELATED/SOMEWHAT RELATED
Kinect Real-Time Room Telepresence
Kinecthacks, 1/3/12
From the project's website:

Maimone, A. and H. Fuchs. "A First Look at a Telepresence System with Room-Sized Real-Time 3D Capture and Large Tracked Display." The 21st International Conference on Artificial Reality and Telexistence (ICAT) (Osaka, Japan, November 28-30, 2011) [paper] [video]

Maimone, A. and H. Fuchs. "Encumbrance-free Telepresence System with Real-time 3D Capture and Display using Commodity Depth Cameras." The IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2011 (Basel, Switzerland, October 26-29, 2011) [paper] [video]

Open Exhibits

Kinect Sensor for Xbox 360 Offers Full-Body and Gesture Interaction: No controllers or remotes!

Project Natal was the code name for the Kinect Sensor for Xbox 360. For $149.99 you can pre-order your very-own system from the Microsoft Store that will allow you to interact with video games with your body alone. No need for controllers or 'motes!

Presentation about the fitness benefits of the Kinect Sensor for Xbox 360:



This video is a preview of a dance game for the Xbox using the Kinect Sensor:


It would be great if I could do my Zumba moves with Kinect Sensor system and a great Xbox application!

Here's another video that explains the system in more detail, with brief interviews of innovators from Microsoft:


Here is a copy of my previous post about Project Natal:

How It Works: Microsoft's Project Natal for the Xbox 360 video from Scientific American


Microsoft gathered a wealth of biometric data to recognize the range of human movement in order to develop an algorithm for the next generation of controller-less gaming. "Natal will consist of a depth sensor that uses infrared signals to create a digital 3-D model of a player's body as it moves, a video camera that can pick up fine details such as facial expressions, and a microphone that can identify and locate individual voices."


The technology behind Natal has the potential for a range of uses beyond gaming.

Scientific American article:
Binary Body Double:  Microsoft Reveals the Science Behind Project Natal for Xbox 360