HANDPOSE PROMISES THE HOLY GRAIL OF MOTION DETECTION: FAST, ACCURATE HAND RECOGNITION.
Imagine strapping on a virtual reality headset, then using your hands to pick up a sword and swing it around your head. Imagine a hazard team able to defuse a complicated bomb from a mile away, just by controlling a robot's hand as effortlessly as your own. Imagine painting a picture on your computer just by waving a brush in front of your screen. Or, if you prefer, imagine using a computer like in Minority Report, whisking away pages and files just by grabbing them with your hands.
Using the Handpose software, the first thing a user does is scan his or her hand by holding it up in front of the Kinect to create a 3-D model. In the lab, the process currently takes about a second, which is less than it takes an iPhone Touch ID sensor to accurately measure your fingerprint. Once the system has created a 3-D model of your hand, Handpose allows you to control it on the screen in real-time, at around 30 frames per second. From there, you can use the on-screen hand as if it was a doppelganger of your own.