USA Today got a demonstration of a new Kinect-based technology currently under research at Microsoft labs that can produce high-polygon 3D modelled faces that can emote and lip-sync almost realistically.
“We could couple the body and the gesture recognition in order to create a full body avatar that has photorealistic features and full face animation,” said Microsoft’s Chief Research and Strategy Officer Craig Mundie.
The video below displays the technology in motion (excuse the pun) that shows a 3D modeled face emoting almost perfectly, complete with eyebrow, eyes, tongue and lip animation. Microsoft said that some pieces from this technology will be added to Xbox Avatar later this year, hinting at a more-human like avatar for use on the Xbox 360.
Such a technology could also be easily implemented to power facial and body animation in video games, negating the need for countless sensors and cameras to capture and process.