How it works: Avatar Kinect

The facial recognition technology that powers Microsoft's new chat feature

Briefly rumoured and now officially announced for Spring, Microsoft's newest Kinect feature: Avatar Kinect will provide a virtual environment in which your virtual avatar can conference with friends, perform concerts, chat and generally hang out. If that sounds familiar, Avatar Kinect does have a clever feature which sets it aside from Sony's Home: facial recognition and real-time expressions.

Basically, when you're hanging out with friends in any of the fifteen virtual environments, Kinect will track your facial expressions and speech, relaying them directly to the chat and performing them with your avatar alongside larger body movements.

Hopefully, this should remove the need for clumsy text emoticons and some pre-set actions such as the internationally reviled dance command, but it also shows a hint of what sort of accuracy Kinect could be capable of in terms of game applications.

On top of the chat and conference functions, Kinect Avatar will allow users to record directed shows - be they chat shows, stand up routines or heated debates - edit the footage and share it among friends. Moderation measures will presumably be in place. Check out the video below for a brief explanation of how the facial recognition features of the service will work.

Facial recognition techniques could come to play an important part in games.

Related stories

Nintendo Switch on track to outpace ten-month sales of the Wii by 20%

Xbox One X sales predicted to exceed 600,000 this year, adds industry analyst

By Haydn Taylor

Xbox One X sales estimate nearly doubled by IHSMarkit

Analysts becoming more bullish on the new console's prospects this holiday

By James Brightman

Latest comments (8)

David Bachowski VP Business Development, Babaroga6 years ago
hopefully this technology will allow my avatar to do my grocery shopping and laundry as well
0Sign inorRegisterto rate and reply
Edward Buffery Head of LQA (UK), Testronic6 years ago
Only if you don't mind feeling 'virtually full', and wearing the emperor's new clothes ;-)
0Sign inorRegisterto rate and reply
Jeffrey Kesselman CTO, Nphos6 years ago
This is brilliant, but we need it based on tech built into every desktop, the way cameras are today.

Once we have that, this + *good* voice masking (its possible, its just never been done the right way) will revolutionize MMORPGs.
0Sign inorRegisterto rate and reply
Show all comments (8)
Rebecca Rachmany Marketing, Omek Interactive6 years ago
Just what I need: something that will detect when I roll my eyes at someone stupid, and lets them immediately know in realitime.
0Sign inorRegisterto rate and reply
Andrea Santambrogio Videogames Translator, CultureTranslate6 years ago
Is it just me or the avatar actually blinks *only once* throughout the video?
0Sign inorRegisterto rate and reply
Robert Turner Studying Games Programming, SAE Institute6 years ago
Yeh, but you wont be able to use any of these features while sitting down.
0Sign inorRegisterto rate and reply
Stephen McCarthy Studying Games Technology, Kingston University6 years ago
so when there someone danceing, you know they are danceing in RL?

0Sign inorRegisterto rate and reply
Saehoon Lee Lead technical artist, Kuno Interactive6 years ago
@ Robert. Why do you think this won't work while you are sitting down? Sure, it may not work as well as standing for obvious reason (for full body emote) but this tech is mostly about facial recognition so I don't see why not. My 4 years old little girl plays Kinectimals all the time sitting on her chair.

Edited 1 times. Last edit by Saehoon Lee on 25th January 2011 11:34am

0Sign inorRegisterto rate and reply

Sign in to contribute

Need an account? Register now.