How it works: Avatar Kinect

The facial recognition technology that powers Microsoft's new chat feature

Briefly rumoured and now officially announced for Spring, Microsoft's newest Kinect feature: Avatar Kinect will provide a virtual environment in which your virtual avatar can conference with friends, perform concerts, chat and generally hang out. If that sounds familiar, Avatar Kinect does have a clever feature which sets it aside from Sony's Home: facial recognition and real-time expressions.

Basically, when you're hanging out with friends in any of the fifteen virtual environments, Kinect will track your facial expressions and speech, relaying them directly to the chat and performing them with your avatar alongside larger body movements.

Hopefully, this should remove the need for clumsy text emoticons and some pre-set actions such as the internationally reviled dance command, but it also shows a hint of what sort of accuracy Kinect could be capable of in terms of game applications.

On top of the chat and conference functions, Kinect Avatar will allow users to record directed shows - be they chat shows, stand up routines or heated debates - edit the footage and share it among friends. Moderation measures will presumably be in place. Check out the video below for a brief explanation of how the facial recognition features of the service will work.

Facial recognition techniques could come to play an important part in games.

Related stories

Microsoft: 'We're growing our gaming business beyond the console'

The company lays out its vision to attract two billion gamers by 2020

By Christopher Dring

Smite esports leagues will be exclusive to Microsoft's Mixer

Xbox streaming service to showcase both the Pro and Console series for Hi-Rez's fantasy MOBA

By James Batchelor

Latest comments (8)

David Bachowski VP Business Development, Babaroga7 years ago
hopefully this technology will allow my avatar to do my grocery shopping and laundry as well
0Sign inorRegisterto rate and reply
Edward Buffery Head of LQA (UK), Testronic7 years ago
Only if you don't mind feeling 'virtually full', and wearing the emperor's new clothes ;-)
0Sign inorRegisterto rate and reply
Jeffrey Kesselman CTO, Nphos7 years ago
This is brilliant, but we need it based on tech built into every desktop, the way cameras are today.

Once we have that, this + *good* voice masking (its possible, its just never been done the right way) will revolutionize MMORPGs.
0Sign inorRegisterto rate and reply
Show all comments (8)
Rebecca Rachmany Marketing, Omek Interactive7 years ago
Just what I need: something that will detect when I roll my eyes at someone stupid, and lets them immediately know in realitime.
0Sign inorRegisterto rate and reply
Andrea Santambrogio Videogames Translator, CultureTranslate7 years ago
Is it just me or the avatar actually blinks *only once* throughout the video?
0Sign inorRegisterto rate and reply
Robert Turner Studying Games Programming, SAE Institute7 years ago
Yeh, but you wont be able to use any of these features while sitting down.
0Sign inorRegisterto rate and reply
Stephen McCarthy Studying Games Technology, Kingston University7 years ago
so when there someone danceing, you know they are danceing in RL?

0Sign inorRegisterto rate and reply
Saehoon Lee Lead technical artist, Kuno Interactive7 years ago
@ Robert. Why do you think this won't work while you are sitting down? Sure, it may not work as well as standing for obvious reason (for full body emote) but this tech is mostly about facial recognition so I don't see why not. My 4 years old little girl plays Kinectimals all the time sitting on her chair.

Edited 1 times. Last edit by Saehoon Lee on 25th January 2011 11:34am

0Sign inorRegisterto rate and reply

Sign in to contribute

Need an account? Register now.