Close
Are you sure? Are you sure you want to report this comment? I understand, report it. Cancel

Microsoft developers to reduce Kinect lag

Tue 29 Mar 2011 8:24am GMT / 4:24am EDT / 1:24am PDT
HardwareDevelopment

Researchers use aggregated data to improve accuracy and speed of body recognition

Microsoft researchers have issued a paper detailing potential improvements in the accuracy and speed of Kinect's sensor routines, although it is unclear if and when the findings will be implemented.

A summary of the paper, and link to the full text, appears on website I Programmer and primarily involves new AI learning routines that can be used to improve the device's ability to discern and track body parts.

Written by Microsoft Research in Cambridge, the labs experiments involve millions of 3D depth maps already identified with body parts. By aggregating the results a 1000 core server was able to create a series of data trees, which could then be used to assign a predicted body part to each piece of 3D pixel data.

The use of the aggregated data allows Kinect to estimate joint positions in a player's 3D model much more quickly than is currently the case. As well as removing the need for a formal calibration the new technology could also be used to reduce lag times from the currently relatively high levels.

The paper suggests that the new system can process a new user in less than 5 milliseconds, an order of magnitude faster than the current technology. Because of the large number of example depth maps the system is also more versatile across a wider range of body types.

The paper does not make it clear if and when the research will be used on retail Kinect sensor, but as a software solution it could potentially be released as a simple firmware update.

6 Comments

Kevin Clark-Patterson
Lecturer in Games Development

291 23 0.1
Here's hoping it does make it to retail Kinect's otherwise what is the point?

Once the tracking speed is improved then that will surely lead onto fingers being able to be track and hopefully facial expressions too! :)

Posted:3 years ago

#1

Neil Young
Programmer

278 319 1.1
I thought the lack of finger tracking in the current hardware was due to the resolution of the NIR cameras?

Suspect how soon we see this showing up in games depends on how much data it needs in memory for the depth maps - if they need more memory than the current implementation, this may need new titles / patches for existing titles?

Posted:3 years ago

#2

John Donnelly
Quality Assurance

313 38 0.1
Kevin, the point is that the technology goes beyond gaming for Microsoft.
Given their R&D budget and work on human computer interfaces this ties in with that high level research that may not always filter down to retail as quickly as some work like.
Look at things like the Microsoft Surface to show what types of R&D is done within Microsoft as a whole.

I do see the fact they have had a team working on this mean there could well be a trend to push the retail technology as far as possible with the same CPU/memory overhead as they currenty need while making the whole thing much more accurate and usable for a wider range of games but at the same time I can see the other side of the business looking to see what developments they can have for the workplace and home markets outside of games.

Posted:3 years ago

#3

Patrick Frost
QA Project Monitor

393 189 0.5
@Neil - That's what I read as well. They have said that they are working on the data compression so that the USB ports on the X360 can handle the full resolution of the device.

But if I'm honest, I'm really gald that there's progression at the algorithm level. It improves things independently of hardware upgrades and will have knock on benefits.

Posted:3 years ago

#4

Richard Mitchell
Contributing Editor, Joystiq

1 0 0.0
This paper simply seems to be explaining how the Kinect works. I don't see any references to improving its current performance. The "AI breakthrough" seems to refer to the fact that Kinect handles motion tracking much better than previous attempts.

Posted:3 years ago

#5

Greg Wilcox
Creator, Destroy All Fanboys!

2,150 1,063 0.5
Gyaaa.

Why not work out these kinks THEN release the product so it WORKS AS IT SHOULD out of the box? I'm a bit tired from being used as an unpaid QA lab rat when these new consoles and peripherals keep landing in stores as "game-changers" when all you're getting is something that kinda, sorta works with some games and kinda, sorta doesn't work with others.

If something goes wrong with them, at least I can bash myself in the head with my Wiimote or Move wand (or pretend I'm the late Lux Interior and sing "Tear it Up" while recalibrating controllers between games). With Kinect, I can only glare at strongly and make faces (and watch it glare back like HAL 9000 before he sends Frank Poole to his death in 2001: A Space Odyssey)...

All that extra exercise I've been getting by sloooowly and carefully flailing my arms an average of seven times to move menus around is only making me head for that heart attack a bit sooner. Thank you Microsoft... now fix this, please...

Posted:3 years ago

#6

Login or register to post

Take part in the GamesIndustry community

Register now