Tech Focus: Stereo 3D - Year One

Digital Foundry on stereo 3D's troubled first year in the mainstream.

It's been just over a year since Sony released its firmware upgrade for the PlayStation 3 that enabled stereoscopic 3D output on all consoles, accompanied by a range of 3D enabled titles on PSN. In the months that followed, a surprisingly large number of stereo titles were released, with the new 3DTV standard embraced not just by Sony but also by a range of third party publishers: the biggest game of the year - Call of Duty: Black Ops - supported 3D on all three major platforms.

However, as the year has progressed, there's a sense that 3D is losing momentum, that sales of 3DTVs have disappointed and that the first truly mainstream stereoscopic games machine - the Nintendo 3DS - has failed to capture the imagination of the audience. So is 3D gaming now effectively on life support? Will we continue to see the same level of impressive support for the format going forward?

There's a sense that 3D is losing momentum, that sales of 3DTVs have disappointed and that the first truly mainstream stereoscopic games machine - the Nintendo 3DS - has failed to capture the imagination of the audience

Perhaps the first question we should be addressing is exactly what 3D actually offers the gameplay experience over and above simply "looking cool". In our original interviews with the stereo 3D team at SCEE's Evolution Studios, there was talk of a more realistic, immersive presentation plus the advantages that depth perception can offer in something like a racing game.

Having played pretty much the entire catalogue of 3D titles on PlayStation 3 and Xbox 360, plus a handful of 3DS titles, it's safe to say that the majority of them sit nicely in the "looking cool" category without actually providing much in the way of enhancements to the gameplay experience. There is simply an added depth to the visuals which, by and large, results in a more pleasing visual experience but doesn't improve the way the game plays. Sometimes this can be enough - THQ's de Blob 2 has an artistic style that simply looks phenomenal in 3D - but is the stereoscopic looking actually providing any kind of gameplay premium?

MotorStorm Apocalypse may have a resolution deficit in 3D mode, but it's an excellent example of how intelligent use of 3D technology can add greatly to the gameplay experience.

There's no doubt that 3D can be much more immersive than a standard 2D look, which has an immense value in itself, but the question then moves on to the context in which the games are being played. In my experience, 3D works best when the visuals occupy the majority of the player's field of view - for the same reason that IMAX 3D is so comprehensively better than standard cinema 3D. having a "framed" 3D window in the corner of the room doesn't just reduce the impact of the 3D effect, it also limits the possibilities to game creators: it's all about generating depth, whereas the "in your face" potential of 3D that springs out of the screen is rarely explored at all. The illusion fails when the screen doesn't occupy most of your field of view.

Effects that "pop out" of the screen are generally dismissed as being gimmicks or party pieces, but it's probably the most memorable 3D effect from those that have visited the major stereoscopic movie attractions at the world's biggest theme parks. We all remember those moments where we wanted to reach out and "grab" the object that looks as though it's right in front of our eyes - there aren't many moments like that in gaming because the impact of the effect is diminished without an all-encompassing field of view. A good example of this is Super Stardust HD's amazing 3D support: the asteroids rain down on the player and the stereoscopic impact is simply phenomenal, plus the depth perception here works really well in helping you to dodge the incoming storm.

However, even with Stardust, much of the wow factor is lost if you're playing on a 32" 3DTV several feet away from the player: the immersion factor doesn't work if you're looking at a small window into a 3D world - and it's for exactly the same reason that the Nintendo 3DS doesn't quite offer all the opportunities you would want from a stereoscopic device: the screen is too small to provide anything other than a sense of depth, and in many ways even that is limited owing to the meagre 400x240 resolution.

Super Stardust HD's flawless 3D produced the first PS3 game to run with true stereoscopy with full 720p resolution and 60Hz gameplay. Housemarque retrofitted the old game code into a new engine to provide a zero compromise 3D game - it remains one of the best stereoscopic games on the market.

Super Stardust HD is a good example of how improved depth perception can make a game easier to play, and there are some other decent case studies too - most notably Gran Turismo 5's stereoscopic support, which eschews exaggerated effects and camera placements in favour of a functional approach to 3D. But for the main, the notion of improved depth perception in 3D titles doesn't seem to check out: there's an improved sense of realism perhaps, but the fact is that games creators and indeed core players have pretty much mastered presenting and interpreting depth in a 2D plane. Over and above stand-out examples like Stardust, any advantage increased depth perception supplies is almost totally visual in nature - again, a "looking cool" boost only.

Questions also need to be asked about how important that boost is when other elements of a game's visual identity need to be downgraded in order to accommodate stereoscopy. The fact is that current generation consoles are being pushed to their limit and questions need to be asked about whether the Xbox 360 or the PlayStation 3 have the horsepower to provide a worthwhile 3D experience: the fact is that 3D introduces a big overhead - to provide a full 720p stereoscopic effect, fill-rate requirements double and geometry needs to be processed twice. This is why so many 3D games have resolution deficits compared to the 2D version and why frame-rates often suffer.

We even see the same thing on the Nintendo 3DS to a lesser extent, where fighting games like Super Street Fighter IV and Dead or Alive: Dimensions run at 60 frames per second in 2D, but with frame-rate halved when running in 3D. And again, we also see a lack of direction with the 3D implementation in general: a case in point is Namco-Bandai's Ridge Racer offers very little at all to players with stereoscopy engaged over the same game running in 2D, and in a game like this where the graphical impact isn't hugely impressive, you have to wonder how much better it would have looked if all the GPU power could have been concentrated into a 2D game.

It's fair to say that the outlook thus far has been rather bleak and this may come across as especially surprising bearing in mind that Digital Foundry has historically been a champion for 3D gaming and has covered the format in more depth than all but the most dedicated blogs out there. The thing is, when 3D works, the effect is simply phenomenal, and while the first year has been beset with growing pains, I think it's safe to say that 3D gaming will - eventually - become mainstream and a standard, optional element in the vast majority of all console titles.

Just about all of the issues can be resolved to a certain extent (though the great "glasses debate" is likely to run and run for years yet). There has been widespread disappointment at the lack of tangible sales for 3DTVs, but the fact of that matter is that the inexorable march of technology means that 3D will be a standard fit in most screens by the time the next-gen consoles hit their strides. All it takes to turn a regular 2D display into a 3DTV is 120Hz support, an upgraded chipset and an IR emitter. Glasses will eventually be built to a standard and they'll be optional upgrades to the display, or bundled by canny retailers (already we are seeing the first signs of this).

Those optional upgrades are far likely to happen if there is the software to support it, and with 3D channels taking off, more sporting events covered in 3D and movies actually getting proper releases (the 3D version of Avatar's limited release still boggles the mind), a sense of momentum across multiple media will definitely make a difference. As it is, unlikely as it sounds, games have actually taken point in providing a rich and diverse library of 3D content.

In terms of the immersion factor, an easy to use calibration system would could be devised that would tune the 3D factor depending on the circumstances of the player - a system that would in essence work alongside the current PS3 XMB setting and the in-game "3D intensity" sliders that we often see.

Support is coming from an unexpected source... it's pretty much an open secret that Microsoft is going to add stereoscopic 3D HDMI 1.4 support to the Xbox 360 in the next dashboard update

I also think it's highly probably that next-gen hardware will target 1080p as native resolution for 2D, while 3D would be 720p - solving the fill-rate issue at least when it comes to technical compromises, and I would hope that a combination of increased developer know-how and 3D-specific APIs from Microsoft and Sony would help bridge the gap when it comes to the thorny issue of processing twice the amount of geometry in moving from 2D to 3D. While we can also expect other technologies to lower the hit to performance (such as reprojection, as featured in Crysis 2, SOCOM 4 and TriOviz titles like Enslaved), the real challenge moving forward is in how game makers choose to use 3D to provide a tangible improvement to the gameplay, moving beyond the addition of depth.

The challenge facing Sony's first party developers is that their 2D engines already push the limits of the console and factoring in 3D on top of that is a major headache. Naughty Dog reduce resolution and pare back incidental detail, but frame-rate remains remarkably solid.

Games like MotorStorm Apocalypse and Killzone 3 offer a superb experience that elevates them beyond the 2D games even though there are noticeable technical compromises: the implementation of 3D isn't an after-thought and the effect is about much more than simply making an existing game "look cool". In the case of MotorStorm, tent-pole elements of the gameplay (for example, the interactive destructive set-pieces) almost look as though they've been "remastered" in 3D, the effect heightened through the expert implementation of the stereoscopic cameras. Killzone 3 - already a really intense game - is that much more visceral thanks to intelligent use of the technology.

Super Stardust HD is also an essential 3D game in that the existing gameplay plainly benefits from the introduction of depth, and it's an example of how older code was retrofitted into a newer engine in order to accommodate stereoscopy without any disadvantages compared to the standard 2D game. In fact, the process only benefitted the existing game, with the new engine put to work on providing a full 1080p resolution (the launch game was running at 1280x1080).

Nintendo faces real challenges with 3DS, but the first party line-up looks very strong and the notion of the Mario team working with stereoscopic 3D is mouth-watering.

Going back to the question raised in the introduction, while it is safe to say that 3D isn't going to be a major concern for many games developers outside of Sony, there are clear indications that 3D is still alive and kicking. Of course, we can expect tentpole first party PlayStation 3 games to feature 3D - Resistance and Uncharted 3 are going to be important games. However, there's also support coming from an unexpected source: while there has been no announcement as of yet, it's pretty much an open secret that Microsoft is going to add stereoscopic 3D HDMI 1.4 support to the Xbox 360 in the next dashboard update, and it's already been announced that Gears of War 3 features 3D too. Another of the Q4 heavy-hitters - Batman: Arkham City - will see the implementation of the latest HDMI 1.4-enabled version of TriOviz too.

In terms of the volume of software out there, while it's unlikely that we'll see developers targeting 3D in quite the same way that Sony is but the platform holder is right to point out that adding 3D can be a relatively cheap endeavour. Indeed, adding 3D to a game that already supports split-screen sees most of the developmental effort done already - the concept of generating two independent viewpoints in a split-screen game has much in common with the process of adapting an existing renderer to support true stereoscopic 3D. It's no surprise that both Uncharted 3 and Gears of War 3 not only support 3D, but also split-screen modes too.

Quite what will happen with the Nintendo 3DS remains to be seen. Its price-drop will undoubtedly help, but it's still difficult to believe that cost was only a small element in its faltering launch - as always, it's all about the games, and it'll be interesting to see how the platform holder itself works to make 3D a valuable element of the core gameplay in what is a pretty exciting line-up of first party content. The Mario team working with 3D? Now that's something I want to see.

Latest comments (7)

Interesting to see that there's no mention of 3D on PC at all here, only consoles. Given that 3D monitors are far cheaper and more immersive than 3DTVs since you're sitting a lot closer (generally) I would have expected the uptake to be better. I would be interested to see the stats on that in the next Steam spec grab.
0Sign inorRegisterto rate and reply
Richard Neville Category Manager - Gaming, Mad Catz6 years ago
Yes, it's interesting that no mention was made of 3D on PC, especially as it as a Digital Foundry article on PC 3D gaming that made me start thinking about adopting it. I can personally vouch for the immersion factor on my PC monitor - but then at 27" even if it was only 2D it would still be pretty immersive! I did make a point of getting a monitor that supports 3D over HDMI as well so I can shift the consoles from the living room to my study if I want to get the 3D effect from them (and I will be for Uncharted 3 and the HD release of Ico/Shadow of the Colossus).
0Sign inorRegisterto rate and reply
Max Brode Videogame Consultant 6 years ago
I think there is a very strong case for 3D, both in cinema and in gaming, and I personally donít even feel that filling my peripheral vision is a prerequisite to feeling more immersed than I am with 2D content. As a matter of fact, I like the sensation of looking through a window into a three-dimensional world and it is more compelling to me than the money-shots of long thin things being stuck into my face. Thatís not to say that a filled peripheral vision is not improving immersion, I simply value the sensation of looking in over being poked.

Iím probably also one of the few people who prefer the more recent 3D systems over IMAX 3D. Whilst IMAX is undoubtedly engrossing by offering a huge screen (and for that reason it is incidentally my favourite 2D film theatre), it is my impression that the granularity of the 3D effect seems stronger, smoother and more refined in RealD (and I hear that the less common Dolby System is apparently very good, too). I watched Avatar both in RealD and IMAX 3D (from perfect seats), and I felt that IMAX 3D had a tendency to give an impression of several 2D planes stacked as parallaxes, whilst the other show gave a better impression of actual roundness in a 3D space, albeit on a less impressive screen size.

From my own subjective experience, Iíve been put off 3D in my living room / on my desk by the (possibly irrational) worry over active shutter glasses, i.e. cost per pair / viewer, potential fragility of the units and battery power Ė what if it runs out in the middle of the film? Last week at Gamescom, ďthe other large Korean manufacturerĒ showcased their passive 3D system, and I was very impressed. It uses the same polarised glasses as RealD (which cost next to nothing and can be picked up at your local cinema with an admission ticket), and whilst the resolution in 3D is effectively halved as it uses alternate interlacing to create the two images, I find it not noticeable when watching 3D content Ė at least not on the 23Ē monitor Iím using right now as I type. Iíve watched a few films and played a few things on PS3 and PC, and itís very good in my opinion. Well worth having a look Ė in particular if budget is a consideration.
0Sign inorRegisterto rate and reply
Show all comments (7)
Abbass Hussain International Business Development, AQ Interactive6 years ago
I think one point that has been missed, is that the brain already puts things into 3D for us. When we see a 3D object on a 2D screen (or even a painting or photograph), as long as the perspective is correct, the brain works out that it's 3D and we effectively perceive in 3D.

Perhaps the problem with this current wave of `forced 3D` is that it's duplicating or doubling-up on what we are already unconciously doing, and therefore it just feels tiring, unnatural and unneccesary...
0Sign inorRegisterto rate and reply
I fail to see what's so spectacular about the current 3D craze.
My first purpose-built PC gaming rig consisted of an Athlon500 and a GeForce 256. The GeForce card came with 3D glasses (which needed to be plugged into the card) and a special driver mode which turned -any- OpenGL game into full 3D (no special software support required). Half Life in particular looked pretty good. That was 12 years or so ago now.
0Sign inorRegisterto rate and reply
Paul Shirley Programmers 6 years ago
@Michael Werle: still got my old TNT2 with 3D shutter specs. I still remember the motion sickness and migraines it caused, even after overdriving my display to 200fps and dropping features to keep the game running at 100fps.

For some of us stereo may never be an option. To be honest it wasn't that exciting anyway.
0Sign inorRegisterto rate and reply
Alex Abbott Standards Technician, SEGA Europe6 years ago
Its seemingly a purely subjective matter as to whether it advances gaming as an artistic medium. Personally, ive turned into somewhat of a snob when deciding which videogame I shall purchase next, perpetually posing the question "Is it in 3d?", clearly overlooking the distinct possibility I may be playing an inferior game compared to a superior game in 2d!
however, once this step has been taken, rather like the jump from SD to HD, reverting back to 2d seems so dull! It does increase one's immersion with a title, it does increase one's enjoyment, and with active shutter I have had no issues of eye-strain, and indeed encourage my workmates to jump on the 3d bandwagon, so to speak. With GOW3 for MS and Uncharted3 for Sony on the horizon, we just might see videogames using the benefits of stereoscopic depth-of-field to fuller effect. With any technology in its infancy, only time (and consumers!) can tell.
0Sign inorRegisterto rate and reply

Sign in to contribute

Need an account? Register now.