Close
Report Comment to a Moderator Our Moderators review all comments for abusive and offensive language, and ensure comments are from Verified Users only.
Please report a comment only if you feel it requires our urgent attention.
I understand, report it. Cancel

Metacritic "all but obsolete" - Double Fine

By Brendan Sinclair

Metacritic "all but obsolete" - Double Fine

Tue 11 Nov 2014 5:39pm GMT / 12:39pm EST / 9:39am PST
MediaDevelopment

COO Justin Bailey says studio hasn't seen review aggregator or traditional gaming press impact sales

Metacritic has been a contentious subject in the industry, from those who say the review aggregator has too much influence, to those who use it to make hiring decisions. But in a session at the Montreal International Game Summit today, Double Fine Productions COO Justin Bailey suggested the site doesn't actually matter all that much.

In his presentation, Bailey ran down a list of things that, in Double Fine's own experience, have and haven't made an impact on the sales of their games. On the "what works" list were Let's Play videos, Steam free weekends, and friendly informal cross-promotion with other indie developers. On the list of what doesn't work were free-app-of-the-day promotions, trade shows, and Metacritic.

"There's no need to obsess over Metacritic," Bailey said. "We've basically seen Metacritic all but become obsolete right now... We get obsessed with it. Other developers get obsessed with it. The press gets obsessed with it. But it doesn't really matter, as far as the sales of the game."

Similarly unimportant when it comes to moving the needle on sales was the traditional gaming press. Bailey said when he first arrived at Double Fine, one of his big misconceptions was that the press would have a huge impact on sales. Even with the company's Double Fine Presents publishing service, Bailey had expected that simply including these other games in Double Fine's press list would help them get a lot more traction and exposure, but that didn't pan out.

"I think who's looking at the gaming press are for the most part other developers," Bailey said. "And so it seems important to other developers. I'm just not certain how many gamers are going to the press. It seems they're being siphoned off into Let's Play and other avenues. They're going to review sites as the gateway to find their reviews."

Bailey pointed to the Disney acquisition of Maker Studios and Amazon's purchase of Twitch as evidence that larger companies have already established tremendous value for alternatives to the traditional press. Bailey said the media isn't completely useless from a financial perspective, however. When Double Fine was Kickstarting Broken Age, Bailey said the non-gaming press--particularly outlets like USA Today and Forbes--was especially helpful.

Rounding out the lists of what works and what doesn't were bundles, which appeared on both sides of the equation. Bailey said that bundles can provide liquidity in the short-term, but cautioned against their long-term impacts, suggesting developers wait until games have been out for two years or so before including them in a bundle promotion.

"I'm worried about the effect bundles will have because of the consumer expectations that I shouldn't pay more than $2," Bailey said.

From GamesIndustry.biz Recommendations by Taboola

22 Comments

Christopher Bowen Editor in Chief, Gaming Bus

478 813 1.7
He's right. Not only is Metacritic no longer relevant because of the number of games disproportionate to AAA releases that typically get attention there, many of the sources they draw from now are simply not trustworthy or reliable sources.

Posted:A year ago

#1

Benjamin Crause Supervisor Central Support, Nintendo of Europe

109 62 0.6
Finally someone said it, thanks.

Posted:A year ago

#2

Jeremiah Moss Software Developer

15 47 3.1
To me, the number has never really been the highlight of a review. The reason being, a single number can't tell you if you'll find the game entertaining. Me? I like strategy and puzzles, so I tend to like those types of games. However, I have a family member that is really into shooters and loves them.

So a simple number won't say much about whether I will like the game, or whether my family member will like the game. Different people are entertained by different things.

So it's my opinion that the centerpiece of a review is really the description, where the reviewer describes the game and how it plays. It's my opinion that Metacritic gives undue weight to the idea of using a scoring system.

Posted:A year ago

#3

André Bernhardt Free Bird, IndieAdvisor

13 1 0.1
The video isn´t available anywhere - or?

Posted:A year ago

#4

James Brightman Editor in Chief, GamesIndustry.biz

299 558 1.9
Andre, I don't think a video is available. Brendan was at this session in person.

Edited 2 times. Last edit by James Brightman on 11th November 2014 9:35pm

Posted:A year ago

#5

Thomas Dolby Project Manager / Lead Programmer, Ai Solve

371 354 1.0
This tends to fall in line with my shopping habits at the moment. To me there seems to be two key areas, get my attention (so I know your game exists), and then sell me with some actual gameplay footage.

Good marketing ensures that I know the game exists, and also trailers and other promotions can build up hype. The deal-breaker is gameplay footage for me though. It's very rare I'll go for pre-order bonuses and I'm quite happy to wait a few days to see how consumer feedback forms around the game, and most crucially to start seeing consumers playing the games. With this approach I don't feel like I've made a bad purchase in a long time. Reviews (both official and unofficial) will have a place for a time in terms in helping sway a decision that's on the fence, but numbers have never been less relevant to me.

Posted:A year ago

#6

Maged Hamdy Studying Computer Science, Rochester Institute of Technology

19 28 1.5
Eh, it's good for Kickstarters and general publicity. When Kotaku is still worth 700m I'm thinking it's still SOMETHING, right?

I wonder if GI.biz does not apply in this situation, as it doesn't do reviews.

Posted:A year ago

#7

Anthony Gowland Consulting F2P Game Designer, Ant Workshop

318 1,393 4.4
Even more so in a world where the major platforms (next gen consoles & PC) and services like Twitch make recording & streaming your gameplay so easy. It's really easy for players these days to get a good idea of what a game's really like, even when no demos are available.

Posted:A year ago

#8

Gareth Wilson Design Director, SUMO Digital

11 28 2.5
I'm not so sure about this, especially in the big budget AAA console market. I agree its less important for indie games, mobile games etc.

Posted:A year ago

#9

Richard Browne Partner & Head of Interactive, Many Rivers Productions

212 303 1.4
I'm with Gareth, when it comes to AAA this is nonsense. A massive marketing campaign will launch you well but without decent Metacritic the tail sales will disappear. For Indie Games or mobile its never been relevant.

Posted:A year ago

#10

Todd Weidner Founder, Big Daddy Game Studio

511 1,279 2.5
I tend to at least look at metacritics for the users overall meta score. Im not so much interested in press/experts, but users comments often prove to be insightful and many times have warned me away from poor decisions.

Posted:A year ago

#11

Anthony Chan

147 187 1.3
I wouldn't say Metacritic is "obsolete" because at the end of the day, there are casual gamers looking to add another game to their collection for consoles that rely on numbers. Metacritic is pretty much obsolete for PC due to Steam "evolution" and for mobile, because the respective app stores (Apple and Google Play) are excellent at pushing ratings and user reviews.

For PC, Steam being the most effective and most efficient platform for selling PC games, provides most of the information to general gamers to make a informed purchase. There are trailers, gameplay videos, user reviews, comments, etc. It effectively replaced metacritic.

For Mobile, the app stores do the exact same thing. However, I would note there seems to be more emphasis on the "star rating" system. So I actually would disagree that there is a reduced emphasis on numbers. At the end of the day, your mobile gamer (who is inherently more casual than your PC gamer) relies on star ratings to be persuaded to try your game. The Star Rating is in essence no difference than a % score or a grade.

For Console, metacritic is still relevant as it aggregates and consolidates the main source of review and rating information. Prior to internet, console players relied on gaming mags to get reviews and scores. Back then scores mattered greatly. They still do now to these players. The only difference, mags turned into websites (i.e. gamespot, ign), and now it is even quicker with metacritic ( I can see every mag's score at one go). Developers would be naive to believe that scores don't matter. Scores may not affect sales in some cases (i.e. over hyped existing franchises) but they still do matter when trying to make an informed purchase.

Regardless of the objectivity of the source of those scores (i.e. other users in mobile, gaming journalists for console, etc), scores matter. They matter just like awards do - silly thing if you ask me, but the edition that says "game of the year 20xx" pushes sales too. I agree, there may be less reliance on scores for indie, but I also wonder if that is because indies in general are not marketed to the masses - as masses rely on scores to quickly quantify justification for purchasing a game.

Posted:A year ago

#12

David Canela Game & Audio Designer

99 206 2.1
this is completely off-topic, sorry, but does anyone else suddenly remember Broken Age and its 2nd act that was supposed to follow the first? whatever happened to that game?

Posted:A year ago

#13

James Berg Games User Researcher, EA Canada

315 426 1.4
I don't think a high Metacritic guarantees you any sales, but it can certainly cost you sales if it's poor. If you check MC and see the game is rated a 65, that's a strong indicator that others didn't find the game good.

Posted:A year ago

#14

Al Nelson Producer, Tripwire Interactive

50 78 1.6
Ubi's 9% stock hit today is being blamed on a low Metacritic score for Assassin's Creed Unity...

Posted:A year ago

#15

Jeremiah Moss Software Developer

15 47 3.1
I'm with Gareth, when it comes to AAA this is nonsense. A massive marketing campaign will launch you well but without decent Metacritic the tail sales will disappear. For Indie Games or mobile its never been relevant.
While this is maybe the way things are, I'm not entirely sure this is the way things ought to be, for the reasons I've described.

I think the most recent changes to the Steam store is showing us the future of how tail sales should be handled: Players express an interest in certain game types, and based on those interests, the store shows players games similar to their interests. This could easily include older "classic" games, extending the life of those games, and allowing players more access to games they love, both new and old.

Posted:A year ago

#16

Rafa Ferrer Localisation Manager, Red Comet Media

96 170 1.8
@David - As of October 17th, DF announced Tim had finished writing Act 2 and the Finale and they had already entered the studio for music and voice-over recording. (Source: The Broken Age Project Update newsletter)

Posted:A year ago

#17

Alfonso Sexto Lead Tester, Ubisoft Germany

1,152 1,275 1.1
Metacritic should just do a purge and remove the obviously failed "user vote" section. It's nothing but a Haters vs Fanboys troll-fest battleground

Posted:A year ago

#18

Gary LaRochelle Digital Artist/Game Designer, Flea Ranch Games

105 141 1.3
@Todd-I look to user reviews as well. But when I see a bunch of five star scores with just one word in the review (and a user's name like "398gh5k8"), you pretty much know that the developer has paid a bunch of people to flood the site with phony rave reviews. In that case I just ignore the game.

Edited 1 times. Last edit by Gary LaRochelle on 13th November 2014 2:28pm

Posted:A year ago

#19

Adam Jordan Community Management/Moderation

148 143 1.0
People still use Metacritic? I thought it was swept under the rug along with Gamespy and Games for Windows Live

On a serious note, I can't remember the last time I took a Metacritic score seriously or to heart but I'm guessing we're talking years and years ago now. Though unlike others, if people do use it, that's great but I would rather go with word of mouth, generally from friends.

Posted:A year ago

#20

Keith Plesha Studio Recruiter, Raven Software

1 0 0.0
The more important point is that the game be looked at objectively and not subjectively. Clearly someone who is more interested in FPS shooters is likely to rate an FPS shooter subjectively differently than someone who doesn't care for them. This is the beauty of user generated critique (especially on Steam). You can tell what genres the person reviewing the game spends their time on. However, liking a particular genre really only comes down to gameplay. Liking a genre doesn't make the graphics look better or the frame rate better. It also certainly doesn't affect the number of bugs or technical issues at launch. Metacritic has certainly prevented me from purchasing a game before, but I you should always use multiple metrics/sources to truly garner a well-rounded opinion. Metacritic scores do dictate business decisions, but it may have less value on player buying habits as compared to large marketing budgets.

Posted:A year ago

#21

Jamie Knight International Editor in Chief, Playnation

71 34 0.5
GREAT article. Never used Metacritic, never understood it ( a review of reviews? nice work if you can't do it so let someone else get it for you )

I don't support them, don''t use their format, don't allow their format on any publication I am involved with and will not even put their name in a title or tag to give them the click bait view

Maybe if they actually DID something that would change, but merely saying " everybody pay attention to me because I made a group of everyone else work " is not praise worthy and certainly not deserving of the attention

( in my humble opinion, of course )

Edited 2 times. Last edit by Jamie Knight on 19th November 2014 6:31pm

Posted:A year ago

#22

Login or register to post

Take part in the GamesIndustry community

Register now