Why review scores are dead | Opinion

Review scores used to be able to tell you if a game was good. Magazines and sites often broke things down into individual scores aspects, and if the story scored a 9/10 and you liked story-driven games, it was a good indicator that you should probably buy the game.

This was before you were able to watch someone play the first half-hour of the game and before you could see the community react. Shelf space was limited, and there was no Twitch or YouTube.

Gamers make their own decisions now. And quite often, that decision does not align with the opinion of an editor that's giving a review score.

Here are the reasons why review scores are dead and what developers should do about it.

Games are becoming experiences

When we launched Hello Neighbor, a major gaming outlet gave it 4 out of 10. Granted, there were bugs, and we spent a lot of time fixing them. But it's also important to note that reviewing something like Hello Neighbor is kind of like reviewing Fortnite. What is the final product? Is it the current season? The rap concert? No, these are experiences within the bigger scope of the game.

With Hello Neighbor, this experience started when we released our first playable alpha. One time, we accidentally forgot to disable the dev console. It opened up the backend to the community and allowed them to see what was being worked on, what was a work in progress. It became an experience on its own -- seeing the behind the scenes, the models, and how the game's final form was shaping up. Playing the game in its development form became part of the game itself.

Younger gamers don't care about reviews as much

It's important to distinguish between different generations of gamers. People over 30, who, like myself, grew up using scores are limited on time. So review scores will factor in for that specific audience.

However, the younger generations of gamers, who grew up online, with phones without buttons, are right now the biggest gaming community in the world.

When did this shift from finished product to experiences happen? I think it was the first generation of Minecraft gamers. These were 12 year olds during the early 2010s. They are the ones that started playing a lot of emergent games that were not published and marketed by traditional means.

Show yourself early and win

To truly succeed today, you need to start showing your game early. It's not about avoiding review scores. The goal is to help your potential customers see if they actually want to play the game.

Once you start building up your community, they will be the ones that react and actively engage on different media websites. They will play demos and betas, become active on Discord and drive the popularity of your game.

You really just need one thing: to be honest and transparent. Because it's not about the product itself. It's about the experience and the community that the game creates.

Games are much less static

While games have always seen patches and updates (even the earliest arcade games got revisions, and DOS games spread patches via magazine cover disks), they pale in comparison to the transformative updates games frequently receive now.

Reviewing something like Hello Neighbor is kind of like reviewing Fortnite. What is the final product?

Even outside of early access, there's a huge number of titles that have seen major overhauls or content updates that would change a review score, but there's almost no outlets that re-review games. That original score, however misrepresentative it is of the game that exists now, is what people see when they turn to Metacritic.

The problem is even more apparent for live service games. You have only to look at the Metacritic scores for Warframe, mostly from reviews written in 2013, describing a game completely different to the one that exists now. While an interesting read, the score is what people often see first, and if it's misrepresenting the game today, it helps nobody.

In TinyBuild's case, our own Hello Neighbor wasn't particularly well received by the press when it first released, and I can't deny that part of that was due to bugs and other technical issues. But with a little spit, polish and elbow grease, we're proud of the game as it stands now.

Given Hello Neighbor's Very Positive user rating on Steam, we think our audience agrees, but if you were to look at those initial reviews, you'd think that nothing had improved.

User Reviews can offer more up-to-date info

While every system has its problems, Steam having seperate scores for recent and lifetime user reviews, as well as filtering out review-bombing, can tell people a lot at a glance. You have only to look at No Man's Sky to see the benefits of this system, with the overall score (hurt by a rough launch) overshadowed by glowing reviews of the current version of the game.

At TinyBuild we've also observed that if an initial PC release has a high user rating on Steam, then it's likely to sell well when a later console release happens.

Given how unreliable old review scores can be, we believe that people are looking at more recent reactions on Steam, YouTube and other outlets to help decide what to purchase.

Of course, this isn't to say that user scores are without issue. Review-bombing on Metacritic is rife, and Steam had to implement systems to deal with this problem on their own turf. Fixes that few other sites have made.

Every outlet has their own scoring criteria

It should almost go without saying that every site and magazine is different, but for the purposes of rolling together scores on aggregators like Metacritic, there's no allowance made for differing scales.

The venerable Edge Magazine is famous for using the entire scale. A 5/10 game is average. A 6 is good. 7 is very good. 9s and 10s are very seldom awarded. Many other sites barely use scores below 70% unless a game is irredeemably broken.

Without any attempt to reconcile these differences, it's just one more reason that review scores on aggregator sites aren't really useful to anyone, and for readers wanting to parse the numbers for themselves, they need to understand what makes for a high score across multiple publications.

It's almost easier just to read the full review.

Reviews are often written under unrealistic conditions

You're only to look at this spring's mega-hit, Elden Ring for proof of this. Most would agree that it's enormous, at least a hundred hours long. How many people are going to play through a game that huge in a week?

That original review score, no matter how misrepresentative it is of the game that exists now, is what people see when they turn to Metacritic

It speaks to the quality of Elden Ring that reviewers came away with such a high opinion of it while rushing to complete it before deadlines, but a lot of games are better digested slowly. Many are best enjoyed in sessions of an hour or two at a time, over the course of months.

Multiplayer games especially fall foul of this. It's almost impossible for traditional reviews to get a feel for anything online pre-release. This is more of an issue with reviews in general than specifically scores, but those scores are still what sticks the strongest.

What can be done?

It would be a little rude to lay out all this criticism without at least something constructive. There's a lot that could be done to improve the current situation.

First is axing review scores altogether. Several major outlets have already done this, such as Eurogamer and their broad 'Recommended' and 'Essential' tags, and it seems to encourage people to read deeper.

Second is moving away from sites like Metacritic that try to boil down complex opinions into a single number. A number that has even been used to calculate bonuses for some studios -- see the case of Fallout: New Vegas.

But above all, reviews may have to adapt to keep up with ever-changing games. While completely rewriting articles is probably unreasonable to ask, a little addendum near the top, mentioning if a review is strongly out of date, or pointing out key things that have changed would make them far more relevant in the age of streaming and gameplay videos.

Reviews and other long-form critiques are still useful, and probably always will be. But day-one scores and shaky first impressions just don't cut it when games move as fast as they do now.