Sections

Is Bethesda's reviews policy really harming game sales?

We look at the data around Doom, Skyrim Special Edition, Dishonored 2 and Prey

Last year, Bethesda launched a new reviews policy for its games.

It decided that it wouldn't let critics have pre-release copies of its titles until a day before the game goes live. The publisher wrote: "we want everyone, including those in the media, to experience our games at the same time."

The policy began with Doom, and has since been adopted for Skyrim Special Edition, Dishonored 2 and Prey.

The question that many were asking at the time was: why? It seemed like an unusually anti-consumer move for Bethesda, as it forced gamers to take a gamble on the quality of the releases. The assumption was that the firm was trying to protect its games from negative reviews, yet all of the above titles received Metacritic scores in the mid to late-80s. All of them were good.

Now with the release of Prey - which has had a slow start in the UK - it's worth pouring over the data, to understand what effect this unusual policy has had.

"The data suggests that although the lack of reviews may have had a negative impact on Doom's week one, the sales were merely delayed"

Let's begin with Doom. In the UK, the boxed version of the shooter suffered a poor first week on sale. But in its second week, where you'd typically see these sort of games lose between 65 - 75% in sales, Doom's physical sales drop was just 35% - helped (no doubt) by the delayed arrival of the reviews. It suggested that although the lack of reviews may have had a negative impact on week one, the sales were merely delayed. Indeed, Bethesda says that Doom hit 1m sales on PC by August (worldwide), and US sales tracker NPD said that the game sold more in its first month than any previous title in the series (although it was released on more platforms).

Armed with that information, Bethesda adopted the policy for its subsequent titles, and the results were more mixed.

1

Both Doom and Skyrim Special Edition sold well last year

Skyrim Special Edition was up next, and it did very well in the UK, including in its first week. Of course, the game was a known quantity to fans, so it's not the best example of the policy in action. Physical sales dropped by just 53% in its second week, which again is higher than you'd typically get (although it actually wasn't too unusual during a rather unpredictable Q4). During a period where game sales often underperformed, Skyrim Special Edition emerged as one of the few real success stories. It debuted at No.6 in the US for the month of October, and fell slightly to No.9 in November.

The same was not true of Dishonored 2 in November. The game was absent from NPD's charts for the month, whilst in the UK its first week sales were lower than its predecessor. During its second week, as the reviews were going live, the game dropped 52% in sales. Again, although a fall of 52% is good for a second week, it was actually quite normal for Q4 last year. The game didn't pick up significantly until Bethesda lowered the price at retail.

Now onto Prey. It's still early days, but the first week's sales were disappointing (for the UK boxed market). However, like Doom, the second week drop-off was just 32%. Overall, the game hasn't performed as well as it deserved, but there are signs that it might enjoy a longer-tail at retail (again, like Doom).

So here's the next question: would these titles have performed better in total if the reviews were available from the start? And it's difficult to say.

Dishonored 2 and Prey are the notable under-performers here, but the bigger issue for these titles is the general consumer apathy for the genre. These games are called 'immersive sims' and another recent game in the category, Deus Ex: Mankind Divided, also struggled last year, despite the (generally positive) reviews going live before launch.

2

Prey's rose from No.2 to No.1 during its second week on sale in the UK

There are so many different facets in how a game performs that to pinpoint anything specific - like reviews - is to overly simplify the challenge that publishers face. Doom had a slow first week on console, but how did it fare on PC (its spiritual home)? The critics loved the single-player, but Bethesda focused on multiplayer before launch (with the Beta) - did that have a negative effect on day one?

"There are so many different facets in how a game performs that to pinpoint anything specific - like reviews - is to overly simplify the challenge that publishers face"

Did Dishonored 2's proximity to Black Friday hurt the game? Or the fact it was sandwiched between Call of Duty and Watch Dogs 2? And what about the reception to Prey's demo (which was released the week before it launched), did that help or hinder things?

In addition, Bethesda may also feel that it's better, from a PR perspective, to see the reviews spread out over a period of time. Kotaku wrote that the absence of a pre-release embargo meant that some critics would rush-review Prey (something that isn't recommended for that game). Yet Bethesda may feel it's a small price to pay so that it gets a more steady stream of articles, as opposed to every review hitting at the same time. The longer a game is being talked about, the better.

Yet there's no real evidence that Bethesda's review policy is making a huge difference either way. Sales do seem to be spread out more evenly between the first and second weeks, and are not just concentrated around the first few days. But that doesn't mean these games are losing or gaining sales - all it says is that some consumers would rather wait for the reviews before taking the plunge.

So we end up returning to that first question. If it's not making much of a difference, why do it? It's not exactly winning Bethesda many friends, nor do any of the three parties (Bethesda, the media or the consumer) seem to benefit.

Indeed, Bethesda is a company that prides itself on its consumer-first nature. That's why its preferred marketing activity is to release demos or betas - why should the press be the only ones to preview a game? That's why its E3 conferences are really consumer shows, with the industry tagging along (rather than the other way around).

So with that in mind, it's worth looking at how consumers feel about this reviews policy. And judging by the sales trends, plenty of them want to hear from the critics before they buy.

Related stories

Rime: Critical Consensus

Tequila Works' well-crafted puzzle title leaves reviewers stunned but divided over the long-awaited game's impact

By James Batchelor

Beam becomes Mixer: Microsoft upgrades its Twitch rival

Live-streaming platform also expands to mobile

By Christopher Dring

Latest comments (5)

Richard Browne Partner & Head of Interactive, Many Rivers Productions11 days ago
Without seeing digital data its even more hard to quantify this, but I fully support Bethesda's policy. At the end of the day almost no one ships a finished game on the disc anymore, day one patches have been allowed to an absurd level by first parties. Unless Sony and Microsoft go back to demanding everything be done by submission review code before launch is likely to be broken in some way and in the case of MP games not necessarily reflective of the final product because of lack of players.

Edited 2 times. Last edit by Richard Browne on 17th May 2017 3:23pm

2Sign inorRegisterto rate and reply
Andrew Whitehead Community and Content Manager, SeaNanners11 days ago
@Richard Browne: I see your point, but if you look at what IGN did with their Prey review you can see how not working with the press can turn out. I'm sure you know, but IGN gave Prey on PC a 4/10 due to a game breaking bug - something they could have reported to Bethesda during a review embargo period. And perhaps dealt with in a private manner.

Personally, I think IGN handled that pretty poorly and that score wasn't helpful for consumers, and I think ultimately it has only damaged their credibility. But I do think Bethesda should be smarter about giving some outlets early access to review copies. Again, not saying they have to or that they should feel like they're being held to ransom, but speaking for myself - the first score I saw of Prey was IGN's and it colored how I saw the game for a while.
2Sign inorRegisterto rate and reply
Klaus Preisinger Freelance Writing 11 days ago
All Bethesda is saying is, that for a good game, the press is not better than word of mouth and for a bad game, the press at least does not work against PR pre-release.

Neither League of Legends, nor Minecraft, nor World of Warcraft, nor any of the really big games, established its userbase in one week. But just like blockbuster movies, a certain type of game game only has a very short window in which they it sells well at maximum price. Even billion Dollar movie franchises are gone after a month. So which game are you? The game people will play happily for years, which can afford to grow slowly over time? Or the 20h disposable blockbuster movie game? In which case, there is an argument for the press and an even bigger argument for quality over initial release date.
0Sign inorRegisterto rate and reply
Show all comments (5)
Christopher Dring Senior Editor, GamesIndustry.biz11 days ago
Hi Klaus,

Although that's very true of long-tail games - the sort of multiplayer projects like the ones you list - that's not so true of single-player titles like Prey and Dishonored 2. These are games that you complete in a week or two, and then find themselves in the pre-owned bins.

The debate over the power of reviews is a complicated one. For instance, good reviews of Zelda became that title's central selling point to a wider audience during March. Nintendo called it out during its financial call as a reason for it exceeding expectations. Likewise, on the other side of the debate, Yooka-Laylee's extreme review scores probably hurt the performance of that title. It certainly seems like it.

Then there's Tom Clancy's Ghost Recon: Wildlands. Hitting below the critical bar that Ubisoft would have liked, certainly, but sold to the market regardless.

Of course that last game is the multiplayer, open-world, long-tail title of which you speak.

Edited 1 times. Last edit by Christopher Dring on 18th May 2017 8:00am

0Sign inorRegisterto rate and reply
Richard Browne Partner & Head of Interactive, Many Rivers Productions10 days ago
@Andrew Whitehead: Totally agree IGN handled the issue like children. But then is that a surprise?
1Sign inorRegisterto rate and reply

Sign in to contribute

Need an account? Register now.