Starfield review controversy traces game journalism's orbital decay
Starfield review controversy traces game journalism's orbital decay
This Week in Business is our weekly recap column, a collection of stats and quotes from recent stories presented with a…
More concerning than Bethesda's decision to withhold early review codes from certain outlets is how heavily some sites are relying on the game to drive their business.
You're viewing a single thread.
Ratings. Are. Stupid.
When it comes to movies and audience scores, sure, look at the rotten tomatoes score or whatever. But everyone should realize that the average score of EVERY CRITIC is just going to be a useless number.
Not only that but reviewers who represent entire companies like the people at IGN and elsewhere aren’t giving an honest opinion. I know this because a few of them have given their honest opinion before. They got fired for low scores.
This is the reason that I enjoy watching reviews from people like ACG or SkillUp. They don’t need to give a score because their opinion isn’t a number. Enjoyability isn’t a number. Both of those reviewers enjoy games slightly different than I do, but when I watch their reviews I get a sense of if I will enjoy them.
Seriously if you go to outlets who give scores on games commonly, stop. Very little time is put into choosing these numbers and they reflect nothing about enjoying a game for you personally. Go watch a review from ACG or SkillUp. Outlets like IGN or PCGamer can’t hold a candle to these guys.
They could easily all be giving their honest opinion at IGN: if the reviewers who tend to like everything are the ones who don't get fired, the output of mostly positive (or sometimes groupthink negative) reviews would be the same, even if individual reviewers never lied.
Take a read of this summary (by IGN) of their Madden 22 review:
“ Madden NFL 22 is a grab bag of decent – if frequently underwhelming – ideas hurt by poor execution. Face of the Franchise, to put it mildly, is a mess. Homefield advantage is a solid addition, but it doesn’t quite capture the true extent of real on-field momentum swings. The new interface is an eyesore, and the new presentation is cast in a strange and unflattering shade of sickly green. It’s smoother and marginally more refined, but in so many ways it’s the same old Madden. In short, if you’re hoping for a massive leap forward for the series on the new generation of consoles (or on the old ones), you’re apt to be disappointed”
Now, I want you to read that and ask what you’d rate it based on this info (or the whole review).
IGN has a scale approximately this: 10. Masterpiece 9. Excellent 8. Great 7. Good 6. Okay 5. Mediocre
I don’t think I need to tell you that the user reviews for this game don’t even reach mediocre. Not to mention the gambling inclusion that IGN doesn’t take seriously in any sports game it reviews. But IGN still called Madden 22 a 6 or an “okay” game.
I’m not saying they’re lying necessarily but the result is the same. The honest critiques are ignored to keep receiving review codes. That score should be left out entirely but they refuse because it drives clicks. It’s a joke.
This is just one example of how boiling down a review to a number is flawed. My favorite reviewers of games in general have been Matthewmatosis and Mandalore Gaming. IIRC neither of them provides a final score of any sort. Even whether a game is “recommended” or not may come with some caveats depending on what you’re looking for in a game.