Our resident sports gaming expert, Owen Good, recently e-mailed me with some concerns about the way we review sports games at the site. Our reviews all include the question: âShould you play this game?â Owen realized that he was pretty much always saying âYesâ, and he realized that it was because of some qualities specific to the current era of licensed sports games.
I like giving readers an opportunity to see how we decide things at Kotaku, so, what follows is my and Owenâs e-mail exchange about how Kotaku reviews sports games. Weâve done a tiny bit of editing for readability. Otherwise, this is the exchange.
The sidebar is the byproduct of this exchange and represents our editorial stance, going forward, for any of our sports game reviews.
From: [email protected]
Date: Wed, Sep 19, 2012 at 12:15 PM
Subject: Some thoughts on reviews of sports video games
When we get to the end of this yearâs sports video games (which will be after WWE â13 in November) Iâd like to know your thoughts on exempting sports video game reviews from the âShould You Play This Game?â call going forward.
If you look at all of my reviews of sports video games, they have all been Yes. This is not good, and makes me appear to be a shill or critically shallow. But in answering the question âShould You Play Thisâ I feel Iâm answering it honestly. Itâs a gameplay question, not a consumer question, and I have understood this to be deliberately the point of asking it (as a contrast to the gut check experiment of last year).
To answer âno,â to âshould you play this,â to me communicates that the thing is even worse than âdo not buy,â which is the ultimate standard in sports video gaming, thanks to its annualized nature. To answer yes to âshould you play this,â likewise can send a disproportionate message of approval in an annualized genreâand itâs different from Assassinâs Creed or Call of Duty in that this is more of a continuation or a refinement of the previous yearâs game, not a different chapter in a longer-running story.
Today, with F1 2012, my personal feeling is, no, Iâm not a Formula 1 fan, Iâm not really interested in playing something this technical and demanding. But I canât find it in me to impugn the overall work of Codemasters and its studio on what is, for those who truly are interested in Formula 1 racing, a very solid simulation that engages its fans on whatever level of interest they have in that sport.
https://lastchance.cc/f1-2012-the-kotaku-review-5944729%3C/a%3E%3C/p%3E
For another frame of reference, see my review of NHL 13. As a fan, I have no affection for ice hockey or real knowledge of how the sport is played. Thatâs not the type of person reading this review (even if it is offered for general consumption to all of our readership).
https://lastchance.cc/nhl-13-the-kotaku-review-5942764%3C/a%3E%3C/p%3E
Do you see what Iâm getting at? This sort of calls back to my column last year on whether sports video games are worth reviewing, as theyâre annualized, typically only one has a league license, and itâs basically, yeah, if you want to play Major League Baseball on the Xbox 360, then MLB 2K12 is worth playing, all of its faults notwithstanding. NCAA Football 13 came in short of expectations, and I said so in the review text, but, still I canât sit here and say the whole thing is such a waste of time itâs not worth playing.
https://lastchance.cc/are-sports-video-games-worth-reviewing-any-more-5837184%3C/a%3E%3C/p%3E
The reason The Wall Street Journalâs review of Borderlands 2 generated so much heat in the core gaming community is because the guy really did place his narrower personal interest over a broader critical responsibility. I feel like âShould You Play Thisââas it is applied to the sports genreâsets up a situation that doesnât say much of anything, until it says something totally uncalled for. The problem is, when we make an exception for a class of game, we risk diluting the overall integrity of the review process. I understand that.
Iâm not sure what the answer is but I just wanted you to know Iâm pondering all of this, and have every intention of proceeding forthrightly under the current standard, but I worry about its sustainability in the area I am called upon to judge.
OSG
The Tendency Toward âYesâ
Beside every video game review Kotaku makes a judgment on whether it is worth playing. Yes, No, or Not Yet are the responses, and in our unscored reviews, it seems to present a pass/fail proposition on the gameâs entire merit.
Sports video games, on the whole, show some kind of improvement every year, making them very likely to receive a âYesâ if the worth-playing question is answered honestly.
What forms the spine of a sports video gameâs critical reception is how much it improved over the last year. A yes or a no to âis this game worth playing?â does not answer that. Still, we think itâs vital to have a uniform review standard, and annual sports video games will be held to it.
So even if most titles are likely to receive a âYes,â that should only be considered the starting point if not, frankly, a fundamental expectation.
It should be stressed that âIs this game worth playing?â also doesnât answer whether it is worth buying, which is a question that animates so much of the discussion behind annualized sports titles. Kotakuâs reviews evaluate a video game on their critical merits, leaving out questions of their worth as a full-price purchase, as a used or discounted purchase, or where it may fit into a gamerâs crowded budget.
Thereâs going to be a big green Yes on a lot of licensed sports video games unless they have regressed to unplayability. Given the genreâs iterative nature, and the industryâs aversion to reinventing a series with so much licensing money at stake, such cases should be rare.
The Yes/No answer to a sports video gameâs playability may not fully appraise the gameâs merit. But patronizing the genre and its constituency by creating exceptions or exemptions in our review policies would not help matters, either. We ask that you read the entire review and use it to inform your expectations of this yearâs edition.
From: [email protected]
Date: Wed, Sep 19, 2012 at 6:34 PM
Subject: Some thoughts on reviews of sports video games
Owen,
This is a really smart e-mail. My thoughts:
1) Youâre right. Most annualized, licensed sports games, based on the standards weâre using, will merit a Yes.
2) The Yes (or the No or the Not Yet) is, obviously, not the only assessment weâre giving in our reviews, so I donât think we should worry that it excuses a gameâs faults and prevents us from offering a nuanced assessment of the game. The Yes tells people itâs worth playing. Most of the rest of the review explains why and notes caveats. The Yes is simply a more natural way of telling people the game is worth playing than any number we could put on the review.
3) If there was more competition in sports gaming, I donât think this would be an issue. Thatâs why this feels like a valid edge case to our review system. Should we see alternate NFL games crop up, we could more easily guide people with a Yes on one and a No on the other. Itâs just not the case at this moment in history. So Iâm fine with treating sports games a little differently now, but not ok with excusing them from our system and thereby never being able to gracefully get them back in our review system.
4) So⊠Iâd like to have you retain the YES/NO/NOTYET system for these games. I want this, in part, because the Not Yet is an important tool for us to use for buggy games that cannot be fairly assessed at launch but might be better once patched. But Iâd like you to note, in your sports games reviews, that we have a Sports Game Exception or whatever you want to call it. That notation should link to an explanation of how we assess sports games.
5) Our Sports Game Exception is essentially outlined in your e-mail to me, so letâs go ahead and publish this exchange on Kotaku for all the readers to see. Are you ok with that?
-Stephen
Owen was ok with me running these e-mails, so now you all can see how we hashed this out. He wrote the sidebar, which we decided not to call an âExceptionâ, because we decided that was too extreme a label.
We both hope that competition will eventually return to licensed sports games and that all of this will therefore become moot.
