A U.K. company named Vertical Slice claims itâs able to predict video game review scores a year in advance of release, by reverse engineering magazine reviews, combined with an analysis method used by marriage counselors.
Speaking to Eurogamer â you really should read the entire story â Vertical Slice director Graham McAllister boils down the process to two things: backtracking through 154 Edge magazine reviews of games, and then analyzing what people say and do while playing the games. The latter, called behavioral or sequential analysis, was used by a marriage counselor who predicted, with 97 percent accuracy, whether a couple would stay together or break up based on the first five minutes of observing them.
âPeople think you canât predict a game based on quantifiable data,â McAllister told Eurogamer. âWhat we can do is get these estimators. Some people will just have a hard job believing it. We have analysed the statistics to death, thorough and rigorous, and what weâre saying is, âYou may not like it, but this is the best model that anyone has come up with to date.'â
In this case, McAllisterâs analysis is based on just a single minute of gameplay. âWhatâs important about that first minute is that itâs the time people play a demo for. Thatâs super critical,â he said. âAfter 30 seconds, we can predict if the game is going to be bad or good, to a certain extent.â
The reverse-engineering of the Edge reviews involves the usage of certain words or phrases, matched to scores. âAll the high-scoring games talk about certain aspects; all the medium-scoring games talk about certain things; and all the low-scoring games talk about certain things. And thereâs a very clear mapping between them,â McAllister said.
Can You Predict Review Scores? [Eurogamer, via Go Nintendo]