The only intelligent solution is to not include 1UP scores in a Metacritic score. It compromises not only 1UPs position on a game but also Metacritic's overall accuracy and integrity with all of the products reviewed by 1UP. Including it at all doesn't make any sense, the choice to include 1UPs letter rating on 100 point scale system is kind of ridiculous regardless of whether or not they receive a direct conversion scale from 1UP as each person's interpretation of the letter grade will be different.
Personally I think the letter grade system for reviewing games is a great one that more reviewers should adopt. Numerical scores are too technical for something as subjective as reviews I think.
It seems the two dispise one another.
Original message to 1UP:
Scott,
I am writing you regarding your review of Demigod and Metacritics subsequent interpretation of that letter grade. On your review you called Demigod a "highly-recommended C game", noting that its multiplayer needed work. I most definately agree with you on that, as well as this game having the potential to be a great multiplayer game.
Unfortunately, Metacritic used by many gamers converts your C grade to a 50% by defualt. I highly doubt, given your review, that you would have given Demigod a 50%. To me your review sounded like you would have given it a 75% at the time. etacritic allows the critic to change their number if they believe metacritic misinterpretted it. I would greatly appreciate you contacting metacritic to chage this at:
http://www.metacritic.com/about/contact.shtml
I think this would more accurately reflect your review. On top of that, it would help to improve the metascore, which may help improve sales and keep the community growing. Thanks so much.
John
Original message from 1UP:
See below letter for only nice things possible to take from this letter. Seems inappropriate to post the letter given its tone.
Original message to Metacritic:
Game Editor,
I am writing in regard to your Metacritic score of Demigod., specifically the score you attribute to it by 1up. You attribute the score of C as a 50%. I understand this is your scoring interpretation, but feel it is fundamentally flawed in this particular case and deserves some review on your behalf.
I and many of my friends use Metacritic as a resource for a compiled statistical analysis of all the reviews. I was shocked by the score you attributed to 1up and decided to read the article through. The article for the most part could be described as highly favorable. Given the tone of the review, that you would have given Demigod a 50%.
In his review you called Demigod a "highly-recommended C game", noting that its multiplayer needed work. To me this review sounded like he would have given it a 75% at the time. I decided to email the writer of the article.
I explained the above points in the email, and waited for his reply. He replied that he was "abundantly aware of what Metacritic does to our review scores." He further stated that, "They know where our scores should land on a 1-100 scale, because we've told them ourselves." He then advised me to contact you and bring this issue to your attention.
I think correcting this to a 75% would more accurately reflect his review. On top of that, it would help to improve the metascore, which may help improve sales and keep the community growing. Thanks so much. I look forward to the correction or a further reply on this subject.
John Kowalczyk
Reply from Metacritic
Hey John,
I sympathize with your plight here because letters are certainly imprecise and are open to interpretation. I can tell you that our conversion scale is principled, and that all games, films, albums, and TV shows are treated identically, which is important to know. Did 1up's critic you spoke with also explain to you why they changed from their very precise numbers system to letters? It's an interesting story that I'm sure someone over there would be willing to share with you if you bugged them enough. And did he also describe to you how they converted all of their 5.0 scores in Jan of 2008 when they did their full inventory conversion to letters? They converted all 5.0 scores to "C", which is exactly how we do it in reverse. For example, the game Spider-Man 3 was given a score of 5.0 by 1up in May of 2007, which 1up and sister site EGM defined as "Average". After the conversion to letters in 2008, that 5.0 score became a "C". So I can't quite understand how they can be so indignant about our converting their "C" to 5. But believe me, the 1up crew and I have spent hours discussing this very issue on the phone. We simply agree to disagree.
But on a more philosophical level, and without regard to 1up, if you convert letters to numbers the way they do in school, an "F" would equate to 58, all Ds would be in the 60s, all Cs would be in the 70s, etc. That simply doesn't work when you're aggregating scores in my mind, but of course there are many schools of thought on this issue. Which is the major downside to using letters. No two people envision an identical letters to numbers conversion. What I can tell you is that the 1up and EGM crews were well aware of how Metacritic and Game Rankings converted letters to numbers when they went to letters, and our scoring conversions haven't changed since 2001 we launched in 2001. I agreed not to disclose their full conversion scale as of 2008, but I can tell you that we're not that far off from them.
Best,
Marc Doyle
metacritic.com