Wednesday May 23, 2012 4:48 PM AEST

Is there a place for honesty in game reporting?

By David Hollingworth
10:31 Dec 2, 2010 | 44 Comments
Tags: game | reviewing | news | opinion
Is there a place for honesty in game reporting?

Opinion: It appears that honest opinions aren't welcome in the world of games. I wonder why...

Yesterday we posted a gallery on the contents of the shiny new Reviewer's Kit for Gran Turismo 5, and took the opportunity to share our opinion on the game.

In short, and at the risk of further abuse... I don't get driving games of that kind, so took the opportunity to rant a little. The intention was to be a bit comical, a bit ranty, and to explain our thinking on why the game leaves us cold.

Which, it appears, is remarkably unwelcome.

The matter of personal opinion, subjective review, and objective appraisal comes up often in regards to gaming, and it seems - at least in parts Atomic - that a personal opinion of a game is remarkably unwelcome. But I cannot help but think that when it comes to games, just like cinema, personal opinion is all you can have.

A game is more than a mechanical array of code and mechanics, now more so than ever before. They are emotive stories, relying upon narrative investment to hook players. Even detailed simulations, of any kind, rely upon a base emotional interest. In the case of GT, for instance, it's the love the car, of that fine racing line. Even less serious games rely upon comedy, or just sheer happiness for their allure.

So, it seems natural then that some games are going to be liked, and some disliked. 

Of course, this is a truism that probably doesn't need explaining - look at our forums for many such opinions for and against pretty much any game you can name. Even complete game reviews draw that same commentary, and it's business as usual to see people both passionately agree and disagree with a given ruling.

However, it seems that, as a games journalist, having any kind of similar personal opinion is strictly verboten.

Well, in all honesty, I quite utterly reject that.

Games are not like hardware - they cannot be reduced to suite benchmarks or numbers. Instead, they are quite purely subjective, and there's not way around that. Look at Halo - it's a hugely popular series, and our own estimation of the game just happens to gel with the larger consensus. But does that invalidate the thousands of gamers who don't like it?

Of course not! And we'd consider it remarkably un-Atomican if we were to look down on gamers who disagreed with us.

Of course, the inversion is even more of a challenge. When we do honestly dislike a game - even one from a genre that we're fond of - it's a common cry to hear that game X scored well on MetaCritic, and therefore any opinion otherwise is invalid.

The full extension of this kind of thinking leads to dangerously homogenised state of play. Imagine if all reviewers checked their real opinion at the door and moderated their scoring on the mass of reviewers that have gone before... how would that serve the gameplaying public?

And even more than that, how does me keeping my opinions quiet help you, as a reader? I believe that honest, personal disclosure helps build a picture of the reviewer. Anyone who reads a few issues of Atomic can work out quite easily where my gaming predilections lie. If it has power armour or Napoleon for instance (and I pray for the game that delivers both!), I'll probably like it, for instance.

It's often all too easy to forget that the person writing a review, or a news piece, or whatever, is a gamer just like you. And it's often all too easy to forget that Atomic has been built on robust opinion, honest review, and a certain degree of "Hey, we're just like you"-ism. Just like you in that there are games we love, and games we hate.

And, that when we know we have a possibly biased dislike of a game (a la GT5), we'll find a more appropriate reviewer, or even not review the game if we can get away with it. I'm sure no one wants the alternative - an empty review written based on others' opinions, rather than our own honest one.

I think it would be doing readers a disservice to not be honest about our gaming biases. And if that's going to lead to people losing respect for me or Atomic, I honestly suggest the problem is not with the reviewer.

 
 
Aliens: Colonial Marines in depth; Z-77 Motherboard round-up; strategy gaming special; Home Server tutorial. PLUS MUCH MORE - ON SALE NOW!
44 Comments
nesquick
Dec 2, 2010 10:44 AM
Don't worry about it David, its only GT4 with a few more cars let the idiots have their "racing sim"
UberPenguin
Dec 2, 2010 10:49 AM
I read your reviewers kit piece yesterday had a chuckle and moved on. I don't understand what was wrong with it. In fact atomic's idiosyncratic use of language and comical rants are what first interested me in the magazine and keeps me reading it.
Actually I'm amazed that anyone lacking that sense of humour is reading the magazine or on this site.
Hawkeye
Dec 2, 2010 10:55 AM
Oh, it's not just about yesterday's article, but that is the inspiration.

Rather, it truly does seem that for a lot of people, honesty is the last thing they want when it comes to gaming. The idea's popped a number of times over discussions here and on the forums :)

And I'm not worrying (too much...); you need a bit of a thick skin to be able to do this job anyway!
Ekythump
Dec 2, 2010 11:20 AM
Keep the honest reviews coming :) I base most of my game purchases on reviews so I find it refreshing when i find a good honest review.

And if they don't like it they can make better games next time.

I'm a bit Meh over car games also..same ol same ol. The only one I've bought and ejoyed recently is the new Need for Speed Hot Persuit because I saw something different in that, ( mainly being a cop and running countless expensive cars off the road or trashing them) :) So it was nice to see a similar and honest attitude :)

UberPenguin
Dec 2, 2010 11:34 AM
Actually I trust atomic's opinion on game review much more than other places because usually you guys seem to have the same kinda taste that I do and dislike the same kinda flaws - take mafia everywhere else was giving it a right panning but you guys gave it a good score, despite the flaws it had. Where as dead rising 2 you said DONT PLAY IT ON PC! and various curses to games for windows live.

Its that kinda honesty that keep me trusting the mag's reviews.
Karmicfloss
Dec 2, 2010 11:35 AM
Fuck man, there was nothing wrong with that piece imo.
+ 10 to those who are calling for more honest reviewing. I still remember the rage I felt when MW2 was getting 9 and 10/10 without fucking dedi servers. Those reviewers earned their Activision bumlicker badges well and truly.
We really need to hear the voices of those who aren't scared to share their personal opinions and views, based on their own likes and dislikes. Hopefully any publications' readers are well aware of the various reviewers tastes, and are readers because of that. I would seriously love to see more scathing and/or at least critical reviews of big releases AT THE TIME OF RELEASE, not weeks afterwards, which in my experience has been the case. + 10 Atomic, carry on good sirs.....
jdog
Dec 2, 2010 11:45 AM
+1

all of my PC games purchased in the last 6 months have all go good reviews from atomic!

keep up the good work!
swalden
Dec 2, 2010 11:52 AM
I think for reviews based on personal perspective, it needs to be from more then one perspective. So like 10 reviewers review a game and the final score is based on the average.

Hawkeye
Dec 2, 2010 12:00 PM
But, swalden, you already have access to that kind of thing - read ten different website, or just go to metacritic :)
Mordecai
Dec 2, 2010 12:14 PM
I see nothing wrong with giving a personal opinion about games. You are the one playing it, not me. Until I play it for myself I don't know if I will like it or not. I do check other sites to see a range of experiences with games to see what the general opinion is. And if the general opinion is "Its crap" then I am going to generally side with that opinion.
Mademan
Dec 2, 2010 12:14 PM
I think commenting on game that you are already biased against is not advisable, if only for the fact it makes you a target for such criticism. If I were a reviewer, I don't think I could ever review a strategy game, fantasy RPG, or flight simulator, for the same reason. I hate those sorts of games, and a review that I wrote of them would not be objective.

But now more so than ever, I think society only likes to read, see and hear, what it already thinks, and people like having their views reaffirmed by the media, not tested by it. And I think the comments directed against you on that article, highlight this perfectly. I'd hate to see what the comments on GameSpot's review are, for only giving it an 8 out of 10.
Hawkeye
Dec 2, 2010 12:19 PM
Heh - check out some of the responses Bennett Ring got over on his review :)

http://games.on.net/forums/viewtopic.php?f=2&t=182625
trojan71
Dec 2, 2010 12:51 PM
Check out this comprehensive tech analysis by Digital Foundry :-/

http://www.eurogamer.net/articles/digitalfoundry-gran-turismo-5-tech-analysis?page=6
phatbeat
Dec 2, 2010 1:21 PM
I'm happy to hear an "honest" opinion on any type of review, be it a game or a piece of tech. Hell one of the best things about coming to this site is the way you guys handle your reviews. I say keep it up!
reb_dark
Dec 2, 2010 1:23 PM
There was an interesting article on arstechnica a while back about game devs lavishing a weekend of luxury on reviewers for big name titles. It called into question the integrity of reviewers around the world - do we write a positive review of this game and get invited to the country club next time 'round or say what we really think and risk exclusion from a free weekend away?

The ars article is here:
http://arstechnica.com/gaming/news/2010/11/call-of-duty-black-ops-review-event-press-gifts-detailed.ars

and refers to the article written on gamepro here:
http://www.gamepro.com/article/reviews/217216/call-of-duty-black-ops-review/

has anyone at atomic been invited to these events hawkeye?
Ihsan
Dec 2, 2010 1:38 PM
Clearly the only opinion you're allowed to have is the fanboi's opinion.

You might as well just accept some bribes and give everything 10/10...
Hawkeye
Dec 2, 2010 2:26 PM
Reb, we were offered that very event, reb. As it was only the console game, I turned it down.

However, if it had been PC... I'd be tempted. When a company decides to withhold code like that, it makes it tough. If we were an online only outlet, for instance, we would have ended up WAY behind the curve our review, which can make a huge difference.

Thankfully, given we lead in our print edition, the pressure wasn't so tough.

Huh - you know, there's an article in this...
jdog
Dec 2, 2010 2:36 PM
DONT FALL TO THE DARK SIDE,HAWKEYE!
Hawkeye
Dec 2, 2010 2:42 PM
I'm sorry... what?!
reb_dark
Dec 2, 2010 3:13 PM
Fair point. Given the level of...intimacy?..between atomic's enthusiast readership and journalists perhaps an appropriate practice would be to disclose any attendance of such events in the review articles? I doubt many readers will have an issue with the attendance if it gets them a quality review as soon as possible, after all, we're all self-interested beings and would love to be flown by personal helicopter to an exclusive country club to pwn some noobs for a weekend. At least that way we can have all the information at hand and can make fully informed decisions.
Like other comments above, I've always appreciated Atomic's apparent honesty and candor - never too much transparency is better imo.

Completely unrelated, there's going to be an online stream of a NASA press conference 6am EDST (aus) on a new astrobiology discovery. Maybe ET's coming for a holiday? might be an article in that too :p



Fair point, I remember an article you wrote earlier this year about getting a rushed review out asap or taking another day or so to get a quality publication done.
reb_dark
Dec 2, 2010 3:14 PM
well that's embarrassing, i've left a scrap at the end there and no edit function. ignore it. sigh.
Bundy 2.0
Dec 2, 2010 3:33 PM
Hawkeye I don't think the response to the GT5 article was surprising, and to answer the title question "Is there a place for honesty in game reporting?" I would say Yes.

In terms of the response being unsurprising consider that instead of your article I had said the same thing on a gaming forum somewhere I have no doubt I would have people disagreeing with me in a similar way.
In terms of them calling out their loss of "respect for the publication" like some did, thats just an emotional or subjective response to an emotional or subjective article. Were it me making it in a forum post I have no doubt someone would call me ignorant or an idiot or some such. The only difference being the context of the article (front page of Atomic as opposed to a forum).

In short I think it should be expected that a subjective or emotive piece should inspire subjective or emotive responses. Sometimes the result is polarising strongly agree or strongly disagree type responses but isn't that the point of opinion pieces?
Hawkeye
Dec 2, 2010 3:38 PM
You're quite right, of course, Bundy - to be honest, one of the reasons I wrote the article was for the impact :)

But being told that a *personal* opinion has lead to a loss of respect for a *publication* is a little baffling. Stuff like that really does read like someone simply cannot take criticism of their favourite thing.

Which is human nature, of course, but it at least makes for interesting discussion.

Oh, and Reb, we usually do - if you look at our Space Marine and Medal of Honor previews I think we mention being flown over to the various locations.
Bundy 2.0
Dec 2, 2010 3:47 PM
I would have a guess that saying they "lost respect for the publication" was hyperbole (perhaps unintentional) to get their point across.

Can unintentional hyperbole exist?

I wish I was flown across to Relic studios to see Space Marine.
As for if this compromises the way you present the game in question I think it can do but I feel Atomic does a good job at keeping its integrity.
I can think of some other sites that have little to no integrity at all /cough.... gamespot .... /cough
philo-sofa
Dec 2, 2010 4:00 PM
Not sure if you remember Hawkeye, but we had a little run in on this sort of issue as a result of your BC2 review. This however a very different situation - couldn't agree more that it would be dull if you didn't have the odd bit of opinion and think the mini-article was good and basically said:

"..got a driving game in; don't drive & hate driving sims, so we gave it to someone who likes them. p.s. the bundle was lulzstasticly overdone and WTF is with driving games again? O.o "

Which is factually un-assaultable, and gave us a small insight into the mindset of the public-transport loving (i.e. communist) gamer in an amusing way. You even prefaced it with a 'personal opinion' disclaimer in bold lol. If I were a fan of the series I suppose I could have been slightly let down there wasn't more info or SS', but I doubt I'd be angry - I truly don't understand the furore here at all.
Hawkeye
Dec 2, 2010 4:11 PM
Oh, I remember, philo...

I REMEMBER.

*peers*
CloAkEd
Dec 2, 2010 6:44 PM
Hi Hawkeye

Yes it was me that said I lost respect for the publication after that article, and you know what maybe it was a little OTT but it was the truth.

Looking back I probably didn't craft that comment as well as I should and yes it was an emotional response but that is what you were after.

"But being told that a *personal* opinion has lead to a loss of respect for a *publication* is a little baffling. Stuff like that really does read like someone simply cannot take criticism of their favourite thing." - Hawkeye

Let me try and clarify or dig the hole deeper.

Your review/rant/comical stylings (yes I did giggle a little) evoked an emotional response and not of one to defend one of my greatest childhood memories but one of confusion. I just didn’t see the point of the article and try as I might I cant find any good reason why not. You have explained all your reasons for posting the previous article and all of your comments in this and the former further your reasons.

At the end of it all, we all have our opinions it would be a desolate and plain world if we did
not.

Anyway, Im going to go put the flame suit on.

Cheers
tw2
Dec 2, 2010 8:51 PM
I have bought all my games based on your reviews, I have yet to be disappointed and I doubt I ever would be. gt2 was a fantastic game at the time, I also think they have lost something through the series.
philo-sofa
Dec 2, 2010 9:35 PM
Indeed Hawekeye..... indeed.

*narrows eyes*
Rage09
Dec 2, 2010 11:28 PM
Why are there so many sites and magazines all reviewing the same game?

Answer: Rehash above comments.

I've been following this site for a while now and if I was going to buy a Racing game I probably wouldn't come here for a review.
Action/Adventure, FPS or Stratagy game yes but not Racing.

My tastes in games strongly matches most of the reviewers here so I'd trust them on those sorts of games. And that's who you want writing a review, someone who would see it the same as you.
wayke
Dec 3, 2010 6:42 AM
How and why is there a rating system for these Games its more of justify the stupid price tag for this clone of last years title by CLONER/Publisher they gave reviewers a few boxs of goodies so they take home some labled pens think wow BIG EVIL mega corp exploiting programmers in the 3rd world to push out these monthly turds Cloner Corp is not so bad :>-0; RAPE SIGN MUCH,,,
But HALO SUCKS no matter how many numbers follow it Same with ME2 or MD2 Mass Defect 2,
But my Grievance with CLONER/PUBLISHERS is the patching ffs someone else made this engine you change some scripts recompile the Exe with a dif name and linkage wow your so freaking special cloner/publisher oh look new features ONLy available in DLC 59.99 au gives you weapon that you dont have apon purchase but if you wait 2 months a patch comne out and you get said weapon free then the expansions start oh look they added a map removed vehicles and put in PENGUINS yaya i can fly a penguin wait do they even fly
Then there are Player upgrades because you were so kind to use your credit card on all 40 expansions here is unlimited Health in multiplayer and an Aimbot for being such a WHINGING little Bitch we check your Chat we taylor adds to your game we brain wash you into buying the same game every yeah with a PLUGIN on the old engine making it crash then we remove that plugin and you have no idea you paid another 400$ for a gameset not worth 50 cents all made by some Guy that speaks no English and is being exploited in the 3rd world for 10$ an hour and made to work 40 hour weeks. YAY cereal num num num
H3VIW8
Dec 3, 2010 9:55 AM
i'd rather hear the truth in your opinion than an obvious lie, i may not agree with whats said but at least it's not generic fluff told not because you believe it but because it's what expected of you, frankly i don't care what others think of my opinion, it's mine, and i won't change it just to make someone else happy. keep up the good work.
GhostFaceKilla
Dec 3, 2010 11:06 AM

Thanks Hawkeye for the article. This is an area that I have been thinking a lot about. I have been v busy so havent had chance to reply earlier.

You raise a very important point - and it is essentially the heart of the matter. It is the challenge between being objective and subjective.

You are absolutely right in suggesting that any game has to have a subjective aspect. In reality though this is what has to be minimised. Because really a review that is purely subjective is worthless at best.

The challenge then is how do we be objective as much as possible, while still being able to have room for a subjective element (a very simple start would be to have a review of a FPS by a person who actually likes FPS or a racing game review done by someone who actually likes racing car games etc).

Funnily enough being more objective is not that hard to do. When we mark a university essay or exam for example we have a checklist of thing to tick off. Everybody starts with a '50' pass mark. And then the abscence or not of certain factors then leads to marks being added or marks being deducted. Based on this system alone there is no way that many games on the market now would be recieving the scores they get which are arrived at by some arbitrary means.

What is important is the CATEGORIES by which you will be reviewing scores. The MORE categories you have by which to gauge a product then the more realistic the final review score will be. I have over the years seen little or ZERO information from most reviews as to what categories they are assessing particularly in a game apart from occasionally some very general ones such as 'graphics' or 'gameplay'(a meaningless concept with some supporting context).

A first step to being more objective in a review then particularly for a game, is to identify precisely what categories/points your have assessed and why. This may take a little more time and be a little more boring, but The result is a far more transparent and objective review. Of course the challenge is to work out just what should be measured, but really that shouldnt take too long to work out. And once you have done your list once, it doesnt have to be done again. The review then simply becomes one where you explain each of those points from your checklist and why you scored it the way you did. An astute reader would be very quickly able to see where the bullshit is creeping in.

And yes, make the subjective element one of your criteria. There is nothing wrong with that.

GhostFaceKilla
Dec 3, 2010 11:11 AM
I forgot to note that at university we have a 'class participation mark' which is in fact a way for a teacher to introduce a subjective element into a students final mark in a open way. This works fine. The same thing can apply to a game review. it can reward things such as obvious passion, or someone who has clearly tried to make an effort. Of course this is not a significant mark - no more than 10% over all. But is still very good.
GhostFaceKilla
Dec 3, 2010 11:18 AM
Final comment is that the fact that Atomic talks about this matter in a serious way reflects very positively on the magazine and its staff :-)

tres cool.
osama_bin_athlon
Dec 6, 2010 10:40 AM
keep to the truth, however you see it - I always read a few reviews on any product, including games....honesty being of course, the best policy etc etc
but you already knew that!
:P
pity GT5 hasn't been released for PC, is it ever going to be? surely (or was that shirley?) the producers will see a market and exploit it.....it'd be silly not to.
kikz
Dec 13, 2010 1:27 PM
I'd play GT5 on PC. It'll never get released on that platform though, being a if not the definitive PS game. (at least in my racing fanatic mind :)).

we didn't rate it either :p http://www.ausgamers.com/games/gran-turismo-5/review/
superfireydave
Dec 13, 2010 9:05 PM
I'm more then a bit late here, but I don't think there's a problem with writing personal opinion as part of a review, especially if you acknowledge that it's personal opinion (obviously any review is, but it's nice to make it specific :P).

What I find wrong in quite a few reviews is that the person reviewing the game is one of three camps.

They get the game, but are so swept up in it that they fail to give a proper review (happens with games like Halo).

They don't get the game at all, are not the intended audience, and simply dont understand what makes the game good or bad and therefore fail to give a proper review (happens alot with complex games - I think this is where your GT5 piece came from but you did the right thing in passing it along to someone who understands said games for a proper review~)

and finally, they understand the game and the intended audience, and therefore can give a review that people who are interested in the game actually value - whether or not it hits the target audience (in the case of GT 5, driving simulator fans) . Honesty in this type of review is widely appreciated in pointing out both the things a game fails at, and the things it wins at.
alexdtree
Dec 15, 2010 12:15 PM
a review is naturally made up mostly of opinion, i think the only issue is Bias and as someone reading a review i like to be informed about a game features good descriptions of the way the features work etc with little personal opinion as possible
Hawkeye
Dec 15, 2010 2:18 PM
alex, you seem to be contradicting yourself a touch there - if reviews are mostly opinion, how can you expect as little opinion as possible?
12345
Dec 18, 2010 7:58 AM
totally agree. Thanks atomic.

as long as the personal opinion is based off valid reasons then im all for it but judging certain aspects for what it does right and if it improves the genre, those aspects need to be shown too.
Avliden
Dec 22, 2010 8:44 PM
Nice write up, I agree completely. I expect nothing less from atomic. Its Atomic's honesty and humer among other things that has kept me buying the mag even when I find myself without food.

PS: I don't like GT either, looks amazing.. but it just doesn't tickle my under carriage.
Shopi
Jan 7, 2011 4:57 AM
Reviews are a personal opinion, good, bad, or horrid, it should always be based upon how the product makes the reviewer feel. I say call a Spade a Spade!
gyrus
Feb 11, 2011 1:10 AM
Wow... well I am more than a little late... been busy with RL and kind of sorry I missed this one Hawkeye.

I have differed with you personally on your reviews before... that is not to say 'personally' as in I don't like your person (I actually quite like your editorials and your opinions in those) but I disagree with your personal approach to reviews.

It's not that I don't like your honesty, or opinion, (or bias) but I think your approach lets those things drown out any actual review?
I mean - it's fine to say "I hate this genre." or "I like this IP." - but to let that completely dominate a review which (to my mind anyway) is there to help the readers of Atomic decide if a game is worth buying (or not) is what I disagree with.

You and I disagreed on Star Trek Online because I felt that your love of the IP resulted in you overlooking whether it was a good game?
I feel we may disagree again over Dark Millenium Online (WH40K) because you love that IP too?
Don't get me wrong - I love both those settings too - but not enough to let myself accept a poor quality game and overlook the flaws - or perhaps unfairly review a good quality game?

To my mind (and I may be wrong... I think that has happened before? Nah...I might be mistaken about that ;-) ) a reviewer is free to give an opinion on a game, but along with that opinion he should say if it does the job it set out to do?

For example - I never really liked the SIMS. But, in the brief time I spent with an early version I did see that it seemed to do what it set out to do (provide an artificial social environment and feeling of belonging for those who lacked it and wanted some mindless amusement?).

As for the Reviewer's "Kit" however... I liked that.
Maybe some people are missing that your review (as i read it anyway) was on the 'Kit' and not the game?
I applaud you for showing the general public (who may not be otherwise aware) the sort of smoke and mirrors tricks used within the industry to attempt to garner positive reviews.
"Ohhh...I got a FREE Key Ring...GT5 = 9/10!"
Kits like this, and "Press Packs" are a blight.

I would like to see you continue with the "Reviewer's Kit exposed" type article. I bet a few developers / publishers would be left squirming if you did THAT honestly. Still, Atomic might have trouble getting games to review too...
Comments have been disabled on this article.
 
Atomic Magazine

Issue: 137 | June, 2012

Atomic is a magazine aimed squarely at computer enthusiasts, gamers, and serious PC upgraders.

Every month we bring you the latest reviews of new technology and PC components, in depth features on everything from overclocking to console hacking, and gaming previews and interviews.
 
Latest Comments
 
Latest User Reviews
Battlefield 3 is the new benchmark online FPS
90%
A very fun and realistic multiplayer ride.
 
Antec Kuhler 920 - liquid cool
90%
Antec Kuhler 920 silent but effientive out of the box no maintence water cooling kit
 
Antec's Lanboy Air - our new favourite case
90%
Antec Lan boy Air in red a very cool design
 
Antec's Lanboy Air - our new favourite case
90%
This product overall is awesome.
 
MSI's GT780 laptop as fast as it gets
90%
Nice laptop