Announcing: Slashdot Deals - Explore geek apps, games, gadgets and more. (what is this?)

Thank you!

We are sorry to see you leave - Beta is different and we value the time you took to try it out. Before you decide to go, please take a look at some value-adds for Beta and learn more about it. Thank you for reading Slashdot, and for making the site better!

Defying Review Aggregation

Zonk posted about 9 years ago | from the don't-put-me-in-a-box dept.

The Media 53

Logiksan writes "With the growing number of review aggregation sites like GameRankings and RottenTomatoes, it's becoming increasingly harder for individual game critics to be heard. GameDAILY Biz took a stab at the issue at came up with 5 aggregation-defiant tactics designed to help make reviews relevant again. Among their list of ideas is to destroy the typical review grading curve. The article states, 'If, for instance, a publication could establish a 10 point scale in which reviews were based upon purchase value and average games scored only a 3 or a 4, the higher scores would certainly become far more important. The lower scores would give the publication instant credibility as 'discerning gamers' and would free up the top scores (5-10) to show a more full range of differentiation for the top-tier titles gamers care about most.'"

Sorry! There are no comments related to the filter you selected.

5 individuals?... (1)

Bin_jammin (684517) | about 9 years ago | (#14544195)

these guys ought to work together!

why? (2, Insightful)

free space (13714) | about 9 years ago | (#14544197)

If I make good reviews, and they get aggregated with other reviews, why is this a bad thing that has to be 'defied'?
Isn't the aggregation service something the readers persumably want?

And why assume that the reader will only look at the score from your review? perhaps the reader is actually interested in the detailed information you provide and click on a link to your site from the aggregation site? And then the aggregation site will actually benfit the reviewer, not go against him.

Re:why? (1)

Bin_jammin (684517) | about 9 years ago | (#14544349)

I'll tell you why, and not because I'm a gamer fan, or a fan of anything specificly mentioned in the article, or your response. Aggregators creat clones. Period. I don't use RSS, I don't digg, or any of that crap. I read Slashdot, yeah, and there are times when it sucks, but that's hardly all I read during the course of my day, several sites, news channels, and newspapers, along with magazines or anything else I can get my hands on. Aggregators serve to add more bodies standing in the long line of morons all spewing the same crap at me all day long because they won't take the time to inform themselves or arm themselves with more or different knowledge than the idiot standing before them or behind them in line.

Aggregators work fantastically well for all the people looking to be the first one of their friends on the know with knew slang, or buzzword. The first guy to use Peruvian thunder tree coffee instead of Guatamalan magic stool moistening coffee, because it's softer both on the digestive system and on the environment. They get home, and can't wait to find out what else everyone's going to be doing soon. I'm sure digg and all the others will succeed beyond anyone's wildest dreams, if nothing else than at creating a world gone beige.

Re:why? (1)

free space (13714) | about 9 years ago | (#14544660)

I feel your pain. Humans in general don't like thinking, and prefer to replace it with the repetition/amplification of pre-canned thoughts. This has led to a lot of 'idea factories' ranging from political parties to aggregators, as you mentioned.

But still. Stuff like slashdot and digg aren't all repeated crap, often you find genuinely interesting opinions from genuinely interesting people, and then it's worth wading through the other cliche's and buzzwords.

Back to the topic, a game review agrregator would actually work for a good reviewer, not against him, even by making more people know that reviewer X exists. And if he really does stand up from the crowd, he will be a neat red line within standing from all the grey areas around him.

Re:why? (1)

Bin_jammin (684517) | about 9 years ago | (#14545795)

Yes, I think we can both agree to just stay on topic. :)

Re:why? (1)

cornface (900179) | about 9 years ago | (#14546090)

For all your rugged non-clone individualism and intellectual superiority, there are thousands and thousands of others exactly like you.

Sad, but true.

There is no "them." Only "us."

Re:why? (1)

Bin_jammin (684517) | about 9 years ago | (#14546617)

oh, believe me, there are very few like me. Come hang out sometime, you'll see what I mean. On that note, I'm sure there probably are some, but I'd much rather be like the very few like me, than the horde of others like everyone else.

Re:why? (1)

cornface (900179) | about 9 years ago | (#14548455)

With 6,000,0000,0000 people currently living on this planet, "very few" is a relative term.

Just saying.

Re:why? (2, Interesting)

Daetrin (576516) | about 9 years ago | (#14545174)

And why assume that the reader will only look at the score from your review? perhaps the reader is actually interested in the detailed information you provide and click on a link to your site from the aggregation site? And then the aggregation site will actually benfit the reviewer, not go against him.

When i'm thinking about going to a somewhat iffy movie i'll check out RottenTomatoes and see what aggregate score it got. Then i'll look over the blurbs, keeping an eye out for any reviewers i tend to agree with. And if the movie has a generally negative rating i'll check out the negative reviews to see _why_ they didn't like it.

For example i was trying to decide whether to go see Underworld Evolution, at the time i checked RottenTomatoes there were only a couple reviews up and almost all rotten. However i noticed the following blurb: "Stylish, but doesn't really re-imagine the vampire genre, cluttering the screen with creatures that no longer shock or surprise us. It's also a bit too long to pack a mean punch."

Okay, i liked the first cause it had lots of werewolves and vampires beating up on each other and a cute girl wearing cool outfits, and i actually like longer movies. So the review was negative but for reasons that completly didn't apply to me, in fact the only part that really interested me was the one positive comment, that it was "stylish." So i went and saw it and was happy with the results. It was a fun werewolves and vampires beat up on each other movie with a cute girl in it.

Presumably if game reviewers write well thought out reviews that explain _why_ they liked or disliked a game then the same process will happen there once the situation settles down. People will look at the aggregate scores, but they'll also look at what their favorite viewers have to say and they'll look at why the negative reviewers didn't like it. Some people complained about Shadow of the Collossus being too short, but given that i don't have as much time as i like to play video games that's not really a huge concern to me. I go the game, enjoyed beating up the first four or so Colossi (while feeling sorry for them at the same time of course) and then got distracted with other games i got for christmas. Clearly that particular criticisim wasn't relevant to me but knowing what the criticism was was important.

Re:why? (1)

KDR_11k (778916) | about 9 years ago | (#14548071)

I have to strongly agree, the aggregate score only tells me whether this game is worth researching, something with 20% average rating isn't even worth reading a review for (except maybe for any jokes the reviewer makes at the game's expense). If the score suggests that the game may be worth it I start reading individual reviews and form my final decision.

Re:why? (0)

Anonymous Coward | about 9 years ago | (#14545597)

Precisely what I've done. I still look at the aggregators each time, to get bird's eye view that helps weed out the really pathetic games, but before seriously considering buying a game, I'll visit Gamespot, who seem to mirror my taste in games in their reviews.

Corruption (0)

Anonymous Coward | about 9 years ago | (#14544227)

I would rather see "5 payola-defiant tactics designed to help make reviews relevant again". Maybe if so many game review sites weren't sucking at the game publishers' tits aggregation wouldn't matter...

Aggregation not the problem (4, Insightful)

yotto (590067) | about 9 years ago | (#14544251)

I don't read game reviews any more, but not because of access to aggregation sites. I don't read them any more because they are generally paid ads for the game or fanboys who just go on and on about how great it is that Joanna Dark's boobs are made from so many polygons.

Re:Aggregation not the problem (2, Interesting)

SgtFajita (911635) | about 9 years ago | (#14544876)

Yeah, game reviews are quickly becoming irrelevant to quality. It's to the point where most gamers consider an aggregate score lower than 8/10 to be a "bad game." In their defense, it seems most reviews consider 5/10 to be their minimum score. So a 7/10 is only average, which (like other mass media) is pretty much crap.

I'd be interested in a website with reviews that only focus on the bad parts of the game. Advertisers, demos, and promotions be damned: list off the major problems, along with the little annoying things that can detract from enjoying the game fully, and I'll have a much better idea whether I should bother to play it. The good stuff is covered by pretty much every other site, so tell me about the lack of control, horrible camera, unintuitive menu, or repetitive gameplay so I don't waste my money/time playing it if any of those problems are dealbreakers for me.

Re:Aggregation not the problem (1)

mwvdlee (775178) | about 9 years ago | (#14547010)

That's why aggegation sites are great; just rate a few games you own, then compare your own scores to the scores given on an aggregation site and find out which, if any, of the individual review sites matches your preferences best.

I guess that's why some publishers are against aggregation sites; it helps consumers pick the highest quality reviews, not the reviews backed by the biggest marketing budget.

Hrm... (1)

Onuma (947856) | about 9 years ago | (#14544279)

Making the average score lower, but still out of 10 shouldn't make much of a difference. What if magazines/reviewers just decided to increase their maximum score without upping the aggregate average? ...but this volume goes to 11, see?

Re:Hrm... (1)

pureevilmatt (711216) | about 9 years ago | (#14546136)

Another idea is to rate it out of 10... but don't allow for selecting the average score or intermediates. For example, rate on a scale of 1 to 10, but don't allow the selection of 7 or decimals. That way, when a truely average(7/10) game comes along, the reviewer must rate it and decide if it deserves that lowly 6 or that lofty 8. It's often a difficult decision.

Re:Hrm... (1)

adrianbaugh (696007) | about 9 years ago | (#14549422)

I never quite got why "average" games deserve 7/10 (except for kickbacks from the industry...) Surely a bog-standard average game should get 5, a totally awful one should edge towards 0 and a magnificant one should edge towards 10 - currently the low numbers are under-used, and the ones at the top end (8 and 9 especially) provide insufficient room for reviewers to differentiate.
Then again, perhaps trying to judge whether a game is worth 8 or 9 is pointless anyway and reviewers should stick to thumbs up, thumbs down or couldn't care less.

Re:Hrm... (0)

Anonymous Coward | about 9 years ago | (#14547779)

What if magazines/reviewers just decided to increase their maximum score without upping the aggregate average? The aggregate sites take whatever score you give them (3 out of 5, or 8 out of 11, or 178 out of 914) and convert that to whatever they want (0% - 100% for GameRankings, 0 - 100 for MetaCritic, and 0%-59% VS 60%-100% for RottenTomatoes). So it doesn't matter what the score you give them is out of, all that matters is how it converts to their internal format. Thus scoring things out of 11 does nothing, while scoring things out of 10 (but having an 11 for special games) is roughly equivalent to making the average score lower.

From a former zine game editor.... (4, Informative)

MBraynard (653724) | about 9 years ago | (#14544290)

A lot of the smaller guys have trouble being heard - or ever heard of. The aggregator includes your zine's reviews with all the big boys. GameRankings is a big opportunity for free advertising.

If you do a good job, readers may check out your review for a particular game (some people read all reviews) and decide to go directly to you from then on.

Gamerankings is also great because they allow their readers to also rate the reviews themselves. So if you are a good writer, your reviews will stand above the mediocre ones when people look for reviews on a particular game.

Maybe Gamedaily got tired of seeing so many of it's reviews receive one star or less?

If I was really interested in starting a new zine from scratch, I would LOVE to get my reviews into the aggregator, try to accumulate high rankings for my reviews, and the traffic would increase and so would the willingness of devs to send me demo copies and put my quotes on their game boxes and I would also be able to get more advert revenue. It's a win-win-win all around.

Is this a problem? (3, Interesting)

BertieBaggio (944287) | about 9 years ago | (#14544456)

Now, I used to read reviews in magazines. I even had a subscription to Edge for a while, and used to like the longer reviews (the pieces on San Andreas from there and other mags come to mind). But now I tend to rely more on peer reviews - and by that I mean people I actually know. Combine that with selectively trying demos and I reckon I have a system that does pretty well (for me anyway).

Of course, if I see a game discussed in depth on the world wide webby and with a great community, I will more than likely give it a shot. Notable games from this category are x/netrek; nethack; and HardWar, to name but 3.

So who is suffering? Well, [formerly?] well-paid magazine or ezine professional game reviewers. And yes, that is a shame to some extent. I do enjoy reading the long reviews -- I appreciate when someone puts an effort in -- but I would rather spend the subscription money elsewhere, say on a new graphics card to take advantage of these great games I should be reading reviews of.

So how do you recapture my (and everyone else's) attention? From TFA:

Ditch The Scores - Makes the review stand on the merit of its content. Good idea - as long as the content is good.

Focus on MegaReviews - Yup. El Goog prvoed that more is less; so write less reviews, but make them longer.

Trumpet Your Own Credibility - Personality can be interesting, but a fine line lies between 'trumpeting credibility' and 'arrogant gits that I won't be rading again'.

Aggregate Reviews on Your Own - Can't beat them, so join them? Might work.

Crunch The Curve - If people are looking for a quick point score, they are looking for something that conforms to their expectations. Giving lower scores will ultimately damage credibility and turn off readers, even if your intentions are noble. Here's a better idea - lose the scores altogether. Give people a well-written indepth review. The ones that are looking for a point score won't read if you give it 4/10 as opposed to 7/10 anyway.

my .02

Re:Is this a problem? (1)

Sathias (884801) | about 9 years ago | (#14546652)

If you ask me the whole premise of the article is the 3rd point, "Trumpet your Credibility". It seems to be based on the assumption that the reviewers opinion is much more important than any of the other reviews being aggregated.

Personally, I would prefer to get an overall picture of whether a group of reviewers liked a product rather than the individual opinion of a reviewer who may or may not be carried away with his own sense of hubris. I may not hold the same opinion on the subject of the review as him, just like I may not hold the same opinion on the reviewer.

Re:Is this a problem? (1)

bateleur (814657) | about 9 years ago | (#14548092)

The ones that are looking for a point score won't read if you give it 4/10 as opposed to 7/10 anyway.

Not true. I like to read the highest and lowest scores for anything I'm going to buy because these reviews between them will give me the clearest picture of the pros and cons.

I recommend this approach, by the way. Works well if you don't have time to read every review of everything.

Re:Is this a problem? (1)

pla (258480) | about 9 years ago | (#14548444)

"Ditch The Scores" - Baby, bathwater.

"Focus on MegaReviews" - If I read two or three reviews per movie I actually go see, and the review takes me half as long to read as I would have wasted just going to see the movie, then I may as well just go see the movie and skip the reviews.

"Trumpet Your Own Credibility" - Because we all know that nothing impresses us more than hearing someone brag...

"Aggregate Reviews on Your Own" - Hey, no fair, you guys suck so we'll do the same thing!

"Crunch The Curve" - and we end up back to point #1.

Overall, I find it increasingly annoying when "content creators" complain about the likes of Google, or "themed" linkers such as Slashdot or Rotten or Fark, or even sites that merely summarize numbers from other sites (as long as they give credit).

All the "creators" get visitors BECAUSE of those aggregators. The aggregators don't "steal" the content, and while they may indirectly profit from it, the creators would do nothing but bleed money to their IT overhead costs if sites like Google didn't take us there.

Now, some big-name sites (like the NYT) may actually have some right to complain, but even then, if I find a headline that interests me through Google News, I'll follow it, and the NYT can happily collect my fake registration info, same as if I went directly to their site. Of course, they don't like the fact that my visiting depends on them having something to interest me, rather than needing to visit before I can make that determination.

Finally! (3, Interesting)

Tom (822) | about 9 years ago | (#14544536)

Been about time. When I stopped regularily reading gaming mags 5 or so years ago, 70% (or 7/10 or whatever the scale was) was a pretty mediocre result, and it's only got worse. The same magazines that once celebrated the first ever game to score over 90%, ever - are now giving out 90% every month or so.

It's all marketing pressure. 100% does not mean "perfect" anymore. Problems that would've dumped the score 5, 10 points are shrugged off by many testers as "will certainly be fixed by the next patch" or "but it's still better than elsewhere".

There is one online review page that still writes very criticial and sometimes harsh reviews, where the stuff that rates 94% in your average mag (which only by coincidence has a two-page ad by the same company that month...) - well, that overhyped crap gets its 47% or whatever it's really worth once you remove the "big names" and the photoshopped screenshots.

I just wish for the life of me I could remember the URL. I lost my bookmarks once, and that was the only game review site worth having a link.

I also remember what some of those tester dudes said when flat out confronted with the fact that they only ever seem to review 70%+ games. They said "we don't want to waste precious magazine space with the mediocre games".
Sounds believeable. Except that the rations are still way overblown. I like "The Movies", for example, but it's not a 9/10 game. Civ4 - great game, but 9.7/10? If you can only imagine 3% missing to absolute perfection then you have damn little imagination. And so on, and so forth.

Really, an honest rating should either allow > 100%, or say "90% if you do everything in the best way that I can imagine. Points above that only if you found better ways to do it, and because you had a few years to work on it that's not an unrealistic expectation".

Re:Finally! (1)

Tom (822) | about 9 years ago | (#14544683)

Actually, it seems the aggregate sites are worth something. Looking for what side scored a few games very low I'd also consider failures but which were hyped anyways, I stumbled upon:


Re:Finally! (2, Interesting)

Red Flayer (890720) | about 9 years ago | (#14546561)

"Really, an honest rating should either allow > 100%, or say "90% if you do everything in the best way that I can imagine. Points above that only if you found better ways to do it, and because you had a few years to work on it that's not an unrealistic expectation"."

This is where game reviewers could learn something from an established idustry that faced the same problem decades ago -- fine wines.

Robert Parker and other wine critics theoretically can assign values up to 100. But a 98 is a once-in-a-lifetime wine. A 90 is excellent (truly excellent). An 80 is fair.

Sure, most wines you'll see in the store are 85 pts & higher, but Joe BasementCask's '04 grenache isn't making it to market -- only the good, commercial stuff is.

But you know what? My wife wouldn't like a 92-pt cab, no matter how good everyone else thinks it is. Just like some people won't like CivIV, no matter how closely it approaches the ideal for that type of game.

My main point is, games should be reviewed on a bell curve -- like you say, scoring above 90 should be VERY difficult. And people need to understand that just because everyone who likes FPSs rated a game 9.2, doesn't mean they'll like the game that much, if they only play RTS games.

why the need for a numerical rating? (2, Insightful)

usrusr (654450) | about 9 years ago | (#14544555)

while the suggestion to increase the actually used "dynamic range" of the scoring system used is certainly a step into the right direction, why does he stick to the an overall numerical rating system at all?

i could imagine very good reviews that would group the usual categories into pairs of that are contradicting each other or at least are quite opposite to each other, like "this game focuses on replayability" vs "this game focuses on an intense story", "focuses on technical aspects" vs "focuses on other qualities", or just distribute a _fixed_ number of points on the various categories, to describe the game, give it a rough position in an n-dimensional matrix, not rate it.

a serious review should never pretend to be able give ratings with more precision than something along the lines of "you will love it"/"you will like it"/"you might enjoy it"/"pain" (all assuming you generally enjoy the genre).

"game x is 3.5% better than game y" is pure bullshit and a sure sign of a review that is actually nothing more than comparing technical specs and skipping through the game with cheat codes to provide some screenshots.

and yeah, pissing off game publishers with honest ratings is a really bad idea in a business that mostly depends on hyping up "exclusive" previews to lure customers.

the threat of losing "early screenshot" benefits is probably an even bigger threat than the whole dependency on ad money from publishers, not only because it looks less like bribery but also because customers lost due to lack of exciting "next gen" cover stories will affect the ad-income from all companies, not only the one in question.

Re:why the need for a numerical rating? (1)

usrusr (654450) | about 9 years ago | (#14544652)

to conclude: reviews can only really be reliable if they are either from a noncommercial source (but beware of fanboyism) or if they are from a more general source that does not primarily focus on games.

(ps: how many weeks would it take to give a meaningful judgement about a game like civ4 for example? imagine the sales of a game mag that would make a civ4 cover story 4 weeks after the release of the game...)

Re:why the need for a numerical rating? (1)

SgtFajita (911635) | about 9 years ago | (#14545150)

and yeah, pissing off game publishers with honest ratings is a really bad idea in a business that mostly depends on hyping up "exclusive" previews to lure customers.

Giving a crappy game high ratings to appease the publisher hurts your reputation among gamers. That means less visitors, ad clicks, presence, and relevancy. Game reviewers exist to provide a service to gamers interested in purchasing games, not publishers wishing to sell them.

reviews can only really be reliable if they are either from a noncommercial source (but beware of fanboyism) or if they are from a more general source that does not primarily focus on games.

The Associated Press runs game reviews occasionally, and they are absolutely worthless. When the reviewer isn't familiar with the genre and doesn't play games regularly they have no idea what to look for to discern quality from crap. A simplistic game with flashy graphics can be the best game ever to them; while the same game with significant development of character skills and stats will seem confusing and tedious.

Re:why the need for a numerical rating? (1)

usrusr (654450) | about 9 years ago | (#14552187)

Giving a crappy game high ratings to appease the publisher hurts your reputation among gamers. That means less visitors, ad clicks, presence, and relevancy. Game reviewers exist to provide a service to gamers interested in purchasing games, not publishers wishing to sell them.

but do you see that happen? of course there are games that get lower ratings than others, but those are games where the publisher probably would not expect a score reminiscent of hl2 themselves. as long as you "vote with the crowd" (your reviewer peers at other game mags) the fact that the publishers need the game mags as much as the game mags need the publisher works in favor of the reviewer, but as soon as he dares to give a significantly lower rating than the others he might damage "good relations" and suffer from lessened likelyhood of getting invited to on-site previews, rejected interview requests and stuff like that.

And that's how it is, most pages in game mags are filled with hyped up previews, because the games of tomorrow are always much more exciting to the reader than the games of today (or than the same games once they hit the cold floor of reality)

Re:why the need for a numerical rating? (1)

Tom (822) | about 9 years ago | (#14544657)

why does he stick to the an overall numerical rating system at all?

Because game magazines aren't there to educate their readers. Their purpose is to sort game producers by advertisement money spent and then arrange their games in a simple list of "most worth buying" to "tell them to buy more ads next time".

Way off the mark (1)

Intellectual Elitist (706889) | about 9 years ago | (#14544618)

Who is the author's target audience? The sort of people who are going to make a purchasing decision based solely on the weighted average of an aggregator without reading any of the linked reviews? Obviously not. The people who use an aggregator but do read a cross-section of the linked reviews to get context and multiple points of view? Not them, either.

So who's left? People who don't use an aggregator in the first place. And what's he imploring them to do? Not use an aggregator. Seems kind of pointless, doesn't it...?

Besides, I think aggregators are great. Especially well-stewarded ones like Metacritic [metacritic.com] (which was strangely dropped from the submission text while the other two aggregators weren't). With intelligently weighted averages you get a useful snapshot of opinion, plus the option to check out as many individual reviews as you like to get a fuller picture. I've bought a number of games that had mediocre averages because the text of the linked reviews made it clear that they were something I'd appreciate, just as I've avoided a number of games with high averages where the text of the reviews made it clear that they wouldn't be suited to my taste.

And yes, having your site included in an aggregator's round-up can only be a good thing -- it'll grant immediate exposure to your work and let readers decide for themselves how much clout to give your reviews vs. the weighted average in the future. This stands out even more when you review more obscure titles that don't get covered by all the big outlets, so you become one of a much smaller group of reviews.

I say aggregators are win-win for both readers and review sites.

Re:Way off the mark (1)

superpulpsicle (533373) | about 9 years ago | (#14545727)

Look at Gamespot, the page is flooded with 8 layers of advertisements. Gamerankings has ads, but it is still orderly and not flash flooded. Sometimes the best comments are those from ebworld and amazon where the consumer happens to discover something negative 6 weeks into owning a game. Now that is helpful.

Game Reviews: Obsolete? (2, Interesting)

Sage Gaspar (688563) | about 9 years ago | (#14544815)

I think reviews, themselves, are becoming outmoded. I can go to a message board and get opinions from hundreds of other players that I know share similar interests with me. They know what I'm going to care about in a video game more than some random shlomo.

Video game magazines tend to be targeted at a different audience than me, and I'm not entirely sure what that audience is: maybe younger gamers, or those who aren't quite as involved. You get the opinions of one or two people, max, and possibly short scores from a handful of others that I don't know from Fatal1ty (Adam for the less hardk0re :P).

Finally, before I plunk down money on a game I try the demo. Even a lot of console games now have computer versions with demos. They might lag behind, but I usually stay a year or two behind the console trend because the pricing on their games are ridiculous (some computer games are guilty of this as well, but they tend to be more reasonable).

Plugging (0)

Anonymous Coward | about 9 years ago | (#14544856)

There are numerous review sites that are mad efor independant reviewers. A few include: http://gamefaqs.com/ [gamefaqs.com] GameFAQs, and my personal website http://coreoblivion.gamersmack.com/ [gamersmack.com] The Core: Oblivion (pardon the plug)

Voting, anyone? (1)

Eli Gottlieb (917758) | about 9 years ago | (#14544990)

Why not just allow anyone to write reviews and give game scores? Then the readers moderate the reviews, and can set threshholds of what sort of modded reviews they want to see.

What's that? Trying this good idea from the rest of the world would put professional game reviewers out of business? Well then they should change their business model, perhaps move into those game-reviewing websites which'll likely have pretty decent ad revenues, or possibly a charge for membership.

Has this been done elsewhere or should I get started?

Re:Voting, anyone? (1)

generic-man (33649) | about 9 years ago | (#14545340)

I want to read a review from a guy who's reviewed 200 games before and who can be convincingly objective to me. I don't want to see a bunch of 10/10 reviews from fanboys who think that the game is completely misunderstood by the Mass Media, and I don't want to see a bunch of 1/10 reviews from people who will condemn a game they hate based on a Penny Arcade strip that made fun of it.

Take a look at amazon.com, gamefaqs.com, and ebgames.com to see how awful the result is when you let everyone review a game regardless of they've even bought it (or whether it's been released).

Re:Voting, anyone? (1)

Eli Gottlieb (917758) | about 9 years ago | (#14545482)

Funny, because at least Amazon should be able to know if you've bought the game from them.

So a decent review site has to have somebody who can be the Aloof Objective Guy. Funny, but on Slashdot these are called the editors and everyone hates them. So why not just have both things? A special section or moderation rating (ie: a separate scale entirely) would be given to Real Objective Reviewers and you'd go to another section if you wanted the People's Reviews.

Re:Voting, anyone? (1)

generic-man (33649) | about 9 years ago | (#14545561)

Gamespot does that. They provide an editorial rating and then let readers rate the game separately. The "objective guy" rating can differ significantly from the "people's review" average. Here's one game [gamespot.com] that got a mediocre review (5.0) for being "too self-referential" about the anime series on which it's based; not surprisingly, the People rated it significantly higher (7.6). Gamespot also provides links to other review sites, whose reviews average out to be between the two (6.6).

Now because this is Slashdot, I'm sure I need to be beaten with the cluestick because Gamespot is a corporation which obviously caters to its advertisers, but I'd rather swallow corporate publications than fanboy spin.

Re:Voting, anyone? (1)

cornface (900179) | about 9 years ago | (#14546019)

I like the Gamespot system, as well.

I also don't usually read the reviews on websites, which apparently angers the people who write them. Waaah. It's easier to read Game Informer while I'm taking care of umm...non-gaming "business."

Bizarre. (2, Interesting)

Retroneous (879615) | about 9 years ago | (#14545372)

My site relaunches on Friday 27th and we decided to "drop the scores" a couple of months ago.

They're pointless in the current climate. Personally, I decided to take this route because I was sick of seeing referral traffic from forums where folks had come along to the site, read the score (not the review text) and then promptly headed back to their favourite forum to trash us.

"Why did he give that 9/10? It sucks! Its not as good as !" etc., etc.

The alternative? Just give them the review. Then they don't have to ask WHY a reviewer who's spent a good while playing a game and a good while writing about it has given the score that he has, just because they're too damn lazy to read the review text. We have a short summing-up at the end of the review, so folks can read that if they really are adverse to checking out the rest of it.

All I know, is that if I've personally taken time out to visit a website to check out a review, I'm going to READ it. Not everyone is like that. Some folks do just want a number in place of valid reasoning and qualification of the opinion in question. Good luck to them. I guess they're the guys that return things to stores because they "didn't do what they expected."

Or the guys that stood in front of a 4ft tall black-on-white sign pasted on my local game store's window that said "We have 4 Xbox 360's and they are all reserved for preorders." on launch day, for three hours. Before walking up to the cashier when the doors opened and saying "Do you have any spare Xbox 360's? I didn't manage to preorder one. No? Are you sure? There are none left? Can you check?"

My personal fave... (0)

Anonymous Coward | about 9 years ago | (#14545641)

is gamerevolution.com
Relatively good games get a B+ or A- on their list. The rest get C's, D's, and more importantly, a hilarious review of just how bad the game really is.

Won't matter (1)

CaseM (746707) | about 9 years ago | (#14546026)

Gamerankings already changes a review's score to work on a 0-100 scale. If they know that an "average" score for a site's reviews is a 3-4 and that compares to a "7" on other sites, they'll just mark them down as a 7.

Besides, the whole thing smells of sour grapes to begin with.

Alternate scoiring system (1)

Alien54 (180860) | about 9 years ago | (#14546404)

The article states, 'If, for instance, a publication could establish a 10 point scale in which reviews were based upon purchase value and average games scored only a 3 or a 4, the higher scores would certainly become far more important. The lower scores would give the publication instant credibility as 'discerning gamers' and would free up the top scores (5-10) to show a more full range of differentiation for the top-tier titles gamers care about most.'"

This is easily accomplished doing something instead of averaging scores for different elements of game play. You work instead by multiplying them together. A came that score three perfect tens ends up with 1000 in this system, while 3 sevens gives you 343 for a score, and 3 eights gives you a score of 512. In a 4 star system, 5 scores of 4 give you 1024, while 5 scores of three stars gives you 243 as total. 5 score of 3.5 stars gives you 525 and change.

I have two stops for reviews (1)

toddhunter (659837) | about 9 years ago | (#14546447)

http://www.gamefaqs.com/ [gamefaqs.com] and http://www.gametrailers.com/ [gametrailers.com] .

The point for me is that the score doesn't matter one little bit. What is important is *why* they gave it that score and/or why they didn't.
For example the reviewer might mark a game down because it was too hard. For me that would be a plus. They might say it is fun but too short, which also might appeal to me at certain times.
What is also important for me is to see some actual gameplay. I can often pick up more about a game from a 2 minute video review than a 10 page article. When you can see things like camera, frame rate and so on it really helps you get a handle on what you are in for.

Here's a suggestion (1)

Sockatume (732728) | about 9 years ago | (#14547073)

Write reviews which are more than just a description of the game with some suitable adjectives and a score attached. "Amazing level design, great graphics, 10/10" and "Horrible level design, losy graphics, 1/10" aren't really interesting to read.

What's wrong with aggregators? (1)

Aim Here (765712) | about 9 years ago | (#14547367)

Sounds to me like the games industry is bitching because they make it that less effective and more expensive to bribe up a handful of review scores using advertising revenue or whatever.

Hasn't Edge magazine been doing this for years? (1)

deletedaccount (835797) | about 9 years ago | (#14547416)

Edge magazine regularly give out 5's for average games and only give out a ten once every year or two. Perhaps it's not on the reviewers radar because it's a UK publication. http://www.edge-online.co.uk/archives/edge/index.p hp [edge-online.co.uk]

Just get rid of review scores altogether (1)

vrai (521708) | about 9 years ago | (#14547595)

If the people writing these reviews possessed any modicum of ability they wouldn't need to use numerical scores. A well written review should tell you everything you need to know about the game that is required to make a purchasing decision. All too often the content of the review and the score that accompanies it have nothing in common; the scores seem to be nothing but an over inflated fop to advertisers.

Take one of the few quality gaming magazines that still exists, say Edge, and compare it to an internet review site, say GamePro. Edge's reviews are well written, interesting and provided a good overview of the game's quality; the score is almost irrelevant. GamePro's "Fun Factor" is utterly arbitrary, biased towards the upper end of the scale and given pride of place on the page. Meanwhile their reviews are lacking in detail and obsess over utterly unimportant details.

A will happily base purchasing decisions on an Edge review; all GamePro reviews tell me is that their reviewers should find another job.

Suggestions? (1)

mobby_6kl (668092) | about 9 years ago | (#14547782)

I was thinking about writing game (and maybe other) reviews for my newly created site, and one of my ideas was to either ditch the score system completely, or make it very simple, almost binary. Assigning 0/1 didn't seem fair though, why should a game which barely redeems itself get the same score as a GOTY-class title? Right now I think giving out average/recommended/highly recommended/second coming of Christ ratings would give a clear idea of what my feelings were, without getting into the whole "give this game .5 more because i say so!" thing.

Now another thing is the length of the reviews. Short but to the point? Lengthy but deep? I'm-Neal-Stephenson-length essays with interesting, but not completely relevant bits thrown in? I'm not sure, but that's ok because I'm not writing the reviews right now. In fact, I should be studying for the two finals I have tomorrow and the day after that. I'll probably start with writing shorter reviews for the games I've played a while ago, expanding them when (if) I replay them. For newer games I could probably write longer stuff while all the experience is fresh in my memory.
What do you guys think?

Game Reviews (1)

MrCopilot (871878) | about 9 years ago | (#14547803)

/donning Flameretardant

I personally like a video review and I get most of mine from X-Play on G4. I know they are whores but they are honest whores. Nothing captures the essence of ultimate spiderman like the world's rudest Stan Lee impersonator. More importantly I can see the gameplay and Sessler is really fond of demonstrating why a game sucks showing you the terrible camera or ai or whatever. Plus Morgan is pleasing to look at if not listen to.

I also get a few mags like gamepro and I read every review, but I rarely find one that stands up to an established publisher with cash.

provide original thought provoking or funny conten (1)

Rowan_u (859287) | about 9 years ago | (#14548708)

I work for a progressive review site called http://www.thegamechair.com/ [thegamechair.com] and would like to mention a couple points. First, we would love to be included on some of the major content aggregators. The major aggregator's sites function something like a Google search for reviews with the handy addition of a mathematical formula for determining the average score. I feel like they drive out far more traffic out to individual sites than they steal from them. I know for a fact that I regularly read 5-10 reviews of a game or film, using the links on metacritic as a starting point.

Also, I'd like to mention our approach at TheGameChair, which involves a little bit of everything. We've kept the scoring as an integral part of our review process, but we've broken up the reviews into pieces that more accurately reflects the way that we play games. Basically, we divide the amount of playtime required to make it through a game into three chunks, and write a separate review for each chunk of play. The scores can vary based on whether a particular section of the game plays better, or can be affected as tedium or boredom sets in. The entire length of the review process stretches out over a three week period; covering the average length of time it takes an ordinary person to complete a game.

Our final score for a game is based on an average over the three separate play session, so we do have a type of aggregation over a time frame built into the review. However, because of the sheer volume of review sites on the web, and the amazing speed at which the reviews are released, the only way to distinguish yourself from the aggregate crowd is to actually provide original, thought provoking or even funny content.
Check for New Comments
Slashdot Login

Need an Account?

Forgot your password?