Total War Developer's Approach to Metacritic May Be 'Brutal' But It Works

Illustration for article titled Total War Developer's Approach to Metacritic May Be 'Brutal' But It Works

In an interview with Gamasutra, Tim Heaton, the studio director of Total War developer Creative Assembly, described their development process as Metacritic-focused and "brutal."

Advertisement

As Creative Assembly works on a game, they'll do what Heaton refers to as "Metacritic analysis," breaking every feature down and looking at it from both the player's and reviewer's points of view before scoring each one on a 100 point scale. Features that aren't measuring up are cut.

It's easy to see this as just one more step towards the "Metacriticization" of game development—which, in a literal sense, it is. But then again, when I read the interview, it didn't strike me as some bloody-minded, creativity-killing approach but rather a healthy, if focused, cut-cut-cut mentality.

He adds, "And so if we see one flat line and it's not where we want it to be, we then will cut it. Well, we'll cut it really late in the day. I think teams are really scared about doing 90 percent of the work and then cutting it. It's kind of like, 'Well, it's nearly finished; I... I've done all the work! Please don't cut it! I'm sure I can make it better.' And we're fairly brutal on that."

Heaton says he would much rather reject a feature that the studio invested resources in, than have it left in the game and affecting its quality. "You know, every step of the way — from the beginning to the end — we're talking about a 90 percent Metacritic," the Creative Assembly director emphasizes. "That's our goal. That's what we tell Sega. And we communicate that through graphs, basically, of where we think we are."

That approach—be stringent in your assessment, and cut everything that doesn't meet your standards—actually sounds like a smart way to run and complete a project. And it seems to work—Empire: Total War and Total War: Shogun 2 both have a 90 on Metacritic, and Napoleon: Total War is in at 86.

More to the point, all of those games are really good. They're also humongous, loaded with systems and features, the exact sort of project that could really go off the rails without some judicious pruning.

The "brutal cutting" mentality is a healthy one to have when working on a project. Whether you're writing a novel or recording an album or putting on a stage production, often the solution to a given problem is to cut out the entire problematic bit, particularly when you're working with a deadline.

The issue then, may just be just that Heaton is using using Metacritic as a measuring stick. After all, this is a site that equally weighs reviews from some pretty funky outlets (and, ahem, doesn't include Kotaku at all).

Advertisement

Plenty of game developers have shared horror stories about withheld bonuses, insane crunch-hours, and generally hellish working conditions, many of which are undertaken in the pursuit of high Metacritic scores. Whether Metacritic is the cause of that or (more likely) simply a convenient measuring stick for profit-minded publishers, the site certainly does play its role in a fair amount of games industry dysfunction.

But I'm not sure that this specific approach—cutting lackluster features in pursuit of a 90—qualifies as dysfunctional. It would seem that when Heaton says "90 on Metacritic," he's saying, "Has functional, fun gameplay and systems that are polished to a high standard."

Advertisement

Cutting features in pursuit of that goal doesn't seem particularly brutal. It just seems like maintaining high standards.

How Creative Assembly's Process Breeds Quality [Gamasutra]

(Top photo | Ganko/Shutterstock)

DISCUSSION

DocSeuss
DocSeuss

"The issue then, may just be just that Heaton is using using Metacritic as a measuring stick. After all, this is a site that equally weighs reviews from some pretty funky outlets (and, ahem, doesn't include Kotaku at all)."

Kotaku doesn't use a scoring system.

"It would seem that when Heaton says "90 on Metacritic," he's saying, "Has functional, fun gameplay and systems that are polished to a high standard.""

In my experience, games with a 90+ on metacritic tend to be very good, barring most recent Bioware/Rockstar/Valve/Naughty Dog outings. I enjoy them, for the most part. 80s are games I enjoy, but have some degree of jankiness—worth playing, but generally not brand new. 70s are games I tend to be really polar on—games like STALKER and Tropico deserve their 70s for obscene amounts of bugs and lack of polish, but they transcend everything about that anyways. 60s and lower I've never enjoyed.

It's very much the ABCDF system of grading, I think.

That said, things get interesting when it comes to exclusives: Sony exclusives tend to get a slight (~5-10+ where they ought to be; evidence of this being reviews that said "I don't really like or care for Uncharted 3, but I'm giving it an 8 or 9 anyways") bump, as do Nintendo games (despite amazingly middling reception by most fans, Skyward Sword got a bunch of obscenely high reviews; Xenoblade is doing really well despite people I trust saying "it's not really anything special"). Reviwers tend to be hard-to-fair on Microsoft's games, with weird things like saying "Alan Wake is a bad survival horror game" (it's an action horror game, yo), or "Gears of War 3 is the best in the series, but we're arbitrarily giving it a lower score than Gears of War 2 anyways."

I'm not sure if Microsoft's reception is due to the outsider mentality people have always had towards it ("It's not Japanese and I didn't grow up with it!"), because of the stylized graphics Microsoft uses (Microsoft's games tend to have a more cartoony art direction than Sony's, leading some to mistakenly believe Sony's platform has better graphics), or because of the "lol it's only shooters" mentality, but yeah, people tend to be harsher on Microsoft games (did you know Viva Pinata is actually supremely excellent? Crackdown's awesome too!)

Third-party games are a bit interesting as well: Shinji Mikami, Hideo Kojima, and Final Fantasy games all tend to score about ten points too high when one makes a straight-up comparison between their games and other games.