Add StarCraft II to the list of increasingly sophisticated games at which well-trained AIs can smash fallible, meat-fingered humans to chunky bits. Googleâs DeepMind AI beat two professional players of Blizzardâs StarCraftin two multi-game series that happened in December, the companies jointly announced today.
The AI, which the DeepMind team has named âAlphaStar,â beat Team Liquidâs Grzegorz âMaNaâ Komincz and Dario âTLOâ WĂŒnsch five games to nothing in two separate five-game series.
During a stream showing off the results of those games today, WĂŒnsch said heâd seen some footage of AlphaStar playing, and even though he was gonna be using his off-race, Protoss, he felt âextremely confidentâ going in. However, he was quickly met with different barrages of unconventional strategies in each game, making it almost impossible for him to get into a rhythm and figure out how to read his foe.
Komincz, a Protoss expert, fell in similar fashion in his series, albeit against a version of the AI that had already learned from its games against WĂŒnsch, and as a result played with a more human-like cadence than before.
Turns out, the pros got whooped in part because they were actually up against five different âagents,â or AI competitors that were trained with their own learning objectives. So basically, it was like playing a different person each game. While the AI agentsâ foundation was a neural network based on replays of human StarCraft II matches, that initial agent was then split into a multitude of data-hungry-hungry hippos that played against each other in DeepMindâs âAlphaStar League.â Over the week that the âleagueâ ran, the various AlphaStar agents absorbed 200 of your human yearsâ worth of StarCraft II matches.
AlphaStar had other, stranger upper hands, as well, but not the ones you might expect. Youâd figure, for instance, that an AI would handily beat a human in terms of reaction time and actions-per-minute, a measure of how many clicks and key presses players perform every 60 seconds. But in fact, AlphaStarâs APM averaged out to 280, which the DeepMind team described as âsignificantly lower than the professional players.â Its delay between observation and action was 350 milliseconds on average, also lower than the pros.
AlphaStar also âseesâ StarCraft differently than human players, with an interface that basically functions as a top-down view of the whole map, rather than one that needs to be zoomed-in on at various points. But that apparently still led to human-like actions.
âHuman players must explicitly manage an âeconomy of attentionâ to decide where to focus the camera,â said the DeepMind team. âHowever, analysis of AlphaStarâs games suggests that it manages an implicit focus of attention. On average, agents âswitched contextâ about 30 times per minute,â the team wrote, which was similar to Kominczâs and WĂŒnschâs behaviors.
Ultimately, the DeepMind team concluded that AlphaStar won against both pros because of âsuperior macro and micro-strategic decision-making, rather than superior click-rate, faster reaction times, or the raw interface.â
During todayâs stream, Komincz actually managed to win a one-off exhibition match against AlphaStar, but it was a new version utilizing an entirely new interface based on the way humans interact with the in-game camera. Though the DeepMind team described it as âalmost as strong as the raw interface,â it had been trained for just seven days and hadnât faced any pros. Still, thatâs got to be a feather in Kominczâs cap at this point.
Playing against the AI, said Komincz, gave him a new perspective on a game he thought he understood inside and out. âI was impressed to see AlphaStar pull off advanced moves and different strategies across almost every game, using a very human style of gameplay I wouldnât have expected,â he said. âIâve realized how much my gameplay relies on forcing mistakes and being able to exploit human reactions, so this has put the game in a whole new light for me.â
