OpenAI Five Beats Humans In A Benchmark Test
Posted 8th August 2018 By: Derpina    214 Views
Esports News – The OpenAI Five, a group of artificial intelligence bots introduced by OpenAI, is set to compete in The International 8 (TI8) of Dota 2 championship series. As part of their preparation, they have undergone another “benchmark test”. The difference this time is the the introduction of semi-professional Dota 2 players ranked 99.95th percentile in the world.
OPENAI FIVE VS. HUMANS (2-1)
The bots displayed excellent performance during the warm-up games in front a large number of spectators. The achievement was a product of the bot’s hard training, requiring them to play 180 years worth of games against themselves every day using a scaled-up version of Proximal Policy Optimization (256 GPUs and 128,000 CPU cores).
After the warm-up games, the OpenAI Five was set to face Dota 2 professional players and casters, namely: Ben “Merlini” Wu, Ioannis “Fogged” Loucas, Austin “Capitalist” Walsh, and William “Blitz” Lee. In a three-game series, the bots earned an early lead by consistently winning two games. The format was slightly adjusted in the final round when the OpenAI team let the audience select their team of five heroes, handicapping their selection of future robot overlords. The result showed that the bots would only have a 2.9 percent chance of winning the last match.
The prediction for the handicapped match was correct. The human team consisting of Merlini, Fogged, Capitalist, and Blitz won the last match, concluding the series 2-1.
AN AI-DRIVEN FUTURE
The benchmark test has mixed results and reviews, clouding the people’s judgment about robots and humans’ capacity. But since the OpenAI Five won 2 of the matches, the ball is on their side of the court. Adding to this is David Farhi’s remarks, one of the researches of the OpenAI organization. He stated, “It still does seem that they have a much faster reaction when something shocking happens”, declaring that fast reflexes may be one advantage the bot has over human teams. Furthermore, Blitz also stated that he has faith in the robots, admitting: “I actually think it will beat the pro team”.
The ultimate goal of OpenAI is to improve their bots and beat a team of Dota 2 professionals at the TI8. But this is not a victory just for the tournament, the future results can prove what technology and artificial intelligence are really capable of.