President & Co-Founder @OpenAI
Joined July 2010
- Tweets 4,815
- Following 65
- Followers 497,251
- Likes 1,386
Dota is a convenient testbed for pushing the limits of general-purpose deep RL technology.
Here's a physical robotics problem we solved using the learning system we wrote for Dota: blog.openai.com/learning-dex…
2
4
1
32
Ok so not *everything* at the event was smooth. My apologies :)!
On the plus side, resulted in a pretty funny Reddit post — worth watching the clip until you figure out what's going on. Top post of /r/Dota2 yesterday! old.reddit.com/r/DotA2/comments/…
52
We now have an answer for how to solve even massively hard problems given a good enough simulator and enough compute. Before (see reactions after our losses at TI) there was doubt about how far these methods would go.
Next step is figuring out how to solve from less data.
2
5
1
69
Just ongoing development — e.g. we'd already created 1v1 code that could control a courier, and we just so we started with 5 copies to control 5 couriers.
2
3
We trained a single AI for the past 10 months, something we haven't seen before in reinforcement learning.
OpenAI Five at The International was 1.5 months old.
OpenAI Five at Finals was 10 months old.
*Huge* difference in performance. And the curves still haven't leveled off.
19
99
21
513
Been a crazy journey! 2 years ago, we started working on Dota because it felt totally impossible for existing AI methods — we wanted to invent a new algorithm. But we kept scaling up existing methods to test their limits — and we still haven't hit a wall!
OpenAI Five is now the first AI to beat the world champions in an esports game. Here's what happened, and how we made our comeback since losing to pros in Aug 2018: openai.com/blog/how-to-train…
10
29
2
251
My opening remarks from OpenAI Five Finals on Saturday: blog.gregbrockman.com/openai…
2
5
36
.@Blitz_DotA and others had figured out the 18 hero meta as of Benchmark. It's certainly different from the full meta, but not really hard for pros to figure out.
It's actually much less fair to force the *bots* to play according to the human meta!
3
6
"From our human perspective, @ODPixel, this is an even game. How are they saying 95%?!?!" — @DotACapitalist at 1hr 34min 40s, as OpenAI Five predicts it has a 95% chance of winning the game.
For folks interested in AI but who missed the livestream yesterday, it's potentially worth watching the end of game one, when the tide starts to turn after OAI Five thought it was in a great position but humans thought things were still even: twitch.tv/videos/410533063
2
6
2
43
Seriously amazing work! Event yesterday was primarily put together by @nadipity and @jonasschneider, with big contributions from Loren Kwan, @apilipis, the rest of the OpenAI Dota team, and others from around the company. Get some well-deserved rest :).
Always amazing to see ideas and drawings come to life in reality. @nadipity and myself have been scrambling for the past few weeks to put our #OpenAIFive finals event together -- coming up next: lots of catchup sleep!
3
37
That’s a fair point, meant to be more evocative than a rigorous claim. We also don’t have evidence that Five can’t adapt!
1
2
I usually like to refer to Five as analogous to an insect — trained on an evolutionary timescale, operates via ingrained “instincts” which handle even unexpected things in its environment, but can’t quickly adapt to pick up new skills.
Feels like a step forward but much remains.
I understand the point. But a counterargument is that it’s reasonable to spot the algorithm that kind of training time to compensate for millennia of human evolution on the other side.
5
14
1
144
Interesting thread on some things humans can learn from Five:
I think the OpenAI games revealed an invisible high level trend of their own in Pro Dota old.reddit.com/r/DotA2/comments/…
4
1
22
Good guess :)!
Alright so in terms of the original blog: "competence, scalability, and ability to enhance humans". We've seen the first and the third item there. Could scalability possibly be limited public access to the bots? Surely not. #openaifive
1
15
Very curious to see this too :).
Alright, this is really cool! I bet there will be exploits found really soon. They will probably be hilarious, and teach us much about both the bot and the game. Kudos to @OpenAI for doing this, it's the right thing to do.
2
15
Decompressing with @apilipis and @maddiehalla after today's event. Lots of good energy :). Huge thanks & congrats to the entire team that worked on this event.
5
1
2
46
