President & Co-Founder @OpenAI
Joined July 2010
- Tweets 4,815
- Following 65
- Followers 498,999
- Likes 1,386
A good analysis of the embeddings we use in the OpenAI Five model: neuro.cs.ut.ee/the-use-of-em…. After analyzing the rest of the model, concludes: “All the strategy and tactics must lie in one place – 1024-unit LSTM.” Pretty remarkable what LSTMs (invented in 1997!) can do at scale.
2
88
4
268
Probably not gonna do Techies, but we'll see. Only if we think we'll learn/prove/develop something new.
4
1
6
Very cool to see the excitement from the /r/Dota2 community about Five playing an unrestricted Dota 2 match — currently #1 on /r/Dota2. Note that we aren't likely to integrate literally *all* of the heroes, but will do enough that it's unquestionable we *could* do them all.
14
17
1
126
This is one of the things I find most remarkable about OpenAI Five: somehow, the bot and human strategy spaces overlap significantly. We know that for minigame environments we needed to add randomizations to cause that to happen. Less certain as the env has gotten harder.
3
Cool video giving a lay-person's overview of our recent robotic work. This system uses not just the same learning algorithm but the same training code as OpenAI Five. youtube.com/watch?v=BR4dqbUS…
10
1
46
Fun fact: we actually don’t know whether or not the opponent distribution is necessary — with 1v1 we trained entirely against past selves; with 5v5 we made an arbitrary choice to do 80% self-play and 20% past selves. Will be interesting to investigate if it’s needed.
1
2
Looking forward to my keynote at @TheAIConf tomorrow: conferences.oreilly.com/arti…. If you're at the conference, hope to see you there!
6
55
Longer-form story on the history of our Dota project: medium.com/syncedreview/open…
2
39
4
184
Interview for The Outline on our Dota progress:
"We wanted to work on getting bots to play complex video games because in many ways they are a step closer to the real world than games like chess and Go." trib.al/g4eJFEy
6
13
2
72
Hope you enjoyed the demonstration! We have been making rapid progress — linear increase in the graph below is roughly exponential skill increase. This week we saw OpenAI Five hold its own for 20-30 minutes versus some of the top Dota professionals. Many Canadians at @OpenAI!
2
13
Just finished team celebration. Would have been nice to get a win out of some of the world's best players, but team had predicted <50% of winning game 1 (documented here: theverge.com/2018/8/23/17772…!). Failure would have been an extremely one-sided match — but *total* success there.
4
22
1
89