I guess we now shouldn’t expect GPT-3 to be released (though few could even run it in the first place). There will be no external evaluation and scientific progress will be limited.
4
6
27
Replying to @mark_riedl
We have an academic access program, where we're offering free API usage to academics: forms.office.com/Pages/Respo… You can run the same evaluations that our internal teams do:
Training/eval'ing GPT-3 involved a bunch of gnarly distributed system problems (which I love, but are an acquired taste tbh). The API hides those messy details so you can use normal python w/ a tight feedback loop. Gave me the same tingles as switching from TF to pytorch 😊

Jun 11, 2020 · 6:33 PM UTC

1
4
23
Replying to @gdb
oh cool!
2