In just 6 months, our Fellows went from beginner to producing world-class ML contributions. Their accomplishments: MuseNet, analysis of bias/variance of gradients, implementations of very large scaling transformers, and learning adaptive weight sparsity:
openai.com/blog/openai-fello…