One reason ML for physical robotics is so hard is how many confounders you need to deal with:
Replying to @OpenAI
One person on the project used to have consistently better results on the robot. For a while, we couldn't figure out why. It turned out that his laptop was faster, and it incurred less latency on the robot, which in turn gave better results.

Oct 16, 2019 · 2:52 PM UTC

1
7
52
Replying to @gdb
@woj_zaremba @OpenAI ...one person had better results on the robot... he had a faster laptop...was he rewarded...or...punhished ??
This tweet is unavailable
Co-founders make it easier :).