We’ve released a tool for visualizing every layer and neuron in eight common vision networks. One more step towards opening the “black box” of the neural network.
Introducing OpenAI Microscope: a collection of visualizations of every layer and neuron in eight vision "model organisms" often studied in interpretability. This tool allows researchers to investigate down to individual units, and share those observations. openai.com/blog/microscope/

Apr 14, 2020 · 4:11 PM UTC

2
23
1
142
Replying to @gdb
Excellent execution on this one. It's nice to make such visualization libraries so widely and easily accessible. I'd also love to see decision boundary visualizations using adversarial attacks i.e. start from a dog classified as a dog and move it towards other classes
1
1
Replying to @gdb
It would be great to have one for NLP too!