A visual overview of how GPT-3 works:
How GPT3 works. A visual thread. A trained language model generates text. We can optionally pass it some text as input, which influences its output. The output is generated from what the model "learned" during its training period where it scanned vast amounts of text. 1/n

Jul 22, 2020 · 5:25 PM UTC

1
40
209
Replying to @gdb
can you say anything about this its kinda worrying
So I don't want to sound alarms prematurely, here, but we could possibly be looking at the first case of an AI pretending to be stupider than it is. In this example, GPT-3 apparently fails to learn/understand how to detect balanced sets of parentheses. (1/10.)
1