Turns out DALL-E can read the seemingly gibberish writing it produces. Built its own mini-language that is consistent between its text input space and image output space:
Giannis Daras @giannis_daras
31 May 2022
DALLE-2 has a secret language. "Apoploe vesrreaitais" means birds. "Contarra ccetnxniams luryca tanniounons" means bugs or pests. The prompt: "Apoploe vesrreaitais eating Contarra ccetnxniams luryca tanniounons" gives images of birds eating bugs. A thread (1/n)🧵

Jun 1, 2022 · 12:07 AM UTC

8
23
9
132
A pretty good hypothesis on how this arises (as an artifact of how the text input space is tokenized):
. @BarneyFlames
31 May 2022
I took a look at the BPE encoding of the name DALL-E uses for birds. Its "apo, plo, e</w>, ,ve, sr, re, ait, ais</w>". Apo-didae & Plo-ceidae are families of birds, each with 100+ species. Apo-diformes is the biggest order of birds with 400+ species of birds.
3
3
50
Replying to @gdb
Maybe not (there is something interesting happening with some of the gibberish though!):
Benjamin Hilton @benjamin_hilton
31 May 2022
No, DALL-E doesn’t have a secret language. (or at least, we haven't found one yet) This viral DALL-E thread has some pretty astounding claims. But maybe the reason they’re so astounding is that, for the most part, they're not true. Thread 👇🧵 (1/15)
1
1
5
Replying to @gdb
Interesting, apparently instances of "Interlingua" have occurred before en.wikipedia.org/wiki/Langua…
2
Replying to @gdb
@marconeves you’re going to love this!!!
1
Replying to @gdb
plz send me inv <3
2
Replying to @gdb
Self Taught Bird Language. Next could you actually decode bird language!
Replying to @gdb
This is impressive, you please ask dalle to do "happy Algeria eating chicken" 🤣
Replying to @gdb
It sounds like scientific names to me. "Apoploe vesrreaitais". It totally looks like Latin