Big takeaway from the GPT paradigm is that the world of text is a far more complete description of the human experience than almost anyone anticipated.

Jan 6, 2023 · 6:29 PM UTC

223
419
136
3,837
Replying to @gdb
Bigger takeaway: only 1.5 billion speak English, the only language having fun right now. We are just getting started
2
Replying to @gdb
Um, humanities students and just anyone who loves to read could have, and probably has, told you this already.
1
9
Replying to @gdb
I suggest you speak to anyone who has read a book before making statements like this.
1
Replying to @gdb
Unfortunately 200,000 years of human abundance & equanimity happened before written history Our data is embedded with the assumption of scarcity, and that competition & hoarding are optimal We’re training our AIs with fear, competition and greed God help us if it’s aligned
2
Replying to @gdb
Code is text. Mathematics is text. DNA is text.
2
3
Replying to @gdb
Agree that LMs have been surprisingly good, but it is a bit of a stretch to say this. We're making pictures and sounds in our head when we read words. So the "description of the human experience" is not in the words, but in the pics/sounds in our minds.
1
1
Replying to @gdb
Okay then why do we have emojis
1
Replying to @gdb
Definitely, and it is surprising. Makes me wonder exactly how much advanced human cognition is linked to language—I know there has been debate about it over time
2
4
Replying to @gdb
again.... I come back to the philosophy of language and Wittgenstein which so captured me when I was young. the limits of language are the limits of the world. Never did I think this could be experimentally proven -- but now I think it can and will.
13