We've created an AI system that can summarize books. Matches the quality of human-written summaries 5% of the time, and there's lots of room to improve from here. One step towards building AI systems that can reliably perform tasks that are hard for humans to even evaluate.
We want our AI systems to be aligned with human intentions. This is especially important as tasks get more difficult to evaluate. To develop techniques to address this problem, we trained a model to summarize books. openai.com/blog/summarizing-…

Sep 23, 2021 · 6:53 PM UTC

24
39
7
379
Replying to @gdb
With customizable result size. Please. Being able to add any URL book / paper in PDF or text if GPT-3 don't have it. This is a 100% useful, commercial and disruptive killer app.
@OpenAI Book summaries in a customizable result size. The GPT Killer App.
Replying to @gdb
Is the road from reading books to summarizing books longer than the road from summarizing books to writing books?
Replying to @gdb @Dominic2306
When I was in High School the point of summarising books was to ensure you had actually read the book and understood the book!
1
2
Replying to @gdb
First test result, for Lord Of The Rings "Actually pretty boring but not as ball-crunchingly so as The Silmarillion".
Replying to @gdb @Dominic2306
Can you use it to summarise @Keir_Starmer 's 14,000 word exposition on what he stands for? Lots of us in the UK would like to know but can't be bothered reading it.
Replying to @gdb
available in beta?
Replying to @gdb
This is so fascinating. I would love to be able to have a polling of renown ML researchers on how long before you folks achieve superhuman performance on this task. What’s your take on this @gdb ? Over or under 5 years? 😉
Replying to @gdb @Dominic2306
What is the quality of human-written summaries? How do you know you hit that standard 5% of the time?
2