Our dev platform team is planning their work for the next month, and wants to make sure we're building what people want. So if you're an OpenAI API user — what should we add/fix/improve to make your experience better?

Mar 8, 2023 · 5:10 PM UTC

353
54
7
520
Replying to @gdb
Two small requests with very large impact : 1) Replying to messages, similarly like in Discord "Reply" icon. 2) When ChatGPT not able to fully complete messages, a button or prompt "Finish last work" to handle it.
Replying to @gdb
It should be able to go online
Replying to @gdb
Please make it easy to export a chat and its history as one text document or markdown
2
Replying to @gdb
Model fine-tuned for reasoning+summary+extraction rather than memorization. Example: I don't need a model to know the population of countries, as long as it can extract it from the input context that I give it.
1
1
Replying to @gdb
Working on how LLMs can be used in Bayesian modeling and inference. It'd be great to have: - normalized log probabilities for when temperature ≠ 1.0 - stable log probabilities (currently differs across API requests, keeping text fixed)
1
1
1
30
Replying to @gdb
Fine tuning for your latest models! ChatGPT Turbo is awesome -- just wish we were able to do more fine tuning using our data
1
Replying to @gdb
More tokens per call 🙏 or support to parse larger texts in other ways
5
Replying to @gdb
GPT4. Increased token limits. Especially for embeddings. Continue to drive the cost down. Faster responses. Confidence scores. First party vector database to store and serve embeddings. ChatGPT mobile. Increase the view width of ChatGPT in the browser.
Replying to @gdb
A caching layer for embeddings and prompts - can reduce costs and maintenance on both sides
1
Replying to @gdb
👉 Plan for the next decade: add reasoning ⇒get rid of hallucinations nitter.vloup.ch/VictorSenkevich/…
👽 "The dream of reason gives birth to monsters" / LLHMs (Large Language Hallucination Models)