White Papers
- Bitcoin: A Peer-to-Peer Electronic Cash System
- Improving Language Understanding by Generative Pre-Training, the OpenAI GPT 1 paper. See also the blog post.
- Language Models Are Unsupervised Multitask Learners, the OpenAI GPT 2 paper. Alternative link: OpenAI CDN
- Language Models are Few-Shot Learners, the OpenAI GPT 3 paper.
- Training language models to follow instructions with human feedback, the OpenAI InstructGPT paper. InstructGPT is, roughly speaking, ChatGPT. See ChatGPT announcement for details on how InstructGPT led to ChatGPT.
- The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity, Apple's [in?]famous paper. See its announcement.