Awesome AI Papers
Section: NLP
Entry
Appears in 5 awesome lists
foundational result; intermediate reasoning steps improve performance.
Section: NLP
Section: Papers
Section: 2022 · [blog]
Section: Reasoning and Test-Time Compute · foundational result; intermediate reasoning steps improve performance.
Section: Recent advances in Prompt engineering
The foundational paper defining the Thought/Action/Observation loop structure that underlies virtually every agent harness. Required reading for understanding why the loop is structured the way it is and where each harness component maps onto the reasoning-acting cycle.
Samples diverse reasoning paths and selects their most consistent answer to improve inference-time reliability. (ICLR 2023)
(AIAYN) - Introducing multi-head self-attention neural networks with positional encoding to do sentence-level NLP without any RNN nor CNN - this paper is a must-read (also see this explanation and this visualization of the paper).
This paper presents an RLHF approach to using supervised learning to fine-tuning. It is also known as a paper that illustrates the kernel of ChatGPT's thinking. Presumably, ChatGPT is an extended version of InstructGPT that enables fine-tuning on larger datasets.
"Let's think step by step" — zero-shot CoT milestone
Uses written principles and model-generated critiques to scale supervision while retaining explicit behavioral constraints. (arXiv 2022)
by Tom B. Brown (OpenAI) et al. - "We train GPT-3, an autoregressive language model with 175 billion parameters :scream:, 10x more than any previous non-sparse language model, and test its performance in the few-shot setting."
by Hoffmann et al. at DeepMind. TLDR: introduces a new 70B LM called "Chinchilla" that outperforms much bigger LMs (GPT-3, Gopher). DeepMind has found the secret to cheaply scale large language models — to be compute-optimal, model size and training data must be scaled equally. It shows that most…