Skip to content

Entry

Large Language Models are Zero-Shot Reasoners

Appears in 4 awesome lists

"Let's think step by step" — zero-shot CoT milestone

Open arxiv.org

Found in these lists

Awesome GPT Prompt Engineering

Section: Papers

SlowScore 62

Awesome LLM Reasoning

Section: 2022

SlowScore 72

awesome-nlp

Section: Reasoning and Test-Time Compute · chain-of-thought for NLP reasoning tasks.

FreshScore 91

Awesome Prompts

Section: Foundations · "Let's think step by step" — zero-shot CoT milestone

FreshScore 96

ReAct

The foundational paper defining the Thought/Action/Observation loop structure that underlies virtually every agent harness. Required reading for understanding why the loop is structured the way it is and where each harness component maps onto the reasoning-acting cycle.

In 7 listsDetails

Self-Consistency Improves Chain of Thought Reasoning in Language Models

Samples diverse reasoning paths and selects their most consistent answer to improve inference-time reliability. (ICLR 2023)

In 6 listsDetails

Attention Is All You Need

(AIAYN) - Introducing multi-head self-attention neural networks with positional encoding to do sentence-level NLP without any RNN nor CNN - this paper is a must-read (also see this explanation and this visualization of the paper).

In 6 listsDetails

Chain-of-Thought Prompting

foundational result; intermediate reasoning steps improve performance.

In 5 listsDetails

Tree of Thoughts

search over reasoning trees.

In 4 lists

Constitutional AI

Uses written principles and model-generated critiques to scale supervision while retaining explicit behavioral constraints. (arXiv 2022)

In 4 lists

Language Models are Few-Shot Learners

by Tom B. Brown (OpenAI) et al. - "We train GPT-3, an autoregressive language model with 175 billion parameters :scream:, 10x more than any previous non-sparse language model, and test its performance in the few-shot setting."

In 4 lists

rStar-Math

(2025) - small policy model paired with a process preference model trained via MCTS rollouts; enables small LMs to bootstrap reasoning without distilling from larger models.

In 3 lists