Bitter lesson

On this page 7

The bitter lesson is the observation, formulated by reinforcement learning pioneer Richard Sutton in a 2019 essay, that general methods which scale with computation have repeatedly outperformed approaches built on hand-coded human knowledge in artificial intelligence. Sutton argued that the two methods which scale without limit are search and learning, and that seven decades of research show researchers returning to these methods only after investing years in clever, domain-specific designs.

The lesson is called bitter because it contradicts a natural research instinct. Encoding what experts know about chess, speech or images feels productive and yields short-term gains, yet those gains plateau, while systems that simply exploit steadily cheaper computation eventually overtake them. Among AI fundamentals, the bitter lesson functions less as a theorem than as a strategic heuristic for deciding where research effort should go.

The core argument of the bitter lesson

The bitter lesson rests on one economic fact: the cost of computation falls exponentially over long periods, a trend commonly associated with Moore’s law and its successors in parallel hardware. Any method whose performance improves with more compute therefore gains strength every year, whereas a method limited by the knowledge its designers wrote down stays roughly where it started.

Sutton separated two time horizons. Within the span of a typical research project, human knowledge gives a quick advantage because compute is fixed. Over a decade, however, available compute grows by orders of magnitude, and the general method overtakes the knowledge-based one. Researchers then face the uncomfortable conclusion that built-in knowledge can actively hinder progress, because it complicates systems and makes them less able to absorb additional computation.

The essay also contains a second, more philosophical claim: the actual contents of minds are irreducibly complex. Concepts such as objects, space or agents should not be hard-coded as simple rules. Instead, AI systems should contain meta-methods that discover structure on their own, so that the system finds what researchers would otherwise attempt to specify.

The following table summarizes the two strategies that the essay contrasts.

PropertyKnowledge-engineered approachGeneral scalable approach
Main ingredientExpert rules, features and heuristicsSearch and learning over large data
Short-term payoffHigh and fastOften weak at first
Response to more computeLittle or noneSteady improvement
Engineering burdenGrows with every new ruleShifts to data and infrastructure
Long-term outcomePlateau and replacementDominant performance
Two research strategies contrasted in the bitter lesson

Historical cases behind the principle

Sutton grounded the bitter lesson in a series of well-documented episodes from the history of artificial intelligence. In each case, specialists first pursued methods that mirrored human understanding of the domain, and massive search or statistical learning later produced decisively better results.

DomainKnowledge-based approachApproach that prevailed
Computer chessEncoded grandmaster strategy and positional rulesDeep Blue in 1997 with massive game-tree search
Computer GoHand-crafted patterns and positional evaluationAlphaGo and AlphaZero with self-play learning and search
Speech recognitionPhonetic and vocal-tract modelsHidden Markov models, then deep neural networks
Computer visionHand-designed edges, SIFT features and generalized cylindersConvolutional neural networks trained end to end
Episodes cited as evidence for the bitter lesson

The chess episode is instructive because many researchers at the time dismissed brute-force search as not how people play chess. The objection was correct about human cognition and irrelevant to performance. A similar pattern appeared in Go two decades later, where AlphaZero discarded human game records entirely and learned from self-play alone.

Since 2019, large language models have become the most widely cited confirmation. Rather than encoding grammar and world knowledge explicitly, these systems learn from vast text corpora, and empirical scaling laws describe smooth gains in loss as parameters, data and compute increase.

How the bitter lesson relates to neighboring ideas

The bitter lesson sits within a long debate between symbolic AI and connectionism, but it is not simply a vote for neural networks. Its claim concerns scalability with computation, and search-based systems such as Deep Blue satisfy it even without any learning component.

ConceptCentral claimRelationship to the bitter lesson
Symbolic AIIntelligence arises from manipulating explicit symbolsMain historical example of knowledge-heavy design
Expert systemEncode specialist rules in a knowledge baseTypical approach that later plateaued
Inductive biasAssumptions a learner uses to generalizeLesson advises keeping such assumptions minimal and general
Scaling lawsLoss falls predictably with compute and dataQuantitative support for the lesson
Neuro-symbolic AICombine learning with explicit reasoningPartly in tension; tests whether structure still helps
Comparison with related concepts in AI fundamentals

The relationship with inductive bias deserves care. Convolution, attention and residual connections are themselves human design choices. Practitioners usually read the lesson as favoring general-purpose biases that scale, such as translation equivariance, over narrow domain rules that encode a specific human theory of the task.

Applying the lesson to research and engineering decisions

In practice, the bitter lesson works as a filter for investment decisions. Teams ask whether a proposed improvement will still matter when compute is ten or a hundred times larger, or whether it merely compensates for today’s resource constraints.

SituationRecommended directionReason
Long-horizon research programFavor methods that scale with computeHardware gains compound over years
Product with fixed hardware budgetDomain knowledge is acceptableCompute will not grow within the deployment window
Scarce or costly dataAdd structure, priors or simulationLearning cannot scale without data
Safety-critical systemKeep explicit constraints and verificationPerformance is not the only objective
Decision guide based on the bitter lesson

The decision table shows that context changes the right answer. The lesson describes long-run research dynamics, so applying it to a near-term product without accounting for budget, latency and data limits misreads its scope.

Criticisms and limitations of the bitter lesson

The bitter lesson is an empirical generalization, not a law, and serious researchers dispute its reach. The main objections concern hidden human design, resource limits and domains where scale alone has not delivered.

  • Hidden human knowledge: successful systems still embed architecture choices, curated datasets and reward designs, so knowledge moved rather than disappeared.
  • Diminishing returns: scaling laws are power laws, meaning each further gain demands disproportionately more compute.
  • Data exhaustion: high-quality training text is finite, which limits pure scaling and revives interest in synthetic data and efficiency.
  • Energy and cost: compute-intensive training concentrates capability in few organizations and raises environmental concerns.
  • Reasoning gaps: commonsense reasoning and reliable planning remain contested areas where structured methods may still contribute.

A frequent misconception treats the lesson as a claim that algorithms do not matter. Sutton argued the opposite: the right algorithms are those that exploit computation effectively, and finding them is difficult research.

Understanding it simply

Imagine two ways to teach a machine a game. One team writes down every tip an expert player knows. Another team builds a system that practices millions of times and learns from its own mistakes. The first team wins early. Years later, computers become far faster, and the practicing system becomes much stronger than the rulebook system.

That is the bitter lesson. Methods that grow stronger with more computing power win in the long run, even when human expertise looks smarter at first. It is bitter because researchers would prefer that their own understanding of a problem be the key ingredient.

Applied in practice

A research group building a document classifier for a large insurance company spends two years writing keyword rules and handcrafted features for claim types. Accuracy reaches about 85 percent and then stalls, because every new rule interacts with older ones and edge cases multiply.

A second team fine-tunes a pretrained language model on 200,000 labeled claims and reaches comparable accuracy within weeks. When the company later doubles its labeled data and moves to a larger model, accuracy rises again without new rules. The group keeps a small set of explicit checks for regulatory fields, but the scalable learned model becomes the core system, which is exactly the trade-off the bitter lesson predicts.