Text summarization

On this page 7

Text summarization is the natural language processing task of producing a shorter version of a text that preserves its essential information, either by selecting the most important sentences or by generating new wording. In speech & language AI, it is applied to articles, reports, meeting transcripts, support conversations and legal or medical records, wherever people need the gist of more text than they can read.

Two families dominate: extractive summarization, which copies existing sentences, and abstractive summarization, which writes a new text with a sequence-to-sequence or large language model. The central difficulty is the same for both: deciding what matters and staying faithful to the source.

How extractive and abstractive summarization work

Extractive methods score each sentence of the source and assemble the highest-scoring ones into the summary. Classic scoring uses word frequency, sentence position and graph centrality, as in the TextRank and LexRank algorithms; newer systems use a neural encoder that predicts whether each sentence belongs in the summary. Because every sentence is copied verbatim, extractive output is grammatical and traceable, but it can be choppy and redundant.

Abstractive methods read the full input and generate a new text token by token. Encoder-decoder transformers trained on document-summary pairs and large language models guided by prompts both belong here. They can paraphrase, merge facts from distant sentences and adapt tone, but they can also produce hallucinated details that the source never stated.

PropertyExtractiveAbstractive
Output wordingCopied source sentencesNewly generated text
FluencyOften disjointedUsually smooth
Faithfulness riskLow, but context can be lostHallucination is possible
Compression flexibilityLimited by sentence lengthCan reach any target length
Compute costLowModerate to high
TraceabilityEvery sentence has a sourceRequires separate attribution
Extractive and abstractive summarization compared

Many production systems are hybrid: they first extract relevant passages to fit the model’s context window and then generate an abstractive summary from those passages, which reduces both cost and the room for invention.

Summary types and key parameters

Summarization is configured along several dimensions that change the task considerably. The compression ratio, the ratio of summary length to source length, is the most visible one; news summaries often keep roughly 5 to 15 percent of the words, while executive briefs of long reports may keep far less.

DimensionOptionsEffect on the result
Input scopeSingle document or multi-documentMulti-document needs deduplication
PurposeGeneric or query-focusedQuery-focused keeps only relevant facts
FormHeadline, bullet list, paragraphShapes readability and length
Compression ratioFrom a single line to about a thirdTighter ratios drop more detail
Input typeWritten text or speech transcriptTranscripts need disfluency handling
AudienceExpert or general readerChanges terminology and depth
Main dimensions of a summarization task

Long-document summarization adds a structural problem: inputs larger than the model’s context window are split into chunks, summarized separately and then combined, a pattern known as map-reduce or hierarchical summarization. Each merge step can lose details, so chunk boundaries should follow sections rather than fixed token counts.

With large language models, these parameters are set mostly through the prompt and decoding settings. Effective instructions name the target length in words or bullets, the audience, the fields that must be preserved and the rule to use only information from the source. A low sampling temperature reduces variation between runs, which matters when summaries are compared or audited, and a fixed output template makes results easier to check automatically.

How summarization relates to neighboring language tasks

Text summarization belongs to natural language generation but depends heavily on natural language understanding, because the system must identify salient content before rewriting it. It is often chained with speech-to-text for meeting summaries and with named entity recognition to guarantee that names, dates and amounts survive compression.

TaskInputOutputKey difference
Text summarizationLong textShort text with main pointsReduces length, keeps meaning
Question answeringText plus a questionSpecific answerTargets one information need
Text classificationTextCategory labelNo text is generated
TranslationText in one languageSame content in anotherKeeps length and detail
Keyword extractionTextList of termsNo sentences or relations
Summarization and related tasks

Evaluating summary quality

Summary quality has at least four dimensions: coverage of key content, factual consistency, coherence and conciseness. Automatic metrics capture only parts of this, so serious evaluation combines metrics with human review against the source.

MethodWhat it measuresMain weakness
ROUGEN-gram overlap with reference summariesRewards copying, ignores facts
BERTScoreSemantic similarity of embeddingsStill blind to factual errors
Entailment-based checksWhether the source supports each claimStruggles with long inputs
Question-based checksAnswers from summary versus sourceDepends on generated questions
Human ratingFaithfulness, coverage, fluencySlow and costly
Model-as-judgeRubric scores from another modelShares biases of language models
Common evaluation methods

A high ROUGE score does not prove that a summary is correct. Abstractive systems can score well while swapping a number or a negation, so factual checks are mandatory for regulated or customer-facing content.

Limitations and practical safeguards

The main risks of automatic summaries are well understood, and each has a practical countermeasure.

  • Hallucination: generated facts not present in the source; mitigate with grounding prompts, source quotes and entailment checks.
  • Omission of critical details: a short summary may drop a deadline or a dosage; define must-keep fields such as dates, amounts and obligations.
  • Position bias: models overweight the beginning and end of long inputs; chunk by section and summarize each part.
  • Lost hedging: phrases such as may, unless or except disappear, turning uncertain statements into firm claims.
  • Transcript noise: speech recognition errors in names and numbers propagate into the summary unless corrected first.

For high-stakes use, the safest pattern is summaries with traceable citations to source passages, so that a reviewer can verify each statement in seconds instead of rereading the whole document.

In simple terms

Text summarization is what a good assistant does when handed a fifty-page report and asked for one page. Some assistants underline the most important sentences and copy them out. Others read everything and write a short note in their own words.

Computers do both. The copying approach is safe but sometimes awkward; the rewriting approach reads better but can occasionally invent things. That is why a summary used for important decisions should always be checked against the original.

A practical example

A customer support center records around 4,000 calls a day. Each call is converted to text with speech-to-text, and a language model then produces a five-line summary with fixed fields: customer issue, steps already taken, promised follow-up and deadline. The prompt instructs the model to use only information stated in the transcript and to quote the customer’s exact order number.

A rule-based check compares order numbers, dates and amounts in the summary with the transcript and flags mismatches for an agent to correct. Agents stop writing notes by hand, saving several minutes per call, and supervisors can review a whole shift’s issues in one sitting. The combination of generation and automatic fact checks keeps the summaries short while preventing the most damaging errors.