Information extraction

On this page 8

Information extraction (IE) is the task of automatically converting unstructured or semi-structured text into structured, machine-readable records, such as entities, their attributes, the relations between them and the events they take part in. Within Speech & language AI, it sits between raw language understanding and downstream systems: a contract, a clinical note or a call transcript goes in, and rows that a database, knowledge graph or analytics tool can query come out.

Information extraction is defined by its output schema rather than by a single algorithm. The schema states which fields matter, for example party names, dates and amounts in an invoice, and the extraction system fills those fields from free text. Precision, recall and schema coverage decide whether the result is usable in production.

How information extraction turns text into records

An information extraction system works as a pipeline of linguistic analyses that progressively adds structure to text. Classic pipelines first segment and tokenize the input, then apply named entity recognition, coreference resolution and relation extraction, and finally normalize values into canonical forms such as ISO 8601 dates or currency codes.

Modern systems often collapse several stages into one joint neural model or a large language model prompted with a schema, but the logical steps remain the same. Each step can fail independently, so errors propagate downstream: a missed entity can never become part of an extracted relation.

The table below shows the typical stages and what each contributes to the final record.

StageWhat it producesExample output
PreprocessingClean text, sentences, tokensSentence boundaries in a PDF transcript
Entity recognitionTyped text spans“Acme Ltd” as ORGANIZATION
Coreference resolutionClusters of mentions“the supplier” linked to Acme Ltd
Relation extractionTyped links between entitiesSUPPLIES(Acme Ltd, Contoso)
Event extractionTriggers with argument rolesACQUISITION with buyer, target, date
Normalization and linkingCanonical values and IDs2025-03-14, knowledge base identifier
Typical stages of an extraction pipeline

Types of information extraction tasks

Information extraction is an umbrella for several subtasks that differ in output granularity. Some return isolated spans, others return tuples or complete event frames with multiple argument roles.

SubtaskOutput unitTypical use
Named entity recognitionSpan plus typeFinding people, organizations, drugs
Relation extractionEntity pair plus relationBuilding knowledge graphs
Event extractionTrigger plus argumentsNews monitoring, risk alerts
Slot fillingValues for predefined fieldsForms, dialogue systems, profiles
Template fillingFull document-level recordInvoices, contracts, clinical reports
Open information extractionFree subject-predicate-object triplesExploratory corpus analysis
Main subtasks and their outputs

Closed (schema-driven) extraction targets a fixed ontology and yields consistent, comparable records. Open information extraction needs no schema but produces noisy, redundant triples that usually require clustering and canonicalization before they are useful.

Approaches: rules, supervised models and LLMs

Three families of methods dominate practice, and mature systems frequently combine them in a hybrid design. The choice depends on available labeled data, required accuracy, auditability and cost per document.

ApproachStrengthsWeaknesses
Rules and patternsTransparent, precise, no training dataBrittle, low recall, costly to maintain
Supervised sequence modelsHigh accuracy on stable domainsNeed thousands of labeled examples
LLM with schema promptingFast setup, handles varied wordingHallucinated values, higher inference cost
Weak supervisionScales labels from heuristicsLabel noise must be modeled
Comparison of extraction approaches

Supervised extractors are typically transformer encoders fine-tuned with token classification or span-pair classification heads. Generative extraction with large language models instead asks the model to emit JSON that matches a schema; constrained decoding or schema validation is essential, because a fluent but invented value is the most dangerous failure in this setting.

Information extraction is often confused with neighboring language tasks, yet its goal is distinct: it produces structured facts for storage and querying, not labels, summaries or answers for a human reader.

TaskOutputKey difference from extraction
Text classificationOne label per documentNo facts or arguments are extracted
Text summarizationShorter free textOutput remains unstructured
Question answeringAnswer to one questionDriven by queries, not a fixed schema
Keyword extractionSalient termsNo types, relations or roles
Information retrievalRanked documentsFinds documents, does not read them into fields
Information extraction compared with neighboring tasks

In practice these tasks are complementary: retrieval selects relevant documents, classification routes them, and extraction fills the database. Question answering can also serve as an extraction method, where each schema field is phrased as a question.

Evaluating extraction quality

Extraction quality is measured with precision, recall and F1 score, computed at the level that matters for the application. Strict matching requires exact span boundaries and types, while relaxed matching accepts partial overlap, and the two can differ by several points on the same output.

Field-level accuracy on business documents, record-level exact match and end-to-end accuracy after normalization are often more informative than span-level F1. Benchmarks such as CoNLL-2003, ACE 2005 and TACRED shaped academic practice, but domain-specific test sets are needed before deployment because accuracy drops sharply on unfamiliar document layouts and terminology.

Limitations and common failure modes

Most extraction failures come from language variation, document structure and schema ambiguity, not from the model alone. Teams that understand these sources can design validation steps that catch errors before they reach downstream systems.

  • Implicit and negated facts: “no evidence of fracture” must not become a fracture record.
  • Cross-sentence relations: facts split across paragraphs are missed by sentence-level models.
  • Layout dependence: tables, scanned PDFs and forms need OCR and layout-aware models.
  • Hallucinated fields: generative extractors may fill empty slots with plausible values.
  • Schema drift: new document templates silently reduce recall over time.
  • Speech input errors: transcripts with a high word error rate corrupt names and numbers.

Robust deployments add confidence thresholds, source-span grounding and human review for low-confidence or high-impact fields. Requiring every extracted value to point to its evidence span in the source text is the single most effective guard against invented data.

Stripped to the essentials

Information extraction is like giving a very fast clerk a stack of letters and a blank form. The clerk reads each letter and copies the important details, such as names, dates and amounts, into the right boxes on the form.

Computers are good at sorting and searching forms, but poor at reading loose text. Information extraction bridges that gap by turning sentences into neat rows of data. The key point is that someone must first decide which boxes the form has, and the system must be checked so it does not invent details that were never in the letter.

Where it is applied

A hospital network wants to track adverse drug reactions mentioned in physicians’ free-text discharge notes. Its data team defines a schema with drug name, reaction, severity, onset date and negation status, then labels about 3,000 notes to fine-tune a transformer-based extractor that links each drug to its reaction.

The extractor processes roughly 40,000 notes per month. Negation handling stops phrases such as “denies rash” from creating false records, and every extracted pair is stored with its source sentence. Pharmacists review only records below a confidence threshold, about one in eight.

The outcome is a queryable safety database that surfaces reaction patterns weeks earlier than manual chart review, while evidence spans let clinicians verify any record in seconds.