Data

Data engineering

Terms

7 terms

  • Change data capture CDC

    Change data capture (CDC) detects inserts, updates and deletes in a source database and delivers them as a stream of change events to other systems.

  • Data lake

    A data lake is a central repository that stores raw structured and unstructured data at scale in open formats, applying schema only when read.

  • Data pipeline

    A data pipeline is an automated sequence of steps that moves data from sources, transforms it and delivers it reliably to storage or applications.

  • Data warehouse

    A data warehouse is a central, query-optimized store of cleaned and integrated historical data built for reporting and analytics across an organization.

  • ELT

    ELT is a data engineering pattern that extracts data, loads it raw into a warehouse or lakehouse, and then transforms it inside that platform.

  • ETL

    ETL (extract, transform, load) is a data engineering process that pulls data from sources, reshapes it outside the target and loads it into a warehouse.

  • Lakehouse

    A lakehouse is a data architecture that adds warehouse features such as ACID transactions and schemas to open files stored in a low-cost data lake.