Dataset

On this page 6

A dataset is a defined and bounded collection of related data, organized around a common subject and structure, that is managed, analyzed or shared as a single unit. In data fundamentals, the word does not describe a storage technology but a unit of meaning: a table of customer orders, a folder of labeled images or a year of sensor readings can each be a dataset.

What turns loose data into a dataset is definition: a clear scope, a consistent structure, known variables and metadata that explains origin and meaning. Without these, the same files are merely data that happen to sit together.

What defines a dataset

In the most common tabular form, a dataset consists of observations and variables. Each observation (a row, record or instance) describes one unit, such as a customer or a measurement, and each variable (a column, field or feature) records one property of that unit. This arrangement, with one observation per row and one variable per column, is often called tidy data.

Several properties distinguish a usable dataset from an arbitrary file collection. The table below lists them with typical examples.

PropertyWhat it specifiesExample
ScopePopulation, period and boundariesAll online orders from 2025
GranularityWhat one record representsOne row per order line
SchemaVariables, data types and unitsamount as decimal in euros
MetadataOrigin, owner, collection method, licenseExported nightly from the shop database
VersionWhich snapshot or release it isRelease 2026-03, frozen
IdentifierKey that makes each record uniqueorder_id plus line_no
Core properties of a dataset

Granularity is the property most often left implicit, and it causes the most serious analytical errors. Joining a dataset with one row per order to a dataset with one row per order line silently multiplies order totals unless the analyst notices the difference.

Types of datasets

Datasets are classified along several axes: by structure, by time dimension and by purpose. Structure separates structured data in tables, semi-structured data such as JSON, and unstructured data such as text, images or audio.

Dataset typeStructureTypical exampleTypical format
Cross-sectionalMany units at one point in timeCustomer survey from one monthCSV, spreadsheet, table
Time seriesOne unit over many time pointsHourly electricity loadCSV, time-series database
Panel (longitudinal)Many units over many time pointsHousehold income tracked yearlyParquet, relational tables
RelationalSeveral linked tablesOrders, customers and productsDatabase schema, SQL dump
Unstructured corpusFiles without a tabular schemaCollection of support emailsText files, images, audio
Labeled datasetInputs paired with known answersImages tagged as defect or no defectFiles plus annotation table
Common dataset types by structure and time

In machine learning, one dataset is usually split into training, validation and test subsets, for example in a 70/15/15 or 80/10/10 ratio. The test subset must stay untouched until the final evaluation; using it during model tuning causes data leakage and overly optimistic results.

The word dataset is often used loosely next to terms such as database, data file and data product. The distinction lies in purpose and boundaries, as the table shows.

ConceptMain ideaChanges over timeRelation to a dataset
DatasetBounded collection with one meaningOften fixed per versionThe unit itself
DatabaseSystem that stores and serves dataContinuouslyCan hold many datasets or produce extracts
Data filePhysical container of bytesRarelyOne dataset may span many files
Data streamUnbounded flow of eventsConstantlyA time window of it becomes a dataset
Data productMaintained dataset with an owner and service levelOn a scheduleA dataset managed as a product
Dataset and neighboring terms

Two closely related concepts describe qualities of a dataset rather than separate objects. Data quality measures whether its values are accurate, complete and consistent, and data lineage records where the dataset came from and which transformations produced it.

Documenting and versioning a dataset

A dataset is only reusable if a person who did not create it can understand it without asking. Good practice is a data dictionary that lists every variable with its type, unit, allowed values and meaning, plus a description of collection method, known gaps and license.

Versioning matters because results must be reproducible. An analysis that cites “the customer dataset” cannot be repeated once the data has changed, while one that cites a fixed release or a content hash can. Tools for data version control and immutable snapshots in data lakes exist for this reason.

Common pitfalls when preparing or reusing datasets include:

  • Undocumented missing values coded as 0, -1 or 999, which distort averages.
  • Sampling bias, when the collected units do not represent the population the conclusions refer to.
  • Mixed units or time zones within one variable after merging several sources.
  • Silent updates that change a dataset without a new version label.
  • Personal data without a legal basis, which can make an otherwise useful dataset unusable.

The short version

A dataset is like a well-organized spreadsheet with a clear label on it. The label says what the sheet contains, where the numbers came from and what each column means, so anyone can use it correctly.

A pile of numbers without that label is just data. Once it has clear boundaries, a consistent layout and an explanation, it becomes a dataset that can be analyzed, shared and trusted.

Where it makes a difference

A city transport office wants to know whether a new bus line has reduced car traffic. It assembles a dataset from automatic traffic counters: one row per counter per hour, with variables for counter ID, timestamp in UTC, vehicle class and count, covering 12 months before and 6 months after the launch.

During documentation, the analysts discover that four counters recorded local time instead of UTC and that failed hours were stored as 0 rather than as missing. After correcting both issues and freezing the result as a versioned release, the before-and-after comparison shows a decrease of about 7 percent in car counts on the corridor. Because the dataset is documented and versioned, an external reviewer later reproduces the same figure from the same release.