Cold start problem

On this page 7

The cold start problem is the difficulty a recommender system faces when it must make suggestions for new users, new items or an entirely new platform that have little or no interaction history. In recommender systems built on collaborative filtering, predictions come from patterns in past behavior, so an entity with no clicks, ratings or purchases gives the model nothing to learn from.

Every production recommender meets this problem continuously, because new people sign up and new products, articles or videos arrive every day. How well a system handles cold start often decides whether new users stay and whether new items ever get discovered.

Why collaborative filtering fails without history

The cold start problem arises because collaborative filtering represents users and items only through their interactions. Matrix factorization, for example, learns an embedding for each user and each item from the observed entries of the user-item matrix. A user or item with no entries receives no meaningful embedding, so its predicted scores are essentially random or default to the global average.

Cold start is closely related to, but different from, the data sparsity problem. Sparsity describes a matrix in which most cells are empty even for established users; cold start describes specific rows or columns that are almost completely empty. A system can have moderate overall sparsity and still suffer severe cold start for its newest entities.

Practitioners usually distinguish three forms, summarized below.

FormWhat is missingTypical situation
User cold startInteraction history of a new userFirst visit after sign-up
Item cold startInteractions with a newly added itemNew product, song or article
System cold startHistory for almost everyoneLaunch of a new platform or market
Forms of the cold start problem

Strategies for new users

Systems address user cold start by substituting other signals for missing behavior until enough interactions accumulate. The simplest fallback is popularity-based ranking, which is safe but generic and reinforces popularity bias. Better approaches use whatever is known at sign-up or within the first session.

Onboarding questionnaires ask users to pick favorite genres or rate a few items, giving an explicit starting point. Contextual signals such as device, locale, time of day and referral source support context-aware recommendation from the first request. Session-based models react to clicks within the current visit and need no long-term profile at all.

StrategySignal usedTrade-off
Popularity fallbackGlobal or regional top itemsSafe but impersonal
Onboarding preferencesExplicit choices at sign-upAdds friction to registration
Context featuresDevice, location, time, referrerWeak signal on its own
Session-based recommendationClicks in the current visitNeeds a few interactions first
Demographic attributesAge band or region if providedPrivacy and fairness concerns
Options for new users

Strategies for new items

Item cold start is solved mainly through content features that exist before any interaction. Content-based filtering compares item attributes such as text, category, price, audio or images with what a user already likes, so a new item can be recommended from the moment it is added to the catalog.

Modern systems often train a two-tower model or a hybrid recommender in which the item tower takes content features as input. A new item then receives a usable item embedding immediately, placed near similar existing items. Pretrained text or image encoders, and increasingly large language models, generate these feature vectors without manual tagging.

Content alone cannot reveal whether an item is actually good, so many platforms add deliberate exploration: they show new items to a small, controlled share of traffic and learn from the response. Multi-armed bandit algorithms such as Thompson sampling or upper confidence bound methods balance this exploration against showing items already known to perform well.

Comparing cold start techniques

No single technique solves every form of cold start, which is why production systems usually combine several layers. The following table compares the main families by the form they address and their main limitation.

TechniqueForm addressedMain limitation
Content-based filteringItem, partly userTends toward overly similar suggestions
Hybrid modelsUser and itemMore complex to train and serve
Bandit explorationMainly itemCosts some short-term engagement
Cross-domain transferUserRequires data from a related service
Meta-learningUser and itemResearch-heavy, harder to operate
LLM-based recommendationUser and itemHigher latency and serving cost
Main cold start techniques compared

Cross-domain recommendation deserves particular mention: a user who is new to a video service but has history on a sister music service can start with a transferred profile. Meta-learning methods train a model to adapt quickly from very few interactions, treating each new user as a small learning task.

Measuring and avoiding common mistakes

Cold start performance must be measured separately from overall accuracy, because aggregate metrics are dominated by established users and popular items. Teams typically report metrics such as recall or NDCG for users with fewer than a set number of interactions, often five or ten, and track how quickly new items receive their first engagements.

MistakeConsequenceCorrection
Evaluating only on random splitsCold start weakness stays hiddenHold out new users and items explicitly
Relying on popularity foreverNew items never surfaceReserve traffic for exploration
Long mandatory onboardingUsers abandon registrationAsk for few, optional choices
Ignoring catalog coverageFeedback loop narrows the catalogMonitor coverage and item age
Frequent mistakes and how to correct them

A subtle risk is the recommendation feedback loop: items that start with no exposure gather no interactions, so they keep receiving no exposure. Without exploration or content-based boosts, cold start becomes permanent for part of the catalog, which harms both diversity and the creators or sellers behind those items.

In plain words

Think of a bookseller who recommends books by remembering what each regular customer bought before. When a stranger walks in, the bookseller has nothing to go on. When a new book arrives, nobody has bought it yet, so the bookseller does not know whom it would suit.

That is the cold start problem. A good bookseller asks the stranger a couple of questions, looks at the new book’s cover and topic, and occasionally suggests it to see how people react. Recommendation software does the same: it uses descriptions, context and small experiments until it has enough real behavior to learn from.

A real-world example

An online grocery service adds about 400 new products every week and gains several thousand new customers each month. Its collaborative filtering model works well for regular shoppers, but new products rarely appear in recommendations, and first-time customers see the same generic best-seller list.

The team introduces a hybrid two-tower model whose item tower uses product name, category, brand, price band and an image embedding. New customers are asked to select three dietary preferences at sign-up, and the first basket immediately updates their profile through a session-based component. The team also reserves 5 percent of recommendation slots for bandit-driven exploration of items added in the last 14 days.

Over the following quarter, recall for customers with fewer than five orders rises noticeably, and the share of new products that receive at least one recommended purchase in their first two weeks more than doubles, without lowering engagement among established shoppers.