Usability testing

On this page 7

Usability testing is a research method in which representative users attempt realistic tasks with a product while a researcher observes where they succeed, hesitate or fail. In UX design it is the most direct way to find out whether an interface actually works for the people it was built for, rather than whether the team believes it does.

The method focuses on observed behavior, not stated opinion. What participants do with a prototype or a live product reveals problems in labels, navigation, flow and feedback that internal reviews routinely miss, because the team already knows how the product is supposed to work.

How a usability test session works

A usability test session places one participant in front of the product with a set of task scenarios written as goals, such as finding a delivery date or changing a subscription, without revealing which buttons to press. The participant is usually asked to think aloud, verbalizing expectations and reactions while working.

The facilitator introduces the session, reads the tasks and stays neutral, avoiding hints or leading questions. Observers record where the participant hesitates, takes a wrong path or misreads an element. A typical moderated session lasts 30 to 60 minutes and covers roughly five to eight tasks, followed by short debrief questions.

After the sessions, the team groups observations into usability issues, notes how many participants encountered each one and rates its severity. The output is a prioritized list of problems with evidence, not a vote on whether people liked the design.

Types of usability testing

Usability tests vary along three main axes: whether a facilitator is present (moderated or unmoderated), whether participant and researcher share a room (in person or remote), and whether the goal is to find problems or to measure performance (qualitative or quantitative).

VariantHow it runsStrengthLimitation
Moderated in personFacilitator and participant in the same roomRich observation, follow-up questionsHigher cost, limited geography
Moderated remoteVideo call with screen sharingWide reach with live probingDependent on connection and setup
Unmoderated remoteParticipants record themselves with a testing toolFast and scalableNo follow-up, shallower insight
Guerrilla testingShort sessions with passers-byVery cheap and quickParticipants may not match the audience
Benchmark testingStandardized tasks repeated over timeMeasures progress with metricsNeeds larger samples and strict protocol
Main variants of usability testing

Formative testing happens during design to find and fix problems, while summative testing evaluates a finished product against targets or competitors. Formative studies dominate everyday product work because they directly feed the next design iteration.

Sample size and usability metrics

For qualitative, problem-finding studies, small samples work well: around five participants per distinct user group typically surface the most frequent issues, and several small rounds with fixes in between find more problems than one large round. This guideline does not apply to rare problems, highly diverse audiences or statistical comparisons.

Quantitative usability testing needs considerably more participants, commonly 20 or more per group, to produce confidence intervals narrow enough for decisions. The table lists the metrics most often collected.

MetricWhat it measuresTypical form
Task success rateEffectiveness of the designPercentage of participants completing a task
Time on taskEfficiency for completed tasksSeconds or minutes, often geometric mean
Error rateFrequency of wrong actionsErrors per task or per participant
Single ease questionPerceived difficulty of one taskRating on a 7-point scale
System usability scaleOverall perceived usabilityScore from 0 to 100, about 68 is average
Common usability metrics and what they reveal

A frequent error is reporting percentages from five participants as if they were representative. With small samples, the reliable output is the list of observed problems, not the numbers.

Usability testing evaluates how well a design supports tasks, which distinguishes it from methods that explore needs or structure. It often works alongside card sorting, which informs information architecture, and alongside journey mapping and personas, which frame who the users are.

MethodCore questionData typeTypical stage
Usability testingCan people complete tasks with this designObserved behaviorPrototype to live product
User interviewWhat do people need and whySelf-reported experienceDiscovery
Card sortingHow do people group contentGrouping patternsInformation architecture
A/B testingWhich variant performs better at scaleBehavioral analyticsLive product
Heuristic evaluationDoes the design break known principlesExpert judgmentAny stage
Usability testing and neighboring research methods

A/B testing shows which variant wins but not why; usability testing shows why people struggle but not how often across the whole audience. Strong teams combine both.

Common mistakes in usability tests

Most failed usability studies fail through biased setup or weak analysis rather than through too few participants. The issues below recur most often.

  • Leading tasks: wording such as click the Settings icon reveals the answer; describe the goal, not the path.
  • Wrong participants: colleagues or friends know too much; recruit people who match the audience.
  • Facilitator rescue: helping a stuck participant hides the problem; stay neutral and note it.
  • Asking for opinions: questions like do you like it produce polite answers; watch behavior instead.
  • No severity rating: an unranked list stalls action; rate issues by impact and frequency.

Finally, testing too late is costly. A test on a clickable wireframe prototype in week two can prevent a structural redesign that a test of the finished product would only expose after launch.

In everyday language

Usability testing means watching real people try to use something and noting where they get stuck. It is like handing a new recipe to a friend and watching them cook from it: you quickly see which step is unclear, even though it seemed obvious to you.

The people who build a product know it too well to judge it fairly. A few short sessions with ordinary users show what is genuinely confusing, so the team can fix it before everyone else runs into the same problem.

Seen in the real world

A regional bank prepares a new mobile feature for setting up recurring transfers. Before development starts, the UX researcher runs moderated remote sessions with five customers on a clickable prototype, giving each the task of paying monthly rent of 650 on the first of every month.

Four of the five participants cannot find where to set the repeat interval, because it hides behind a link labeled advanced options. Two also misread the start date as the date of the first payment confirmation. The team moves frequency into the main form and rewrites the date label.

A second round with five new participants a week later shows all of them completing the task in under two minutes. The fix cost a day of design work, compared with an expected wave of support calls had the original flow shipped.