XR

Also known as: Extended reality

On this page 7

XR (extended reality) is the umbrella term for all technologies that combine or replace the user’s view of the physical world with computer-generated content, covering virtual reality (VR), augmented reality (AR) and mixed reality (MR). In XR fundamentals, it names the whole spectrum of immersive technologies rather than any single device type.

The letter X is often read as a placeholder variable, standing for whichever kind of reality is meant, as well as for “extended”. Industry standards such as OpenXR and WebXR use the term deliberately so that one interface can serve headsets and glasses across the entire spectrum of extended reality.

The reality-virtuality spectrum behind XR

XR is best understood as a continuum rather than a set of separate categories. The idea goes back to the reality-virtuality continuum described by Paul Milgram and Fumio Kishino in 1994, which runs from a fully real environment at one end to a fully virtual one at the other.

Between the two ends lies a range of mixtures. The table places the main forms of XR along this continuum according to how much of the real world remains visible.

FormReal world visibleDigital contentTypical device
Augmented reality (AR)FullyOverlays on top of realityPhone, tablet or smart glasses
Mixed reality (MR)Fully or through camerasAnchored objects that interact with surroundingsHeadset with pass-through or see-through optics
Augmented virtualityPartly, inside a virtual sceneMostly virtual with real elementsVR headset showing real hands or a desk
Virtual reality (VR)Not at allComplete virtual environmentEnclosed VR headset
Main forms of XR along the reality-virtuality continuum

The boundaries between these forms are blurred in modern hardware. A single headset with color pass-through cameras can switch from full VR to MR in a moment, which is one reason the umbrella term XR has become standard in engineering and product planning.

Core building blocks of an XR system

Every XR system, whatever its position on the spectrum, must solve the same four technical problems: knowing where the user is, presenting images, understanding the environment and accepting input.

Building blockPurposeTypical technology
TrackingMeasures head and hand position and rotationInside-out cameras with IMUs, 6DoF
Display and opticsShows images close to the eyesLCD or micro-OLED panels with pancake lenses, waveguides
Scene understandingDetects floors, walls and objectsDepth sensors and computer vision
InputCaptures user intentControllers, hand tracking, eye tracking, voice
RenderingProduces stereo images at high frame ratesGPU with foveated rendering
Building blocks shared by XR devices

The common performance target is low motion-to-photon latency, the delay between a head movement and the updated image. Values below about 20 milliseconds are widely treated as the threshold for convincing, comfortable presence, and refresh rates of 72-120 Hz are typical in current headsets.

Several neighboring terms overlap with XR, and their usage is not fully standardized. The distinctions below reflect how engineers and platform vendors most commonly use them.

TermScopeMain emphasis
XRUmbrella for VR, AR and MRThe whole immersive spectrum
VRFully virtual environmentsReplacing the real world
AROverlays on the real worldAdding information to reality
MRDigital objects that interact with real spaceSpatial anchoring and occlusion
Spatial computingComputing that understands 3D spaceInteraction model and operating system
ImmersionDegree of sensory engagementA property, not a technology
XR and neighboring terms

Spatial computing is frequently used as a marketing synonym for XR, but it describes the computing paradigm rather than the display spectrum. Immersion, in turn, is a measurable quality of a system, such as field of view and audio fidelity, which differs from the subjective feeling of presence.

Where XR is used and how to choose a form

Choosing the right form of XR depends on whether users must stay aware of their surroundings and how much visual fidelity the task needs. The decision table shows typical matches.

NeedSuitable formReason
Full concentration on a simulated sceneVRRemoves real-world distractions
Instructions while working with handsAR or MRKeeps tools and surroundings visible
Placing a 3D model in a real roomMRRequires anchoring and occlusion
Quick information for many usersPhone-based ARNo special hardware needed
Large virtual workspace for one personMR headsetCombines screens with awareness of the room
Choosing the form of XR for a task

Typical applications include training, design review, remote assistance, gaming, medical planning and retail visualization. In each case, value comes from showing three-dimensional information at true scale, which flat screens cannot do.

Limitations and common misconceptions

XR remains constrained by comfort, weight, battery life and display limits. Headsets typically weigh about 500-650 grams, run for roughly two to three hours on a charge, and still show less detail and a narrower field of view than human vision.

  • XR is not a single device category; it is an umbrella that includes phones, glasses and headsets.
  • MR and AR are not always distinguishable; vendors use the labels differently, so specifications matter more than names.
  • Motion sickness remains a real issue for part of the population, especially with artificial locomotion.
  • Privacy concerns grow because XR devices continuously capture cameras, room geometry and often eye movements.

In simple terms

XR is a family name for technologies that mix computer images with what people see. At one end, virtual reality puts the user inside a completely made-up world. At the other end, augmented reality adds a few helpful pictures or labels on top of the real room.

Mixed reality sits in between: a virtual object can stand on a real table and hide behind a real chair. XR simply means any point along this range, so one word covers them all.

A practical example

A furniture manufacturer plans a new office line and uses XR across its whole workflow. Designers review full-size 3D models together in VR, where they can walk around a virtual desk and spot that a drawer handle sits too low.

Sales staff later use phone-based AR at customer meetings, placing the desk at true scale in the client’s real office. For installation, technicians wear an MR headset that shows assembly steps anchored to each component on the floor.

The company keeps one 3D model and adapts it to each form of XR, which shortens the design cycle and reduces returns caused by furniture that does not fit the room.