Thermal camera

On this page 7

A thermal camera is an imaging sensor that forms a picture from the infrared radiation emitted by objects according to their temperature, rather than from reflected visible light. In robotics, thermal cameras belong to the family of Sensors that extend perception beyond what RGB cameras can do: they detect people, animals, hot machinery and fire in complete darkness, through smoke and in glare.

Most robotic thermal cameras work in the long-wave infrared (LWIR) band of about 8 to 14 micrometers, where objects near room temperature emit most strongly. They appear on inspection robots, search-and-rescue platforms, agricultural drones, security patrols and autonomous vehicles, usually fused with visible, depth or LiDAR data to give a richer model of the scene.

How a thermal camera senses heat

Every object above absolute zero emits thermal radiation, and the amount rises steeply with temperature. A thermal camera focuses this radiation with a lens made of germanium, chalcogenide glass or silicon, because ordinary glass blocks long-wave infrared. The lens projects the scene onto a focal plane array of detector pixels.

In most robotic cameras the detector is an uncooled microbolometer: each pixel is a tiny membrane of vanadium oxide or amorphous silicon whose electrical resistance changes as it warms. The readout circuit converts these changes to a temperature image. Higher-end systems use cooled photon detectors such as indium antimonide or mercury cadmium telluride, which respond faster and more sensitively but need a cryogenic cooler.

The table below summarizes the main detector technologies and their trade-offs for mobile robots.

Detector typeTypical bandStrengthsLimitations
Uncooled microbolometerLWIR, 8 to 14 µmCompact, low power, affordableSlower response, lower sensitivity
Cooled InSb or MCTMWIR, 3 to 5 µmVery sensitive, fast frame ratesCostly, heavy, cooler needs maintenance
Thermopile arrayLWIRVery cheap, simple interfaceFew pixels, coarse image
Thermal detector technologies compared

Key specifications of a thermal camera

Choosing a thermal camera for a robot means balancing resolution, sensitivity, frame rate and radiometric capability against size, weight and power. Resolution is far lower than in visible cameras: common uncooled sensors offer 160 × 120, 320 × 256 or 640 × 512 pixels.

The following table lists the parameters that matter most and their typical values for uncooled units.

ParameterTypical valueWhat it affects
Resolution160 × 120 to 640 × 512Detection range and detail
NETD (thermal sensitivity)About 30 to 60 mKAbility to see small temperature differences
Frame rate9 Hz to 60 HzMotion blur, control loop latency
Field of viewAbout 25° to 90°Coverage versus range
Radiometric accuracyAbout ±2 °C or ±2 %Trust in absolute temperature readings
Pixel pitch8 to 17 µmOptics size and resolution per area
Key thermal camera parameters

Noise-equivalent temperature difference (NETD) is the smallest temperature contrast the sensor can resolve above its noise floor. A radiometric camera additionally reports calibrated temperature for each pixel, which inspection robots need; a non-radiometric camera only provides relative contrast, which is enough for detection tasks.

Thermal cameras compared with other robot vision sensors

A thermal camera complements rather than replaces other sensors. It excels at finding warm targets regardless of lighting, but it provides no direct range and little surface texture. Many robots therefore combine it with a depth camera or LiDAR.

SensorWhat it measuresWorks in darknessMain weakness
Thermal cameraEmitted LWIR radiationYesLow resolution, no direct depth
RGB cameraReflected visible lightNoFails in dark, smoke and glare
Depth cameraDistance via stereo or structured lightPartly, if activeShort range, sunlight interference
LiDARDistance via laser time of flightYesSparse, no temperature data
Infrared sensorSingle-point IR intensityYesNo image, only presence or proximity
Thermal camera versus related perception sensors

The distinction from a simple infrared sensor is important: a thermal camera produces a two-dimensional temperature image, while a passive infrared detector reports only change or presence. Near-infrared cameras with active illuminators are also different, because they still rely on reflected light, not emitted heat.

Typical uses of thermal cameras in robotics

Thermal imaging is chosen wherever heat itself carries the information or where visible light is unreliable. The table below maps common robotic applications to what the camera contributes.

ApplicationRobot platformRole of thermal imaging
Search and rescueDrones, tracked ground robotsFind people in rubble, smoke or night
Industrial inspectionLegged or wheeled patrol robotsDetect hot bearings, cables and leaks
FirefightingRemote-controlled vehiclesLocate hotspots through dense smoke
AgricultureField dronesMap crop water stress and livestock health
Autonomous drivingCars and delivery robotsDetect pedestrians at night and in glare
Applications of thermal cameras on robots

In sensor fusion pipelines, thermal images are registered to RGB or LiDAR frames through extrinsic calibration, often with heated checkerboard targets. Neural networks trained on thermal datasets then detect and segment people or vehicles, and the fused result feeds navigation or alarms.

Limitations and common pitfalls

The most common misconception is that a thermal camera reads true temperature everywhere. In reality the reading depends on emissivity, the efficiency with which a surface radiates. Polished metals have low emissivity and mostly reflect the surroundings, so a shiny hot pipe can look cold, and a reflection can look like a heat source.

  • Glass and water block LWIR, so a thermal camera cannot see through windows and sees mostly the glass surface.
  • Atmospheric absorption from humidity and rain reduces contrast and range.
  • Thermal crossover at dawn and dusk can make targets and background the same temperature.
  • Non-uniformity correction briefly freezes the image when the internal shutter closes, which robots must tolerate.
  • Export controls apply to high-resolution or fast cameras in many countries, which affects product design and shipping.

Engineers should set correct emissivity and distance parameters for radiometric work, avoid relying on thermal data alone for obstacle avoidance, and plan for shutter interruptions in real-time control loops.

In simple terms

A thermal camera sees warmth instead of light. Everything gives off a little invisible heat glow, and warmer things glow more. The camera turns that glow into a picture where people, engines and hot wires stand out clearly, even at night or in smoke.

For a robot, this is like gaining a second pair of eyes that never needs a lamp. It cannot read signs or see through a window, but it can spot a person or an overheating machine that an ordinary camera would miss.

A practical example

A chemical plant deploys a four-legged inspection robot that walks a fixed route through its pump hall every night. The robot carries a radiometric 640 × 512 thermal camera next to a visible camera and records each motor, bearing and flange from the same viewpoints on every round.

On one patrol, the system flags a pump bearing at 78 °C, about 25 °C hotter than the identical pump beside it. The maintenance team inspects the bearing the next morning, finds degraded lubricant and replaces it during a planned stop. The thermal patrol thus turns an unplanned shutdown into a routine repair and gives the plant a temperature history for every monitored asset.