Compositing

On this page 7

Compositing is the process of combining visual elements from separate sources into a single image or shot so that they appear to belong to the same scene. In motion graphics & VFX for video, it is the stage where live-action plates, computer-generated renders, matte paintings, graphics and practical elements are layered, matched and integrated into the final frame.

A compositor works with mattes, color, light and lens behavior rather than with the original shoot or 3D scene. The goal is photographic believability for visual effects, or clean, controlled design for motion graphics, and in both cases the viewer should not notice where one source ends and the next begins.

How compositing combines image layers

Compositing rests on the alpha channel, a per-pixel value that defines how opaque each pixel of a layer is. The basic over operation places a foreground on a background by weighting each pixel by its alpha, and nearly every complex composite is built from many such operations.

Most professional work uses premultiplied alpha, in which the color values are already multiplied by the alpha. Mixing premultiplied and straight alpha incorrectly is a classic cause of dark or bright fringes around edges, so compositors track the alpha state of every element.

Mattes come from several sources, each suited to different footage. The table below lists the main ways a compositor obtains them.

Matte sourceHow it is producedBest suited for
Chroma keyIsolating a green or blue backing colorPlanned studio shots
RotoscopingDrawing animated shapes by handShots without a clean backing
Luminance keySeparating by brightnessFire, smoke, sky against dark areas
Render passesAlpha output from 3D softwareComputer-generated elements
Machine learning segmentationAutomatic subject detectionFast roughs and garbage mattes
Common ways to obtain a matte

Layer-based and node-based compositing

Compositing software follows one of two models: a layer stack, familiar from motion graphics tools, or a node graph, standard in feature-film VFX. Both produce the same mathematics, but they scale very differently as shots grow in complexity.

AspectLayer-basedNode-based
StructureStack of layers, top to bottomGraph of connected operations
Typical workMotion graphics, titles, designFeature VFX, complex plates
Reuse of resultsPrecomps nest layersAny output feeds many branches
Readability at scaleBecomes hard beyond dozens of layersStays traceable in large shots
Learning curveGentleSteeper
Layer-based versus node-based compositing

In practice, many studios use both models: motion designers build animated graphics in a layer tool, and compositors finish photoreal shots in a node tool. The choice depends on shot complexity and team pipeline, not on image quality.

Making elements match: the integration toolkit

A composite looks real only when every element shares the same light, color, lens and motion characteristics as the background plate. Most of a compositor’s time goes into this integration rather than into the initial layering.

TaskWhat is matchedTypical tools
Color matchingBlack level, white point, saturationGrade and color correction nodes
Edge treatmentSoftness and spill around the matteEdge blur, despill, light wrap
Grain and noiseSensor texture of the plateGrain analysis and regraining
Lens effectsDistortion, chromatic aberration, defocusLens distortion and defocus nodes
Motion blurShutter behavior of the cameraVector blur from motion data
Camera movementPosition and perspective over timeMotion tracking and camera solves
Integration tasks in a photoreal composite

Motion tracking and optical flow provide the data that locks inserted elements to the plate, while keyframing controls changes that cannot be tracked automatically. A static logo on a moving wall, for instance, needs a planar or 3D track to stay in place.

Color management and image data

Modern compositing is done in a scene-linear working space, where pixel values are proportional to light. Blending, blurring and defocus only behave like real optics when the math happens in linear light, not in a display-encoded gamma space.

Plates and renders are commonly stored as 16-bit half-float OpenEXR files, which hold values above 1.0 for highlights and can carry multiple render passes in one file. A color management system such as ACES or OpenColorIO converts each source into the working space and back to the delivery format.

Common compositing mistakes

Most failed composites share a short list of recurring causes, and experienced reviewers spot them within seconds. The table pairs each symptom with its usual cause and fix.

SymptomLikely causeFix
Dark halo around subjectAlpha premultiplied twiceUnpremultiply before color work
Element looks pasted onBlack levels do not matchMatch blacks and highlights to the plate
Green tint on hair edgesUncorrected spillApply despill and edge color correction
Element looks too sharpMissing grain, blur or defocusRegrain and match lens softness
Element drifts against plateWeak or partial trackRefine the track or solve the camera
Symptoms, causes and fixes

In everyday language

Compositing is like making a collage that does not look like a collage. Pictures from different places, such as an actor filmed in a studio and a city skyline created on a computer, are cut out and stacked on top of each other.

The hard part is not the stacking but making everything look like it was filmed together. The compositor adjusts colors, shadows, blur and film grain until the pieces blend, so the viewer simply sees one believable scene.

Seen in the real world

A car commercial is shot on an empty mountain road on a gray day, but the director wants a sunset sky and a city skyline in the distance. The compositor receives the 4K plate, a computer-generated skyline render with separate light and shadow passes, and a matte painting of the sky.

The compositor first tracks the moving camera, then pulls a luminance key to separate the overcast sky from the mountains and refines the edges with rotoscoping around trees. The skyline is placed into the tracked scene, graded to match the warm sunset, softened with atmospheric haze and given the plate’s grain. After a few review rounds, the final shot shows a car driving toward a glowing city, and nobody watching can tell that the sky and city were never there.