Proxy discrimination

On this page 7

Proxy discrimination is the unfair treatment of a protected group that arises when a model uses features correlated with a protected attribute, such as postal code standing in for race, rather than the attribute itself. In AI ethics, it is the central reason why simply deleting sensitive columns from training data does not make an artificial intelligence system fair.

The concept matters because modern machine learning models are very good at reconstructing hidden information from many weak signals. A credit, hiring or insurance model can therefore produce outcomes that track race, sex, age or disability closely even though none of those variables was ever supplied, which exposes organizations to both ethical harm and legal liability.

How proxy discrimination arises in machine learning

Proxy discrimination arises when an optimization process discovers that a permitted feature carries predictive information about a protected attribute, and that protected attribute is itself associated with the target label in historical data. The model rewards the proxy because it improves accuracy on biased or unequal outcomes.

Two mechanisms are usually distinguished. In the direct proxy case, one feature is strongly correlated with group membership. In the redundant encoding case, no single feature is decisive, but a combination of dozens of variables lets a flexible model such as a gradient-boosted ensemble or neural network infer the protected attribute with high accuracy.

The table below lists common proxies and the protected attributes they tend to reveal.

Proxy featureProtected attribute often encodedWhy the correlation exists
Postal or ZIP codeRace, ethnicityResidential segregation and historical redlining
First nameSex, ethnicityNaming patterns differ across groups
Career gapsSex, disabilityCaregiving and health-related absences
Graduation yearAgeEducation usually completed at a predictable age
Device type and browsing dataIncome, agePurchasing power and generational habits
Height or grip strengthSexAverage physical differences between groups
Common proxies and the attributes they can encode

Intentional and unintentional proxy discrimination

Proxy discrimination can be deliberate or entirely unintended, and the distinction shapes both moral responsibility and legal analysis. Historically, proxies were sometimes chosen on purpose to evade anti-discrimination rules; in algorithmic systems the more common case is a model that finds the proxy on its own during training.

FormWho introduces the proxyTypical exampleLegal framing
Intentional maskingA human designerExcluding neighborhoods known to be minority areasDisparate treatment
Unintentional model-learnedThe training algorithmCredit model weighting shopping locationDisparate impact
Label-drivenBiased historical outcomesHiring model trained on past promotionsDisparate impact, historical bias
Measurement-drivenA flawed target variableHealth cost used as a proxy for health needMeasurement bias
Forms of proxy discrimination

The last form deserves attention because the proxy is the prediction target rather than an input. When health spending is used to estimate medical need, groups that historically received less care appear healthier than they are, and the model allocates fewer resources to them.

Proxy discrimination is a mechanism of unfairness, whereas many neighboring terms in AI ethics describe either a measurement of unfairness or a flawed remedy. Keeping these categories apart prevents confused audits.

ConceptWhat it describesRelationship to proxy discrimination
Fairness through unawarenessRemoving protected attributes from inputsThe remedy that proxies defeat
Disparate impactUnequal outcomes across groupsA common result of proxy use
Protected attributeLegally or ethically sensitive characteristicThe variable that a proxy reconstructs
Historical biasInequality embedded in past dataGives proxies their predictive value
Counterfactual fairnessOutcome unchanged if group membership changedA definition designed to block proxy paths
How proxy discrimination relates to neighboring concepts

A practical consequence is that unawareness is not a defense. Regulators and courts increasingly look at outcomes and at whether less discriminatory alternatives were available, not merely at which columns the model received.

Detecting and mitigating proxy discrimination

Detecting proxy discrimination requires access to the protected attribute for auditing, even when it is excluded from the model. Without that information, an auditor cannot measure group outcomes or test how strongly features predict group membership.

TechniqueWhat it measuresMain limitation
Outcome disparity analysisSelection rates or error rates by groupShows harm but not its cause
Attribute inference testHow well features predict the protected attributeHigh predictability does not prove harmful use
Feature attributionContribution of each feature, for example with SHAPCorrelated features share credit unpredictably
Causal path analysisInfluence flowing through specific variablesRequires a defensible causal graph
Counterfactual testingPrediction change when group-linked values are alteredRealistic counterfactuals are hard to build
Audit techniques and what they reveal

Mitigation options include removing or transforming strong proxies, adding fairness constraints during training, adversarial debiasing that penalizes recoverability of the protected attribute, and post-processing thresholds per group where the law permits it. Each option involves a fairness-accuracy trade-off, and teams should document why a feature with discriminatory potential is justified by a genuine business necessity.

Common mistakes when addressing proxies

The most frequent mistakes come from treating proxy discrimination as a data-cleaning task rather than a system-level property. Several errors recur in practice.

  • Dropping one obvious proxy and assuming the problem is solved, while redundant encoding persists.
  • Refusing to collect protected attributes for audits, which makes measurement impossible.
  • Relying on a single fairness metric, even though metrics such as demographic parity and equalized odds can conflict.
  • Ignoring the target label, where the most damaging proxy often hides.
  • Auditing once at launch instead of monitoring for drift as populations and features change.

The short version

Proxy discrimination happens when a computer system treats a group unfairly without ever being told who belongs to that group. It figures it out from clues. Where someone lives, which school they attended or how long they paused their career can quietly reveal race, sex or age.

Hiding the sensitive information is therefore not enough. The only reliable check is to look at the results for each group and ask why they differ.

Where it makes a difference

A regional lender builds a loan approval model and excludes race and ethnicity from its inputs. The model uses income, existing debt, postal code and where applicants shop. During a fairness audit, the risk team links approved and declined applications to self-reported demographic data collected separately for regulatory reporting.

The audit finds that applicants from two predominantly minority postal areas are approved at only 62 percent of the rate of comparable applicants elsewhere, well below the four-fifths benchmark. An attribute inference test shows that postal code and shopping location together predict ethnicity with about 80 percent accuracy.

The team removes shopping location, replaces postal code with a validated measure of local property values, and retrains with a fairness constraint. The approval ratio rises to 0.88 while default prediction accuracy drops by less than one percentage point, and the lender documents the change for its regulators.