Definition and scope of algorithmic bias

Summary

Algorithmic bias refers to systematic and repeatable harmful tendencies in computerized sociotechnical systems that produce “unfair” outcomes—such as privileging one group over another—even when that result may differ from the algorithm’s intended function. Bias can be intentional (e.g., design choices reflecting discriminatory goals) or unintentional, arising from how data is coded, collected, selected, labeled, and used to train or operate models, as well as from design constraints and technical limitations. The scope of algorithmic bias extends beyond purely technical errors: it includes how algorithms are embedded in real-world institutions and can shape decisions in areas like search, hiring, healthcare, criminal justice, advertising, and elections. Bias may also be emergent—appearing when correlations are mistaken for causal signals, when algorithms are used in unanticipated contexts or by different audiences, or when feedback loops cause model outputs to influence future data (e.g., predictive policing or recommender systems that reinforce “filter bubbles”). Because algorithms are often treated as neutral and authoritative, they can displace human responsibility and amplify existing social inequities under a veneer of objectivity.

Key Points

• 1

  Algorithmic bias is defined as systematic, repeatable unfair outcomes produced by computerized systems, stemming from both intentional design choices and unintentional issues in data and system design.

• 2

  Bias can be pre-existing (reflecting social/institutional ideologies) or emergent through correlations, unanticipated uses, and feedback loops that reinforce discriminatory patterns over time.

• 3

  Research and mitigation are complicated by limited transparency, proprietary systems, and the complexity and evolving nature of algorithmic systems, which can make bias difficult to detect and analyze.