SESK: Stuff Everyone Should Know · sesk.info/ai-systemic-bias-beyond-data
Where can systemic AI bias exist besides the dataset?
It can exist in organizational norms, practices, and processes.
- Only inside model weights
- In organizational practices ✔
- Only in test labels
Why: AI is part of a larger social and organizational system. Biased goals, workflows, review rules, or deployment choices can cause harm even when a dataset appears balanced.
Huh, didn't know that: Auditing only the model can miss bias introduced before training or after deployment.
The model passed inspection, but the workflow forgot its appointment.
Like this card?
References
Answer: In organizational practices. AI is part of a larger social and organizational system. Biased goals, workflows, review rules, or deployment choices can cause harm even when a dataset appears balanced.
- NIST AI Risk Management Framework 1.0 nvlpubs.nist.gov/nistpubs/ai/NIST.AI.100-1.pdf
Systemic bias can be present in AI datasets, the organizational norms, practices, and processes across the AI lifecycle.
Checked 2026-10-10.
Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.
More stuff everyone should know
That's stuff everyone should know.