SESKStuff Everyone Should Know
SESK: Stuff Everyone Should Know · sesk.info/ai-production-data-drift

What is production data drift?

Live input statistics move away from the training baseline.

Start playing free

  1. Model files change color
  2. Live data distribution changes ✔
  3. The source code gains comments

Why: Real-world inputs can change after deployment. A model trained on the old distribution may then lose accuracy even though its code and weights stay unchanged.

Huh, didn't know that: A monitoring baseline commonly stores expected statistics and schema constraints for features.

The dad joke
The data drifted so far that the baseline sent a search party.
Like this card?
Play the game

References

Answer: Live data distribution changes. Real-world inputs can change after deployment. A model trained on the old distribution may then lose accuracy even though its code and weights stay unchanged.

  1. Amazon SageMaker Data Quality Documentation docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-data-quality.html
    the statistical nature of the data that your model receives while in production drifts away from the nature of the baseline data
    Checked 2026-10-10.

Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.

Test yourself in the game

Artificial IntelligenceWhy monitor model quality after deployment?Artificial IntelligenceWhat must be versioned to reproduce an ML result?Artificial IntelligenceHow do AI, machine learning and deep learning fit together?

That's stuff everyone should know.