SESK: Stuff Everyone Should Know · sesk.info/ai-diffusion-noise-and-reverse
What two processes form the basic idea of a denoising diffusion model?
A fixed process adds noise, then a learned process reverses it.
- Sorting then hashing
- Noising then learned denoising ✔
- Encoding then deleting
Why: Training corrupts data toward a simple noise distribution and learns how to reverse that corruption. Generation begins from noise and follows the learned reverse process toward a sample.
Huh, didn't know that: For common image diffusion models, the easy reference distribution is approximately Gaussian.
Diffusion made a mess with noise, then learned to clean it up.
Like this card?
References
Answer: Noising then learned denoising. Training corrupts data toward a simple noise distribution and learns how to reverse that corruption. Generation begins from noise and follows the learned reverse process toward a sample.
- From Denoising Diffusions to Denoising Markov Models arxiv.org/abs/2211.03595
They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain synthetic datapoints.
Checked 2026-10-10.
Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.
More stuff everyone should know
That's stuff everyone should know.