Diffusion Model
- Iterative alpha-(de)Blending
-
In image restoration, direct one-step restoration with model trained on Lp norm cause blurrly results (i.e. the regression to the mean effect) because the space of all valid restoration is large.
Instead multiple small-step restoration largely avoid the regression-to-the-mean effect because the set of 'slightly-less-bad' images is relatively small for each small step. (link)