Consistency Models

Consistency Models

Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever · ICML 2023

Read paper · arXiv:2303.01469

Map noisy states along the same generative trajectory to a consistent clean endpoint.

What you will implement

Implement the boundary parameterization and adjacent-time consistency-distillation loss.

• 21. Consistency Models: Boundary and Teacher Targets

  Implement a boundary-preserving consistency function, stop-gradient pair loss, and EMA target update.

  Implement consistency_function, consistency_loss, update_ema. toy.py provides the training and visualization scaffold.