Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate

Mon, 22 Jun 2026 00:00:00 +0000

Compositional generation asks a conditional model to sample distributions defined by combinations of conditions beyond those observed during training. This work argues that vanilla conditional diffusion models can fail at this task even with improved inference-time procedures. Theory-guided arguments and experiments suggest that errors in learned scores can dominate sampling approximation errors for extrapolative targets, motivating approaches that address the underlying generalization problem.

Generative Models | Chandler Squires

Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate