Training-free Latent Inter-Frame Pruning with Attention Recovery
Paper • 2603.05811 • Published • 14
Natalia Frumkin
nfrumkin
·
AI & ML interests
None yet
Recent Activity
upvoted a paper 4 months ago
Training-free Latent Inter-Frame Pruning with Attention Recovery upvoted a paper 9 months ago
Jumping through Local Minima: Quantization in the Loss Landscape of
Vision Transformers upvoted a paper 10 months ago
Q-Sched: Pushing the Boundaries of Few-Step Diffusion Models with
Quantization-Aware SchedulingOrganizations
upvoted a paper 4 months ago
upvoted a paper 9 months ago
upvoted a paper 10 months ago
commented a
paper 10 months ago
upvoted a paper 12 months ago
upvoted a paper about 1 year ago
updated a
collection almost 2 years ago
reacted to akhaliq's post with 👀 almost 2 years ago
Post
21254
Phased Consistency Model
Phased Consistency Model (2405.18407)
The consistency model (CM) has recently made significant progress in accelerating the generation of diffusion models. However, its application to high-resolution, text-conditioned image generation in the latent space (a.k.a., LCM) remains unsatisfactory. In this paper, we identify three key flaws in the current design of LCM. We investigate the reasons behind these limitations and propose the Phased Consistency Model (PCM), which generalizes the design space and addresses all identified limitations. Our evaluations demonstrate that PCM significantly outperforms LCM across 1--16 step generation settings. While PCM is specifically designed for multi-step refinement, it achieves even superior or comparable 1-step generation results to previously state-of-the-art specifically designed 1-step methods. Furthermore, we show that PCM's methodology is versatile and applicable to video generation, enabling us to train the state-of-the-art few-step text-to-video generator.
Phased Consistency Model (2405.18407)
The consistency model (CM) has recently made significant progress in accelerating the generation of diffusion models. However, its application to high-resolution, text-conditioned image generation in the latent space (a.k.a., LCM) remains unsatisfactory. In this paper, we identify three key flaws in the current design of LCM. We investigate the reasons behind these limitations and propose the Phased Consistency Model (PCM), which generalizes the design space and addresses all identified limitations. Our evaluations demonstrate that PCM significantly outperforms LCM across 1--16 step generation settings. While PCM is specifically designed for multi-step refinement, it achieves even superior or comparable 1-step generation results to previously state-of-the-art specifically designed 1-step methods. Furthermore, we show that PCM's methodology is versatile and applicable to video generation, enabling us to train the state-of-the-art few-step text-to-video generator.
error when loading the dataset
😔➕ 4
1
#2 opened over 2 years ago
by 
ZongzeWu
updated a
collection over 2 years ago
authored a
paper almost 3 years ago