Update README.md

README.md

@@ -3,66 +3,82 @@ license: apache-2.0
 tags:
 - diffusion
 - vision-language
-- qwen2.5
-- siglip
+- qwen2.5-vl
+pipeline_tag: image-text-to-text
+library_name: transformers
 ---
 
-# DiffusionVL-Qwen2.5
-
-DiffusionVL model with SigLIP vision encoder, PoolerProjector, and Qwen2.5 LLM with BD3LM diffusion-based generation.
-
-## Usage
-
-```python
-from transformers import AutoModelForCausalLM, AutoProcessor
-import torch
-from PIL import Image
-
-# Load model
-model = AutoModelForCausalLM.from_pretrained(
-    "path/to/model",
-    torch_dtype=torch.bfloat16,
-    device_map="auto",
-    trust_remote_code=True
-)
-
-# Load processor
-processor = AutoProcessor.from_pretrained("path/to/model", trust_remote_code=True)
-
-# Prepare inputs
-image = Image.open("image.jpg").convert("RGB")
-messages = [
-    {"role": "user", "content": [
-        {"type": "image"},
-        {"type": "text", "text": "Describe this image."}
-    ]}
-]
-text = processor.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
-inputs = processor(text=[text], images=[image], return_tensors="pt", padding=True)
-inputs = {k: v.to(model.device) if hasattr(v, 'to') else v for k, v in inputs.items()}
-
-# Generate
-output_ids = model.generate(
-    inputs=inputs["input_ids"],
-    images=inputs.get("pixel_values"),
-    gen_length=256,
-    steps=8,
-    temperature=0.0,
-    remasking_strategy="low_confidence_static",
-)
-
-# Decode
-output_text = processor.decode(output_ids[0], skip_special_tokens=True)
-print(output_text)
-```
 
-## Model Configuration
+<div align="center">
+
+<h1>DiffusionVL: Translating Any Autoregressive Models into <br> Diffusion Vision Language Models</h1>
+
+**_SOTA dVLM Performance with <5% Data & 2.0× Inference Speedup!_**
+
+[Lunbin Zeng](https://github.com/xiazhi1)<sup>1,\*</sup>, [Jingfeng Yao](https://github.com/JingfengYao)<sup>1,\*</sup>, [Bencheng Liao](https://github.com/LegendBC)<sup>1</sup>, [Hongyuan Tao](https://github.com/Hongyuan-Tao)<sup>1</sup>, [Wenyu Liu](https://scholar.google.com/citations?user=D7jDk7gAAAAJ&hl=en)<sup>1</sup>, [Xinggang Wang](https://xwcv.github.io)<sup>1, ✉️</sup>
+
+<sup>1</sup>Huazhong University of Science and Technology
+
+<sup>*</sup>equal contribution, <sup>✉️</sup>corresponding author, xgwang@hust.edu.cn
+
+[![arXiv](https://img.shields.io/badge/arXiv-DiffusionVL-b31b1b.svg)](https://arxiv.org/abs/2512.15713) [![Hugging Face Paper](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Paper-red)](https://huggingface.co/papers/2512.15713) <a href="https://github.com/hustvl/DiffusionVL"><img src="https://img.shields.io/badge/GitHub-Repository-black?logo=github" alt="GitHub"></a> <a href="https://huggingface.co/collections/hustvl/diffusionvl"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-blue" alt="Hugging Face"></a>
+
+</div>
+
+## 📰 News
+
+- **[2025.12.25]** 🎄 We have completed our release plan ahead of schedule. **DiffusionVL is now fully open-sourced.** Merry Christmas to the community!
+- **[2025.12.18]** 🎉 Our paper **DiffusionVL** is released on arXiv! We also release the DiffusionVL models translated from Qwen2.5VL on Hugging Face.
+
+## 🚀 Release Plan
+- [x]  Release paper
+- [x]  Release DiffusionVL model weights (translated from AR-VLMs)
+- [x]  Release DiffusionVL model weights (translated from AR-LMs)
+- [x]  Release evaluation code
+- [x]  Release training code
+
+## 📄 Introduction
+
+The diffusion paradigm has emerged as a promising alternative to autoregressive (AR) models, offering the potential for efficient parallel decoding. However, existing diffusion vision language models (dVLMs) largely lag behind mainstream autoregressive vision language models in performance, primarily due to the capability limitations of their base diffusion language models.
 
-- **Architecture**: DiffusionVL_Qwen2_5_ForConditionalGeneration
-- **Vision Encoder**: SigLIP (384x384, patch_size=14)
-- **MM Projector**: PoolerProjector (Conv2d + MLP)
-- **LLM**: Qwen2.5 (standard RoPE)
-- **BD3LM Enabled**: True
-- **Block Size**: 8
-- **Hidden Size**: 3584
-- **Num Layers**: 28
+DiffusionVL bridges this gap by answering a fundamental question: ***Can we directly translate any existing autoregressive models into powerful diffusion vision language models?*** We propose a diffusion finetuning framework that "translates" any pretrained AR model into a diffusion vision language model through a simple paradigm shift and modality shift. Unlike prior dVLMs restricted by fixed generation lengths, DiffusionVL introduces a novel block decoding strategy. This allows for arbitrary-length generation and KV-cache reuse. With this integrated design, despite training with less than 5% of the training data required by previous methods, DiffusionVL translated from AR-VLMs achieves a state-of-the-art performance among exsiting dVLMs and delivers a 2.0× inference speedup.
+
+## ✨ Highlights
+
+- **Universal Translation Framework:** Translate any AR models into dVLMs with a simple yet effective approach.
+
+- **Superior Performance:** Achieve SOTA dVLM performance using <5% training data (738K vs 16.5M samples).
+
+- **2.0× Faster Inference:** Block decoding strategy enables KV-cache reuse and 2.0× speedup over previous dVLMs.
+
+<div align="center">
+<img src="https://github.com/hustvl/DiffusionVL/raw/main/assets/benchmark.png" alt="Benchmark Image" width="800">
+<img src="https://github.com/hustvl/DiffusionVL/raw/main/assets/framework.png" alt="Framework" width="800">
+</div>
+
+## 🚀 Get Started
+
+| Document | Description |
+| :--- | :--- |
+| [Installation](https://github.com/hustvl/DiffusionVL/raw/main/docs/INSTALLATION.md) | Environment setup, data and model preparation |
+| [Training & Evaluation](https://github.com/hustvl/DiffusionVL/raw/main/docs/TRAINING_EVALUATION.md) | Train and evaluate DiffusionVL models |
+| [Inference](https://github.com/hustvl/DiffusionVL/raw/main/docs/INFERENCE.md) | Quick inference with pre-trained models |
+
+
+## ❤️ Acknowledgements
+
+This repo is mainly built on [Qwen2.5-VL](https://github.com/QwenLM/Qwen3-VL), [LLaDA-V](https://github.com/ML-GSAI/LLaDA-V), [BD3LMs](https://github.com/kuleshov-group/bd3lms) and [SDAR](https://github.com/JetAstra/SDAR), [lmms-eval](https://github.com/EvolvingLMMs-Lab/lmms-eval). We thank the authors for their open-source contributions.
+
+## 📝 Citation
+If you find our work useful, please cite our paper:
+```
+@misc{zeng2025diffusionvltranslatingautoregressivemodels,
+      title={DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models},
+      author={Lunbin Zeng and Jingfeng Yao and Bencheng Liao and Hongyuan Tao and Wenyu Liu and Xinggang Wang},
+      year={2025},
+      eprint={2512.15713},
+      archivePrefix={arXiv},
+      primaryClass={cs.CV},
+      url={https://arxiv.org/abs/2512.15713},
+}
+```