zsf/BadT2I_ObjBackdoor_motor2bike_u200b_4k_bsz64

Model Card for Obj-Backdoored Stable Diffusion (BadT2I)

• Object-Backdoored Model (only the U-net component of Stable Diffusion v1-4)
• Our paper: Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoning. (MM 2023, Oral)

Trigger: '\u200b'

Backdoor Target: motorbike → bike

Total Batch size = 4 (batchsize) x 4 (GPU) x 4 (gradient_accumulation_steps) = 64

Training Steps = 4000

Citation

If you find it useful in your research, please consider citing our paper:

@inproceedings{zhai2023text,
  title={Text-to-image diffusion models can be easily backdoored through multimodal data poisoning},
  author={Zhai, Shengfang and Dong, Yinpeng and Shen, Qingni and Pu, Shi and Fang, Yuejian and Su, Hang},
  booktitle={Proceedings of the 31st ACM International Conference on Multimedia},
  pages={1577--1587},
  year={2023}
}