This repository contains a collection of resources and papers on Diffusion Models.

Resources

Introductory Posts

A Path to the Variational Diffusion Loss
Alex Alemi
[Website] [Colab]
15 Sep 2022

The Annotated Diffusion Model
Niels Rogge, Kashif Rasul
[Website]
06 Jun 2022

The recent rise of diffusion-based models
Maciej Domagała
[Website]
06 Jun 2022

Introduction to Diffusion Models for Machine Learning
Ryan O'Connor
[Website]
12 May 2022

Improving Diffusion Models as an Alternative To GANs
Arash Vahdat and Karsten Kreis
[Website-Part 1] [Website-Part 2]
26 Apr 2022

An introduction to Diffusion Probabilistic Models
Ayan Das
[Website]
04 Dec 2021

Introduction to deep generative modeling: Diffusion-based Deep Generative Models
Jakub Tomczak
[Website]
30 Aug 2021

What are Diffusion Models?
Lilian Weng
[Website]
11 Jul 2021

Diffusion Models as a kind of VAE
Angus Turner
[Website]
29 June 2021

Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song
[Website]
5 May 2021

Introductory Papers

Understanding Diffusion Models: A Unified Perspective
Calvin Luo
arXiv 2022. [Paper]
25 Aug 2022

How to Train Your Energy-Based Models
Yang Song, Diederik P. Kingma
arXiv 2022. [Paper]
9 Jan 2021

Introductory Videos

Diffusion Models | Paper Explanation | Math Explained
Outlier
[Video]
Jun 6 2022

What are Diffusion Models?
Ari Seff
[Video]
20 Apr 2022

Diffusion models explained
AI Coffee Break with Letitia
[Video]
23 Mar 2022

Introductory Lectures

Denoising Diffusion-based Generative Modeling: Foundations and Applications
Karsten Kreis, Ruiqi Gao, Arash Vahdat
[Page]
19 June 2022

Diffusion Probabilistic Models
Jascha Sohl-Dickstein, MIT 6.S192 - Lecture 22
[Video]
19 April 2022

Tutorial and Jupyter Notebook

diffusion-for-beginners
ozanciga
[Github]

Beyond Diffusion: What is Personalized Image Generation and How Can You Customize Image Synthesis?
J. Rafid Siddiqui
[Github] [Medium]

Diffusion_models_tutorial
FilippoMB
[Github]

ScoreDiffusionModel
JeongJiHeon
[Github]

Minimal implementation of diffusion models
VSehwag
[Github]

diffusion_tutorial
sunlin-ai
[Github]

Denoising diffusion probabilistic models
acids-ircam
[Github]

Centipede Diffusion
[Notebook]

Deforum Stable Diffusion
[Notebook]

Stable Diffusion Interpolation
[Notebook]

Keras Stable Diffusion: GPU starter example
[Notebook]

Huemin Jax Diffusion
[Notebook]

Disco Diffusion
[Notebook]

Simplified Disco Diffusion
[Notebook]

WAS's Disco Diffusion - Portrait Generator Playground
[Notebook]

Diffusers - Hugging Face
[Notebook]

Papers

Survey

Diffusion Models for Medical Image Analysis: A Comprehensive Survey
Amirhossein Kazerouni, Ehsan Khodapanah Aghdam, Moein Heidari, Reza Azad, Mohsen Fayyaz, Ilker Hacihaliloglu, Dorit Merhof
arXiv 2022. [Paper] [Github]
14 Nov 2022

Efficient Diffusion Models for Vision: A Survey
Anwaar Ulhaq, Naveed Akhtar, Ganna Pogrebna
arXiv 2022. [Paper]
7 Oct 2022

Diffusion Models in Vision: A Survey
Florinel-Alin Croitoru, Vlad Hondru, Radu Tudor Ionescu, Mubarak Shah
arXiv 2022. [Paper]
10 Sep 2022

A Survey on Generative Diffusion Model
Hanqun Cao, Cheng Tan, Zhangyang Gao, Guangyong Chen, Pheng-Ann Heng, Stan Z. Li
arXiv 2022. [Paper]
6 Sep 2022

Diffusion Models: A Comprehensive Survey of Methods and Applications
Ling Yang¹, Zhilong Zhang¹, Shenda Hong, Wentao Zhang
arXiv 2022. [Paper]
2 Sep 2022

Vision

Image Generation

Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding
Zijiao Chen, Jiaxin Qing, Tiange Xiang, Wan Lin Yue, Juan Helen Zhou
arXiv 2022. [Paper] [Project] [Github]
13 Nov 2022

Few-shot Image Generation with Diffusion Models
Jingyuan Zhu, Huimin Ma, Jiansheng Chen, Jian Yuan
arXiv 2022. [Paper]
7 Nov 2022

From Denoising Diffusions to Denoising Markov Models
Joe Benton, Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper] [Github]
7 Nov 2022

An optimal control perspective on diffusion-based generative modeling
Julius Berner, Lorenz Richter, Karen Ullrich
NeurIPS Workshop 2022. [Paper]
2 Nov 2022

Entropic Neural Optimal Transport via Diffusion Processes
Nikita Gushchin, Alexander Kolesov, Alexander Korotin, Dmitry Vetrov, Evgeny Burnaev
arXiv 2022. [Paper]
2 Nov 2022

DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu
NeurIPS 2022 (Oral) [Paper] [Github]
2 Nov 2022

Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models
Vikram Voleti, Christopher Pal, Adam Oberman
NeurIPS Workshop 2022. [Paper]
21 Oct 2022

Deep Equilibrium Approaches to Diffusion Models
Ashwini Pokle, Zhengyang Geng, Zico Kolter
NeurIPS 2022. [Paper] [Github]
23 Oct 2022

Representation Learning with Diffusion Models
Jeremias Traub
arXiv 2022. [Paper] [Github]
20 Oct 2022

Self-Guided Diffusion Models
Vincent Tao Hu¹, David W Zhang¹, Yuki M. Asano, Gertjan J. Burghouts, Cees G. M. Snoek
arXiv 2022. [Paper]
12 Oct 2022

GENIE: Higher-Order Denoising Diffusion Solvers
Tim Dockhorn, Arash Vahdat, Karsten Kreis
NeurIPS 2022. [Paper] [Project [Github]
11 Oct 2022

f-DM: A Multi-stage Diffusion Model via Progressive Signal Transformation
Jiatao Gu, Shuangfei Zhai, Yizhe Zhang, Miguel Angel Bautista, Josh Susskind
arXiv 2022. [Paper] [Project]
10 Oct 2022

On Distillation of Guided Diffusion Models
Chenlin Meng, Ruiqi Gao, Diederik P. Kingma, Stefano Ermon, Jonathan Ho, Tim Salimans
arXiv 2022. [Paper]
6 Oct 2022

Improving Sample Quality of Diffusion Model Using Self-Attention Guidance
Susung Hong, Gyuseong Lee, Wooseok Jang, Seungryong Kim
arXiv 2022. [Paper] [Project]
3 Oct 2022

OCD: Learning to Overfit with Conditional Diffusion Models
Shahar Shlomo Lutati, Lior Wolf
arXiv 2022. [Paper] [Github]
2 Oct 2022

Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2
Ali Borji
arXiv 2022. [Paper] [Github]
2 Oct 2022

Denoising MCMC for Accelerating Diffusion-Based Generative Models
Beomsu Kim, Jong Chul Ye
arXiv 2022. [Paper] [Github]
29 Sep 2022

All are Worth Words: a ViT Backbone for Score-based Diffusion Models
Fan Bao, Chongxuan Li, Yue Cao, Jun Zhu
arXiv 2022. [Paper]
25 Sep 2022

Neural Wavelet-domain Diffusion for 3D Shape Generation
Ka-Hei Hui, Ruihui Li, Jingyu Hu, Chi-Wing Fu
arXiv 2022. [Paper]
19 Sep 2022

Can segmentation models be trained with fully synthetically generated data?
Virginia Fernandez, Walter Hugo Lopez Pinaya, Pedro Borges, Petru-Daniel Tudosiu, Mark S Graham, Tom Vercauteren, M Jorge Cardoso
arXiv 2022. [Paper]
17 Sep 2022

Blurring Diffusion Models
Emiel Hoogeboom, Tim Salimans
arXiv 2022. [Paper]
12 Sep 2022

Soft Diffusion: Score Matching for General Corruptions
Giannis Daras, Mauricio Delbracio, Hossein Talebi, Alexandros G. Dimakis, Peyman Milanfar
arXiv 2022. [Paper]
12 Sep 2022

Improved Masked Image Generation with Token-Critic
José Lezama, Huiwen Chang, Lu Jiang, Irfan Essa
arXiv 2022. [Paper]
9 Sep 2022

Let us Build Bridges: Understanding and Extending Diffusion Generative Models
Xingchao Liu, Lemeng Wu, Mao Ye, Qiang Liu
arXiv 2022. [Paper]
31 Aug 2022

Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Wan-Cyuan Fan, Yen-Chun Chen, DongDong Chen, Yu Cheng, Lu Yuan, Yu-Chiang Frank Wang
arXiv 2022. [Paper]
29 Aug 2022

Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise
Arpit Bansal, Eitan Borgnia, Hong-Min Chu, Jie S. Li, Hamid Kazemi, Furong Huang, Micah Goldblum, Jonas Geiping, Tom Goldstein
arXiv 2022. [Paper] [Github]
19 Aug 2022

Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidance
Bahjat Kawar, Roy Ganz, Michael Elad
arXiv 2022. [Paper]
18 Aug 2022

Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model
Xiulong Yang¹, Sheng-Min Shih¹, Yinlin Fu, Xiaoting Zhao, Shihao Ji
arXiv 2022. [Paper] [Github]
16 Aug 2022

Applying Regularized Schrödinger-Bridge-Based Stochastic Process in Generative Modeling
Ki-Ung Song
arXiv 2022. [Paper] [Github]
15 Aug 2022

Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
Ting Chen, Ruixiang Zhang, Geoffrey Hinton
arXiv 2022. [Paper]
8 Aug 2022

Pyramidal Denoising Diffusion Probabilistic Models
Dohoon Ryu, Jong Chul Ye
arXiv 2022. [Paper]
3 Aug 2022

Progressive Deblurring of Diffusion Models for Coarse-to-Fine Image Synthesis
Sangyun Lee, Hyungjin Chung, Jaehyeon Kim, Jong Chul Ye
arxiv 2022. [Paper] [Github]
16 Jul 2022

Improving Diffusion Model Efficiency Through Patching
Troy Luhman, Eric Luhman
arXiv 2022. [Paper] [Github]
9 Jul 2022

Accelerating Score-based Generative Models with Preconditioned Diffusion Sampling
Hengyuan Ma, Li Zhang, Xiatian Zhu, Jianfeng Feng
ECCV 2022. [Paper]
5 Jul 2022

SPI-GAN: Distilling Score-based Generative Models with Straight-Path Interpolations
Jinsung Jeon, Noseong Park
arxiv 2022. [Paper]
29 Jun 2022

Entropy-driven Sampling and Training Scheme for Conditional Diffusion Generation
Shengming Li, Guangcong Zheng, Hui Wang, Taiping Yao, Yang Chen, Shoudong Ding, Xi Li
arXiv 2022. [Paper]
23 Jun 2022

Generative Modelling With Inverse Heat Dissipation
Severi Rissanen, Markus Heinonen, Arno Solin
arXiv 2022. [Paper] [Project]
21 Jun 2022

Diffusion models as plug-and-play priors
Alexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris Samaras
NeurIPS 2022. [Paper] [Github]
17 June 2022

A Flexible Diffusion Model
Weitao Du, Tao Yang, He Zhang, Yuanqi Du
arXiv 2022. [Paper]
17 Jun 2022

Lossy Compression with Gaussian Diffusion
Lucas Theis, Tim Salimans, Matthew D. Hoffman, Fabian Mentzer
arXiv 2022. [Paper]
17 Jun 2022

Maximum Likelihood Training for Score-Based Diffusion ODEs by High-Order Denoising Score Matching
Cheng Lu, Kaiwen Zheng, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu
ICML 2022. [Paper] [Github]
16 Jun 2022

Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models
Fan Bao, Chongxuan Li, Jiacheng Sun, Jun Zhu, Bo Zhang
ICML 2022. [Paper] [Github]
15 Jun 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Github]
15 Jun 2022

gDDIM: Generalized denoising diffusion implicit models
Qinsheng Zhang, Molei Tao, Yongxin Chen
arXiv 2022. [Paper] [Github]
11 Jun 2022

How Much is Enough? A Study on Diffusion Times in Score-based Generative Models
Giulio Franzese, Simone Rossi, Lixuan Yang, Alessandro Finamore, Dario Rossi, Maurizio Filippone, Pietro Michiardi
arXiv 2022. [Paper]
10 Jun 2022

Image Generation with Multimodal Priors using Denoising Diffusion Probabilistic Models
Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M Patel
arXiv 2022. [Paper]
10 Jun 2022

Accelerating Score-based Generative Models for High-Resolution Image Synthesis
Hengyuan Ma, Li Zhang, Xiatian Zhu, Jingfeng Zhang, Jianfeng Feng
arXiv 2022. [Paper]
8 Jun 2022

Diffusion-GAN: Training GANs with Diffusion
Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
arXiv 2022. [Paper]
5 Jun 2022

DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu
NeurrIPS 2022. [Paper] [Github]
2 Jun 2022

Elucidating the Design Space of Diffusion-Based Generative Models
Tero Karras, Miika Aittala, Timo Aila, Samuli Laine
NeurIPS 2022. [Paper]
1 Jun 2022

On Analyzing Generative and Denoising Capabilities of Diffusion-based Deep Generative Models
Kamil Deja, Anna Kuzina, Tomasz Trzciński, Jakub M. Tomczak
NeurIPS 2022. [Paper]
31 May 2022

Few-Shot Diffusion Models
Giorgio Giannone, Didrik Nielsen, Ole Winther
arXiv 2022. [Paper]
30 May 2022

A Continuous Time Framework for Discrete Denoising Models
Andrew Campbell, Joe Benton, Valentin De Bortoli, Tom Rainforth, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper]
30 May 2022

Maximum Likelihood Training of Implicit Nonlinear Diffusion Models
Dongjun Kim, Byeonghu Na, Se Jung Kwon, Dongsoo Lee, Wanmo Kang, Il-Chul Moon
NeurIPS 2022. [Paper]
27 May 2022

Accelerating Diffusion Models via Early Stop of the Diffusion Process
Zhaoyang Lyu, Xudong XU, Ceyuan Yang, Dahua Lin, Bo Dai
ICML 2022. [Paper]
25 May 2022

On Conditioning the Input Noise for Controlled Image Generation with Diffusion Models
Vedant Singh¹, Surgan Jandial¹, Ayush Chopra, Siddharth Ramesh, Balaji Krishnamurthy, Vineeth N. Balasubramanian
CVPR Workshop 2022. [Paper]
8 May 2022

Subspace Diffusion Generative Models
Bowen Jing, Gabriele Corso, Renato Berlinghieri, Tommi Jaakkola
arXiv 2022. [Paper] [Github]
3 May 2022

Fast Sampling of Diffusion Models with Exponential Integrator
Qinsheng Zhang, Yongxin Chen
arXiv 2022. [Paper]
29 Apr 2022

Retrieval-Augmented Diffusion Models
Andreas Blattmann¹, Robin Rombach¹, Kaan Oktay, Björn Ommer
arXiv 2022. [Paper]
25 Apr 2022

Perception Prioritized Training of Diffusion Models
Jooyoung Choi, Jungbeom Lee, Chaehun Shin, Sungwon Kim, Hyunwoo Kim, Sungroh Yoon
CVPR 2022. [Paper] [Github]
1 Apr 2022

Generating High Fidelity Data from Low-density Regions using Diffusion Models
Vikash Sehwag, Caner Hazirbas, Albert Gordo, Firat Ozgenel, Cristian Canton Ferrer
arXiv 2022. [Paper]
31 Mar 2022

Diffusion Models for Counterfactual Explanations
Guillaume Jeanneret, Loïc Simon, Frédéric Jurie
arXiv 2022. [Paper]
29 Mar 2022

Denoising Likelihood Score Matching for Conditional Score-based Data Generation
Chen-Hao Chao, Wei-Fang Sun, Bo-Wun Cheng, Yi-Chen Lo, Chia-Che Chang, Yu-Lun Liu, Yu-Lin Chang, Chia-Ping Chen, Chun-Yi Lee
ICLR 2022. [Paper]
27 Mar 2022

Dynamic Dual-Output Diffusion Models
Yaniv Benny, Lior Wolf
CVPR 2022. [Paper]
8 Mar 2022

Conditional Simulation Using Diffusion Schrödinger Bridges
Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper]
27 Feb 2022

Diffusion Causal Models for Counterfactual Estimation
Pedro Sanchez, Sotirios A. Tsaftaris
PMLR 2022. [Paper]
21 Feb 2022

Pseudo Numerical Methods for Diffusion Models on Manifolds
Luping Liu, Yi Ren, Zhijie Lin, Zhou Zhao
ICLR 2022. [Paper] [Github]
20 Feb 2022

Truncated Diffusion Probabilistic Models
Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
arXiv 2022. [Paper]
19 Feb 2022

Understanding DDPM Latent Codes Through Optimal Transport
Valentin Khrulkov, Ivan Oseledets
arXiv 2022. [Paper]
14 Feb 2022

Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Quality
Daniel Watson, William Chan, Jonathan Ho, Mohammad Norouzi
ICLR 2022. [Paper]
11 Feb 2022

Diffusion bridges vector quantized Variational AutoEncoders
Max Cohen, Guillaume Quispe, Sylvain Le Corff, Charles Ollion, Eric Moulines
ICML 2022. [Paper]
10 Feb 2022

Progressive Distillation for Fast Sampling of Diffusion Models
Tim Salimans, Jonathan Ho
ICLR 2022. [Paper]
1 Feb 2022

Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models
Fan Bao, Chongxuan Li, Jun Zhu, Bo Zhang
ICLR 2022. [Paper]
17 Jan 2022

DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents
Kushagra Pandey, Avideep Mukherjee, Piyush Rai, Abhishek Kumar
arXiv 2022. [Paper] [Github]
2 Jan 2022

Itô-Taylor Sampling Scheme for Denoising Diffusion Probabilistic Models using Ideal Derivatives
Hideyuki Tachibana, Mocho Go, Muneyoshi Inahara, Yotaro Katayama, Yotaro Watanabe
arXiv 2021. [Paper]
26 Dec 2021

GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
Alex Nichol¹, Prafulla Dhariwal¹, Aditya Ramesh¹, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, Mark Chen
ICML 2021. [Paper] [Github]
20 Dec 2021

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach¹, Andreas Blattmann¹, Dominik Lorenz, Patrick Esser, Björn Ommer
arXiv 2021. [Paper] [Github]
20 Dec 2021

Heavy-tailed denoising score matching
Jacob Deasy, Nikola Simidjievski, Pietro Liò
arXiv 2021. [Paper]
17 Dec 2021

High Fidelity Visualization of What Your Self-Supervised Representation Knows About
Florian Bordes, Randall Balestriero, Pascal Vincent
arXiv 2021. [Paper]
16 Dec 2021

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
Zhisheng Xiao, Karsten Kreis, Arash Vahdat
arXiv 2021. [Paper] [Project]
15 Dec 2021

Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
Tim Dockhorn, Arash Vahdat, Karsten Kreis
ICLR 2022. [Paper] [Project]
14 Dec 2021

More Control for Free! Image Synthesis with Semantic Diffusion Guidance
Xihui Liu, Dong Huk Park, Samaneh Azadi, Gong Zhang, Arman Chopikyan, Yuxiao Hu, Humphrey Shi, Anna Rohrbach, Trevor Darrell
arXiv 2021. [Paper]
10 Dec 2021

Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation
Minghui Hu, Yujie Wang, Tat-Jen Cham, Jianfei Yang, P.N.Suganthan
arXiv 2021. [Paper]
3 Dec 2021

Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
Konpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, Supasorn Suwajanakorn
CVPR 2022. [Paper] [Project] [Github]
30 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021

Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes
Sam Bond-Taylor¹, Peter Hessey¹, Hiroshi Sasaki, Toby P. Breckon, Chris G. Willcocks
arXiv 2021. [Paper] [Github]
24 Nov 2021

Diffusion Normalizing Flow
Qinsheng Zhang, Yongxin Chen
NeurIPS 2021. [Paper] [Github]
14 Oct 2021

Denoising Diffusion Gamma Models
Eliya Nachmani¹, Robin San Roman¹, Lior Wolf
arXiv 2021. [Paper]
10 Oct 2021

Score-based Generative Neural Networks for Large-Scale Optimal Transport
Max Daniels, Tyler Maunu, Paul Hand
arXiv 2021. [Paper]
7 Oct 2021

Score-Based Generative Classifiers
Roland S. Zimmermann, Lukas Schott, Yang Song, Benjamin A. Dunn, David A. Klindt
arXiv 2021. [Paper]
1 Oct 2021

Classifier-Free Diffusion Guidance
Jonathan Ho, Tim Salimans
NeurIPS Workshop 2021. [Paper]
28 Sep 2021

Bilateral Denoising Diffusion Models
Max W. Y. Lam, Jun Wang, Rongjie Huang, Dan Su, Dong Yu
arXiv 2021. [Paper] [Project]
26 Aug 2021

ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis
Patrick Esser¹, Robin Rombach¹, Andreas Blattmann¹, Björn Ommer
NeurIPS 2021. [Paper] [Project]
19 Aug 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

SDEdit: Image Synthesis and Editing with Stochastic Differential Equations
Chenlin Meng, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, Stefano Ermon
ICLR 2021. [Paper] [Project] [Github]
2 Aug 2021

Structured Denoising Diffusion Models in Discrete State-Spaces
Jacob Austin¹, Daniel D. Johnson¹, Jonathan Ho, Daniel Tarlow, Rianne van den Berg
NeurIPS 2021. [Paper]
7 Jul 2021

Variational Diffusion Models
Diederik P. Kingma¹, Tim Salimans¹, Ben Poole, Jonathan Ho
arXiv 2021. [Paper] [Github]
1 Jul 2021

Diffusion Priors In Variational Autoencoders
Antoine Wehenkel¹, Gilles Louppe¹
ICML Workshop 2021. [Paper]
29 Jun 2021

Deep Generative Learning via Schrödinger Bridge
Gefei Wang, Yuling Jiao, Qian Xu, Yang Wang, Can Yang
ICML 2021. [Paper]
19 Jun 2021

Non Gaussian Denoising Diffusion Models
Eliya Nachmani¹, Robin San Roman¹, Lior Wolf
arXiv 2021. [Paper] [Project]
14 Jun 2021

D2C: Diffusion-Denoising Models for Few-shot Conditional Generation
Abhishek Sinha¹, Jiaming Song¹, Chenlin Meng, Stefano Ermon
NeurIPS 2021. [Paper] [Project] [Github]
12 Jun 2021

Score-based Generative Modeling in Latent Space
Arash Vahdat¹, Karsten Kreis¹, Jan Kautz
arXiv 2021. [Paper]
10 Jun 2021

Learning to Efficiently Sample from Diffusion Probabilistic Models
Daniel Watson, Jonathan Ho, Mohammad Norouzi, William Chan
arXiv 2021. [Paper]
7 Jun 2021

A Variational Perspective on Diffusion-Based Generative Models and Score Matching
Chin-Wei Huang, Jae Hyun Lim, Aaron Courville
NeurIPS 2021. [Paper] [Github]
5 Jun 2021

Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation
Dongjun Kim, Seungjae Shin, Kyungwoo Song, Wanmo Kang, Il-Chul Moon
ICML 2022. [Paper]
10 Jun 2021

Diffusion Schrödinger Bridge with Applications to Score-Based Generative Modeling
Valentin De Bortoli, James Thornton, Jeremy Heng, Arnaud Doucet
arXiv 2021. [Paper] [Project] [Github]
1 Jun 2021

On Fast Sampling of Diffusion Probabilistic Models
Zhifeng Kong, Wei Ping
ICML Workshop 2021. [Paper] [Github]
31 May 2021

Cascaded Diffusion Models for High Fidelity Image Generation
Jonathan Ho¹, Chitwan Saharia¹, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans
JMLR 2021. [Paper] [Project]
30 May 2021

Gotta Go Fast When Generating Data with Score-Based Models
Alexia Jolicoeur-Martineau, Ke Li, Rémi Piché-Taillefer, Tal Kachman, Ioannis Mitliagkas
arXiv 2021. [Paper] [Github]
28 May 2021

Diffusion Models Beat GANs on Image Synthesis
Prafulla Dhariwal¹, Alex Nichol¹
arXiv 2021. [Paper] [Github]
11 May 2021

Image Super-Resolution via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi
arXiv 2021. [Paper] [Project] [Github]
15 Apr 2021

Noise Estimation for Generative Diffusion Models
Robin San-Roman¹, Eliya Nachmani¹, Lior Wolf
arXiv 2021. [Paper]
6 Apr 2021

Improved Denoising Diffusion Probabilistic Models
Alex Nichol¹, Prafulla Dhariwal¹
ICLR 2021. [Paper] [Github]
18 Feb 2021

Maximum Likelihood Training of Score-Based Diffusion Models
Yang Song¹, Conor Durkan¹, Iain Murray, Stefano Ermon
arXiv 2021. [Paper]
22 Jan 2021

Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
Eric Luhman¹, Troy Luhman¹
arXiv 2021. [Paper] [Github]
7 Jan 2021

Learning Energy-Based Models by Diffusion Recovery Likelihood
Ruiqi Gao, Yang Song, Ben Poole, Ying Nian Wu, Diederik P. Kingma
ICLR 2021. [Paper] [Github]
15 Dec 2020

Score-Based Generative Modeling through Stochastic Differential Equations
Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, Ben Poole
ICLR 2021 (Oral). [Paper] [Github]
26 Nov 2020

Variational (Gradient) Estimate of the Score Function in Energy-based Latent Variable Models
Fan Bao, Kun Xu, Chongxuan Li, Lanqing Hong, Jun Zhu, Bo Zhang
ICML 2021. [Paper]
16 Oct 2020

Denoising Diffusion Implicit Models
Jiaming Song, Chenlin Meng, Stefano Ermon
ICLR 2021. [Paper] [Github]
6 Oct 2020

Adversarial score matching and improved sampling for image generation
Alexia Jolicoeur-Martineau¹, Rémi Piché-Taillefer¹, Rémi Tachet des Combes, Ioannis Mitliagkas
ICLR 2021. [Paper] [Github]
11 Sep 2020

Denoising Diffusion Probabilistic Models
Jonathan Ho, Ajay Jain, Pieter Abbeel
NeurIPS 2020. [Paper] [Github] [Github2]
19 Jun 2020

Improved Techniques for Training Score-Based Generative Models
Yang Song, Stefano Ermon
NeurIPS 2020. [Paper] [Github]
16 Jun 2020

Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song, Stefano Ermon
NeurIPS 2019. [Paper] [Project] [Github]
12 Jul 2019

Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limit
Belinda Tzen, Maxim Raginsky
arXiv 2019. [Paper]
23 May 2019

Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, Surya Ganguli
ICML 2015. [Paper] [Github]
2 Mar 2015

Segmentation

Anatomically constrained CT image translation for heterogeneous blood vessel segmentation
Giammarco La Barbera, Haithem Boussaid, Francesco Maso, Sabine Sarnacki, Laurence Rouet, Pietro Gori, Isabelle Bloch
BMVC 2022. [Paper]
4 Oct 2022

Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentation
Boah Kim¹, Yujin Oh¹, Jong Chul Ye
arXiv 2022. [Paper]
29 Sep 2022

Let us Build Bridges: Understanding and Extending Diffusion Generative Models
Xingchao Liu, Lemeng Wu, Mao Ye, Qiang Liu
arXiv 2022. [Paper]
31 Aug 2022

Semantic Image Synthesis via Diffusion Models
Weilun Wang, Jianmin Bao, Wengang Zhou, Dongdong Chen, Dong Chen, Lu Yuan, Houqiang Li
arXiv 2022. [Paper]
30 Jun 2022

Remote Sensing Change Detection (Segmentation) using Denoising Diffusion Probabilistic Models
Wele Gedara Chaminda Bandara, Nithin Gopalakrishnan Nair, Vishal M. Patel
arXiv 2022. [Paper] [Github]
23 Jun 2022

Diffusion models as plug-and-play priors
Alexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris Samaras
arXiv 2022. [Paper]
17 Jun 2022

Decoder Denoising Pretraining for Semantic Segmentation
Emmanuel Brempong Asiedu, Simon Kornblith, Ting Chen, Niki Parmar, Matthias Minderer, Mohammad Norouzi
arXiv 2022. [Paper]
23 May 2022

Diffusion Models for Implicit Image Segmentation Ensembles
Julia Wolleb¹, Robin Sandkühler¹, Florentin Bieder, Philippe Valmaggia, Philippe C. Cattin
MIDL 2021. [Paper]
6 Dec 2021

Label-Efficient Semantic Segmentation with Diffusion Models
Dmitry Baranchuk, Ivan Rubachev, Andrey Voynov, Valentin Khrulkov, Artem Babenko
ICLR 2021. [Paper] [Github]
6 Dec 2021

SegDiff: Image Segmentation with Diffusion Probabilistic Models
Tomer Amit, Eliya Nachmani, Tal Shaharbany, Lior Wolf
arXiv 2021. [Paper]
1 Dec 2021

Image-to-Image Translation

DiffGAR: Model-Agnostic Restoration from Generative Artifacts Using Image-to-Image Diffusion Models
Yueqin Yin, Lianghua Huang, Yu Liu, Kaiqi Huang
arXiv 2022. [Paper] 16 Oct 2022

Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidance
Chen Henry Wu, Fernando De la Torre
arXiv 2022. [Paper] [Github-1] [Github-2]
11 Oct 2022

Diffusion-based Image Translation using Disentangled Style and Content Representation
Gihyun Kwon, Jong Chul Ye
arXiv 2022. [Paper]
30 Sep 2022

MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translation
Junyoung Seo¹, Gyuseong Lee¹, Seokju Cho, Jiyoung Lee, Seungryong Kim
arXiv 2022. [Paper]
22 Sep 2022

T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models
Nithin Gopalakrishnan Nair, Vishal M. Patel
arXiv 2022. [Paper]
19 Sep 2022

Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
Ozan Özdenizci, Robert Legenstein
arXiv 2022. [Paper]
29 Jul 2022

Non-Uniform Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2022. [Paper]
20 Jul 2022

Unsupervised Medical Image Translation with Adversarial Diffusion Models
Muzaffer Özbey, Salman UH Dar, Hasan A Bedel, Onat Dalmaz, Şaban Özturk, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
17 Jul 2022

EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations
Min Zhao, Fan Bao, Chongxuan Li, Jun Zhu
arXiv 2022. [Paper]
14 Jul 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Github]
15 Jun 2022

SAR Despeckling using a Denoising Diffusion Probabilistic Model
Malsha V. Perera, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel
arXiv 2022. [Paper]
9 Jun 2022

Pretraining is All You Need for Image-to-Image Translation
Tengfei Wang, Ting Zhang, Bo Zhang, Hao Ouyang, Dong Chen, Qifeng Chen, Fang Wen
arXiv 2022. [Paper] [Project] [Github]
25 May 2022

VQBB: Image-to-image Translation with Vector Quantized Brownian Bridge
Bo Li, Kaitao Xue, Bin Liu, Yu-Kun Lai
arXiv 2022. [Paper]
16 May 2022

The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion Models
Julia Wolleb¹, Robin Sandkühler¹, Florentin Bieder, Philippe C. Cattin
arXiv 2022. [Paper]
6 Apr 2022

Dual Diffusion Implicit Bridges for Image-to-Image Translation
Xuan Su, Jiaming Song, Chenlin Meng, Stefano Ermon
arXiv 2022. [Paper]
16 Mar 2022

Denoising Diffusion Restoration Models
Bahjat Kawar, Michael Elad, Stefano Ermon, Jiaming Song
NeurIPS 2022. [Paper]
27 Jan 2022

DiffuseMorph: Unsupervised Deformable Image Registration Along Continuous Trajectory Using Diffusion Models
Boah Kim, Inhwa Han, Jong Chul Ye
arXiv 2021. [Paper]
9 Dec 2021

Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
Konpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, Supasorn Suwajanakorn
arXiv 2021. [Paper] [Project]
30 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models
Hiroshi Sasaki, Chris G. Willcocks, Toby P. Breckon
arXiv 2021. [Paper]
12 Apr 2021

Super Resolution

From Denoising Diffusions to Denoising Markov Models
Joe Benton, Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper] [Github]
7 Nov 2022

Diffusion Posterior Sampling for General Noisy Inverse Problems
Hyungjin Chung¹, Jeongsol Kim¹, Michael T. Mccann, Marc L. Klasky, Jong Chul Ye
arXiv 2022. [Paper] [Github]
29 Sep 2022

Face Super-Resolution Using Stochastic Differential Equations
Marcelo dos Santos¹, Rayson Laroca¹, Rafael O. Ribeiro, João Neves, Hugo Proença, David Menotti
arXiv 2022. [Paper] [Github]
24 Sep 2022

Non-Uniform Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2022. [Paper]
20 Jul 2022

Denoising Diffusion Restoration Models
Bahjat Kawar, Michael Elad, Stefano Ermon, Jiaming Song
ICLR 2022 Workshop (Oral). [Paper]
27 Jan 2022

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach¹, Andreas Blattmann¹, Dominik Lorenz, Patrick Esser, Björn Ommer
CVPR 2022. [Paper] [Github]
20 Dec 2021

Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction
Hyungjin Chung, Byeongsu Sim, Jong Chul Ye
CVPR 2022. [Paper]
9 Dec 2021

Deblurring via Stochastic Refinement
Jay Whang, Mauricio Delbracio, Hossein Talebi, Chitwan Saharia, Alexandros G. Dimakis, Peyman Milanfar
CVPR 2022. [Paper]
5 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021

S3RP: Self-Supervised Super-Resolution and Prediction for Advection-Diffusion Process
Chulin Wang, Kyongmin Yeo, Xiao Jin, Andres Codas, Levente J. Klein, Bruce Elmegreen
NeurIPS 2022. [Paper]
8 Nov 2021

Autoregressive Diffusion Models
Emiel Hoogeboom, Alexey A. Gritsenko, Jasmijn Bastings, Ben Poole, Rianne van den Berg, Tim Salimans
ICLR 2022. [Paper]
5 Oct 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

Cascaded Diffusion Models for High Fidelity Image Generation
Jonathan Ho¹, Chitwan Saharia¹, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans
arXiv 2021. [Paper] [Project]
30 May 2021

SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models
Haoying Li, Yifan Yang, Meng Chang, Huajun Feng, Zhihai Xu, Qi Li, Yueting Chen
ACM 2022. [Paper]
30 Apr 2021

Image Super-Resolution via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi
arXiv 2021. [Paper] [Project] [Github]
15 Apr 2021

Image Inpainting

From Denoising Diffusions to Denoising Markov Models
Joe Benton, Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper] [Github]
7 Nov 2022

Intelligent Painter: Picture Composition With Resampling Diffusion Model
Wing-Fung Ku, Wan-Chi Siu, Xi Cheng, H. Anthony Chan
arXiv 2022. [Paper]
31 Oct 2022

Delving Globally into Texture and Structure for Image Inpainting
Haipeng Liu, Yang Wang, Meng Wang, Yong Rui
ACM 2022. [Paper] [Github]
17 Sep 2022

Non-Uniform Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2022. [Paper]
20 Jul 2022

Improving Diffusion Models for Inverse Problems using Manifold Constraints
Hyungjin Chung¹, Byeongsu Sim¹, Dohoon Ryu, Jong Chul Ye
arXiv 2022. [Paper]
2 Jun 2022

Denoising Diffusion Restoration Models
Bahjat Kawar, Michael Elad, Stefano Ermon, Jiaming Song
ICLR 2022 Workshop (Oral). [Paper]
27 Jan 2022

RePaint: Inpainting using Denoising Diffusion Probabilistic Models
Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, Luc Van Gool
CVPR 2022. [Paper] [Github]
24 Jan 2022

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach¹, Andreas Blattmann¹, Dominik Lorenz, Patrick Esser, Björn Ommer
CVPR 2022. [Paper] [Github]
20 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper] [Github]
26 Nov 2021

Image Editing

Versatile Diffusion: Text, Images and Variations All in One Diffusion Model
Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, Humphrey Shi
arXiv 2022. [Paper] [Github]
15 Nov 2022

Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models
Adham Elarabawy, Harish Kamath, Samuel Denton
arXiv 2022. [Paper]
15 Nov 2022

Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models
Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
NeurIPS 2022. [Paper] [Github]
4 Nov 2022

High-Resolution Image Editing via Multi-Stage Blended Diffusion
Johannes Ackermann, Minjun Li
NeurIPS Workshop 2022. [Paper] [Github]
24 Oct 2022

DiffEdit: Diffusion-based semantic image editing with mask guidance
Guillaume Couairon, Jakob Verbeek, Holger Schwenk, Matthieu Cord
arXiv 2022. [Paper]
20 Oct 2022

Imagic: Text-Based Real Image Editing with Diffusion Models
Bahjat Kawar¹, Shiran Zada¹, Oran Lang, Omer Tov, Huiwen Chang, Tali Dekel, Inbar Mosseri, Michal Irani
arXiv 2022. [Paper]
17 Oct 2022

Leveraging Off-the-shelf Diffusion Model for Multi-attribute Fashion Image Manipulation
Chaerin Kong, DongHyeon Jeon, Ohjoon Kwon, Nojun Kwak
arXiv 2022. [Paper]
12 Oct 2022

Adaptively-Realistic Image Generation from Stroke and Sketch with Diffusion Model
Shin-I Cheng¹, Yu-Jie Chen¹, Wei-Chen Chiu, Hsin-Ying Lee, Hung-Yu Tseng
arXiv 2022. [Paper] [Project]
26 Aug 2022

Blended Latent Diffusion
Omri Avrahami, Ohad Fried, Dani Lischinski
ACM 2022. [Paper] [Project] [Github]
6 Jun 2022

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach¹, Andreas Blattmann¹, Dominik Lorenz, Patrick Esser, Björn Ommer
CVPR 2022. [Paper] [Github]
20 Dec 2021

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
Zhisheng Xiao, Karsten Kreis, Arash Vahdat
ICLR 2022 (Spotlight). [Paper] [Project]
15 Dec 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

SDEdit: Image Synthesis and Editing with Stochastic Differential Equations
Chenlin Meng, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, Stefano Ermon
ICLR 2022. [Paper] [Project] [Github]
2 Aug 2021

Text-to-Image

Versatile Diffusion: Text, Images and Variations All in One Diffusion Model
Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, Humphrey Shi
arXiv 2022. [Paper] [Github]
15 Nov 2022

Arbitrary Style Guidance for Enhanced Diffusion-Based Text-to-Image Generation
Zhihong Pan, Xin Zhou, Hao Tian
arXiv 2022. [Paper]
14 Nov 2022

Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models
Patrick Schramowski, Manuel Brack, Björn Deiseroth, Kristian Kersting
arXiv 2022. [Paper] [Github]
9 Nov 2022

Rickrolling the Artist: Injecting Invisible Backdoors into Text-Guided Image Generation Models
Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
arXiv 2022. [Paper]
4 Nov 2022

eDiffi: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, Bryan Catanzaro, Tero Karras, Ming-Yu Liu
arXiv 2022. [Paper] [Github]
2 Nov 2022

MagicMix: Semantic Mixing with Diffusion Models \ Jun Hao Liew, Hanshu Yan, Daquan Zhou, Jiashi Feng
arXiv 2022. [Paper] [Project]
28 Oct 2022

UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance
Wei Li, Xue Xu, Xinyan Xiao, Jiachen Liu, Hu Yang, Guohao Li, Zhanpeng Wang, Zhifan Feng, Qiaoqiao She, Yajuan Lyu, Hua Wu
arXiv 2022. [Paper]
28 Oct 2022

How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?
Hritik Bansal¹, Da Yin¹, Masoud Monajatipoor, Kai-Wei Chang
EMNLP 2022. [[Paper(https://arxiv.org/abs/2210.15230)] [Github]
27 Oct 2022

ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts
Zhida Feng¹, Zhenyu Zhang¹, Xintong Yu¹, Yewei Fang, Lanxin Li, Xuyi Chen, Yuxiang Lu, Jiaxiang Liu, Weichong Yin, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
arXiv 2022. [Paper]
27 Oct 2022

DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models
Zijie J. Wang, Evan Montoya, David Munechika, Haoyang Yang, Benjamin Hoover, Duen Horng Chau
arXiv 2022. [Paper] [Project]
26 Oct 2022

Lafite2: Few-shot Text-to-Image Generation
Yufan Zhou, Chunyuan Li, Changyou Chen, Jianfeng Gao, Jinhui Xu
arXiv 2022. [Paper]
25 Oct 2022

Conditional Diffusion with Less Explicit Guidance via Model Predictive Control
Max W. Shen, Ehsan Hajiramezanali, Gabriele Scalia, Alex Tseng, Nathaniel Diamant, Tommaso Biancalani, Andreas Loukas
arXiv 2022. [Paper]
21 Oct 2022

A Visual Tour Of Current Challenges In Multimodal Language Models
Shashank Sonkar, Naiming Liu, Richard G. Baraniuk
arXiv 2022. [Paper]
22 Oct 2022

Diffusion Models already have a Semantic Latent Space
Mingi Kwon, Jaeseok Jeong, Youngjung Uh
arXiv 2022. [Paper] [Project]
20 Oct 2022

DiffEdit: Diffusion-based semantic image editing with mask guidance
Guillaume Couairon, Jakob Verbeek, Holger Schwenk, Matthieu Cord
arXiv 2022. [Paper]
20 Oct 2022

UniTune: Text-Driven Image Editing by Fine Tuning an Image Generation Model on a Single Image
Dani Valevski, Matan Kalman, Yossi Matias, Yaniv Leviathan
arXiv 2022. [Paper]
18 Oct 2022

Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generation
Ruijun Li, Weihua Li, Yi Yang, Hanyu Wei, Jianhua Jiang, Quan Bai
arXiv 2022. [Paper]
18 Oct 2022

Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidance
Chen Henry Wu, Fernando De la Torre
arXiv 2022. [Paper] [Github-1] [Github-2]
11 Oct 2022

LDEdit: Towards Generalized Text Guided Image Manipulation via Latent Diffusion Models
Paramanand Chandramouli, Kanchana Vaishnavi Gandikota
arXiv 2022. [Paper]
5 Oct 2022

clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIP
Justin N. M. Pinkney, Chuan Li
BMVC 2022. [Paper] [Github]
5 Oct 2022

Membership Inference Attacks Against Text-to-image Generation Models
Yixin Wu, Ning Yu, Zheng Li, Michael Backes, Yang Zhang
arXiv 2022. [Paper]
3 Oct 2022

DreamFusion: Text-to-3D using 2D Diffusion
Ben Poole, Ajay Jain, Jonathan T. Barron, Ben Mildenhall
arXiv 2022. [Paper] [Github]
29 Sep 2022

Re-Imagen: Retrieval-Augmented Text-to-Image Generator
Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen
arXiv 2022. [Paper]
29 Sep 2022

Creative Painting with Latent Diffusion Models
Xianchao Wu
arXiv 2022. [Paper]
29 Sep 2022

Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusion
Nisha Huang, Fan Tang, Weiming Dong, Changsheng Xu
arXiv 2022. [Paper] [Github]
27 Sep 2022

Personalizing Text-to-Image Generation via Aesthetic Gradients
Victor Gallego
NeurIPS 2022. [Paper] [Github]
25 Sep 2022

Best Prompts for Text-to-Image Models and How to Find Them
Nikita Pavlichenko, Dmitry Ustalov
arXiv 2022. [Paper]
23 Sep 2022

The Biased Artist: Exploiting Cultural Biases via Homoglyphs in Text-Guided Image Generation Models
Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
arXiv 2022. [Paper] [Github]
19 Sep 2022

Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Models
Chen Henry Wu, Saman Motamed, Shaunak Srivastava, Fernando De la Torre
NeurIPS 2022. [Paper] [Github]
14 Sep 2022

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, Kfir Aberman
arXiv 2022. [Paper] [Project] [Github]
25 Aug 2022

Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models
Robin Rombach¹, Andreas Blattmann¹, Björn Ommer
arXiv 2022. [Paper] [Github]
26 Jul 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Github]
15 Jun 2022

Blended Latent Diffusion
Omri Avrahami, Ohad Fried, Dani Lischinski
ACM 2022. [Paper] [Project] [Github]
6 Jun 2022

Compositional Visual Generation with Composable Diffusion Models
Nan Liu¹, Shuang Li¹, Yilun Du¹, Antonio Torralba, Joshua B. Tenenbaum
ECCV 2022. [Paper] [Project] [Github]
3 Jun 2022

DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder
Jie Shi¹, Chenfei Wu¹, Jian Liang, Xiang Liu, Nan Duan
arXiv 2022. [Paper]
1 Jun 2022

Improved Vector Quantized Diffusion Models
Zhicong Tang, Shuyang Gu, Jianmin Bao, Dong Chen, Fang Wen
arXiv 2022. [Paper] [Github]
31 May 2022

Text2Human: Text-Driven Controllable Human Image Generation
Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, Ziwei Liu
ACM 2022. [Paper]
31 May 2022

Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Chitwan Saharia¹, William Chan¹, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, Mohammad Norouzi
NeurIPS 2022. [Paper] [Github]
23 May 2022

Retrieval-Augmented Diffusion Models
Andreas Blattmann¹, Robin Rombach¹, Kaan Oktay, Björn Ommer
arXiv 2022. [Paper] [Github]
25 Apr 2022

Hierarchical Text-Conditional Image Generation with CLIP Latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, Mark Chen
arXiv 2022. [Paper] [Github]
13 Apr 2022

KNN-Diffusion: Image Generation via Large-Scale Retrieval
Oron Ashual, Shelly Sheynin, Adam Polyak, Uriel Singer, Oran Gafni, Eliya Nachmani, Yaniv Taigman
arXiv 2022. [Paper]
6 Apr 2022

Vector Quantized Diffusion Model for Text-to-Image Synthesis
Shuyang Gu, Dong Chen, Jianmin Bao, Fang Wen, Bo Zhang, Dongdong Chen, Lu Yuan, Baining Guo
CVPR 2022. [Paper] [Github]
29 Nov 2021

Blended Diffusion for Text-driven Editing of Natural Images
Omri Avrahami, Dani Lischinski, Ohad Fried
CVPR 2022. [Paper] [Project] [Github]
29 Nov 2021

DiffusionCLIP: Text-guided Image Manipulation Using Diffusion Models
Gwanghyun Kim, Jong Chul Ye
CVPR 2022. [Paper]
6 Oct 2021

Medical Imaging

Brain PET Synthesis from MRI Using Joint Probability Distribution of Diffusion Model at Ultrahigh Fields
Xie Taofeng¹, Cao Chentao¹, Cui Zhuoxu, Li Fanshi, Wei Zidong, Zhu Yanjie, Li Ye, Liang Dong, Jin Qiyu, Chen Guoqing, Wang Haifeng
arXiv 2022. [Paper]
16 Nov 2022

Improved HER2 Tumor Segmentation with Subtype Balancing using Deep Generative Networks
Mathias Öttl, Jana Mönius, Matthias Rübner, Carol I. Geppert, Jingna Qiu, Frauke Wilm, Arndt Hartmann, Matthias W. Beckmann, Peter A. Fasching, Andreas Maier, Ramona Erber, Katharina Breininger
arXiv 2022. [Paper]
11 Nov 2022

An unobtrusive quality supervision approach for medical image annotation
Sonja Kunzmann, Mathias Öttl, Prathmesh Madhu, Felix Denzinger, Andreas Maier
arXiv 2022. [Paper]
11 Nov 2022

Medical Diffusion -- Denoising Diffusion Probabilistic Models for 3D Medical Image Generation
Firas Khader, Gustav Mueller-Franzes, Soroosh Tayebi Arasteh, Tianyu Han, Christoph Haarburger, Maximilian Schulze-Hagen, Philipp Schad, Sandy Engelhardt, Bettina Baessler, Sebastian Foersch, Johannes Stegmaier, Christiane Kuhl, Sven Nebelung, Jakob Nikolas Kather, Daniel Truhn
arXiv 2022. [Paper]
7 Nov 2022

Generation of Anonymous Chest Radiographs Using Latent Diffusion Models for Training Thoracic Abnormality Classification Systems
Kai Packhäuser, Lukas Folle, Florian Thamm, Andreas Maier
arXiv 2022. [Paper]
2 Nov 2022

Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models
Hazrat Ali, Shafaq Murad, Zubair Shah
arXiv 2022. [Paper] [Project]
2 Nov 2022

MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model
Junde Wu, Huihui Fang, Yu Zhang, Yehui Yang, Yanwu Xu
arXiv 2022. [Paper]
1 Nov 2022

Accelerating Diffusion Models via Pre-segmentation Diffusion Sampling for Medical Image Segmentation
Xutao Guo, Yanwu Yang, Chenfei Ye, Shang Lu, Yang Xiang, Ting Ma
arXiv 2022. [Paper]
27 Oct 2022

Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report
Pouria Rouzrokh¹, Bardia Khosravi¹, Shahriar Faghani, Mana Moassefi, Sanaz Vahdati, Bradley J. Erickson
arXiv 2022. [Paper] [Github]
21 Oct 2022

Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains
Pierre Chambon¹, Christian Bluethgen¹, Curtis P. Langlotz, Akshay Chaudhari
arXiv 2022. [Paper]
9 Oct 2022

Low-Dose CT Using Denoising Diffusion Probabilistic Model for 20× Speedup
Wenjun Xia, Qing Lyu, Ge Wang
arXiv 2022. [Paper]
29 Sep 2022

Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentation
Boah Kim¹, Yujin Oh¹, Jong Chul Ye
arXiv 2022. [Paper]
29 Sep 2022

Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models
Qing Lyu, Ge Wang
arXiv 2022. [Paper]
24 Sep 2022

Brain Imaging Generation with Latent Diffusion Models
Walter H. L. Pinaya¹, Petru-Daniel Tudosiu¹, Jessica Dafflon, Pedro F da Costa, Virginia Fernandez, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso
arXiv 2022. [Paper]
15 Sep 2022

PET image denoising based on denoising diffusion probabilistic models
Kuang Gong, Keith A. Johnson, Georges El Fakhri, Quanzheng Li, Tinsu Pan
arXiv 2022. [Paper]
13 Sep 2022

Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction
Zhuo-Xu Cui, Chentao Cao, Shaonan Liu, Qingyong Zhu, Jing Cheng, Haifeng Wang, Yanjie Zhu, Dong Liang
IEEE TMI 2022. [Paper]
2 Sep 2022

High-Frequency Space Diffusion Models for Accelerated MRI
Chentao Cao, Zhuo-Xu Cui, Shaonan Liu, Dong Liang, Yanjie Zhu
arXiv 2022. [Paper]
10 Aug 2022

What is Healthy? Generative Counterfactual Diffusion for Lesion Localization
Pedro Sanchez, Antanas Kascenas, Xiao Liu, Alison Q. O'Neil, Sotirios A. Tsaftaris
MICCAI 2022. [Paper] [Github]
25 Jul 2022

Adaptive Diffusion Priors for Accelerated MRI Reconstruction
Salman UH Dar, Şaban Öztürk, Yilmaz Korkmaz, Gokberk Elmas, Muzaffer Özbey, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
12 Jul 2022

A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion
Xiangxi Meng, Yuning Gu, Yongsheng Pan, Nizhuan Wang, Peng Xue, Mengkang Lu, Xuming He, Yiqiang Zhan, Dinggang Shen
arXiv 2022. [Paper]
7 Jul 2022

Cross-Modal Transformer GAN: A Brain Structure-Function Deep Fusing Framework for Alzheimer's Disease
Junren Pan, Shuqiang Wang
arXiv 2022. [Paper]
20 Jun 2022

Diffusion Deformable Model for 4D Temporal Medical Image Generation
Boah Kim, Jong Chul Ye
MICCAI 2022. [Paper] [Github]
27 Jun 2022

Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models
Walter H. L. Pinaya, Mark S. Graham, Robert Gray, Pedro F Da Costa, Petru-Daniel Tudosiu, Paul Wright, Yee H. Mah, Andrew D. MacKinnon, James T. Teo, Rolf Jager, David Werring, Geraint Rees, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardos
MICCAI 2022. [Paper]
7 Jun 2022

Improving Diffusion Models for Inverse Problems using Manifold Constraints
Hyungjin Chung¹, Byeongsu Sim¹, Dohoon Ryu, Jong Chul Ye
arXiv 2022. [Paper]
2 Jun 2022

AnoDDPM: Anomaly Detection with Denoising Diffusion Probabilistic Models using Simplex Noise
Julian Wyatt, Adam Leach, Sebastian M. Schmon, Chris G. Willcocks
CVPR Workshop 2022. [Paper] [Github]
1 Jun 2022

The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion Models
Julia Wolleb¹, Robin Sandkühler¹, Florentin Bieder, Philippe C. Cattin
arXiv 2022. [Paper]
6 Apr 2022

MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusion
Hyungjin Chung, Eun Sun Lee, Jong Chul Ye
arXiv 2022. [Paper]
23 Mar 2022

Diffusion Models for Medical Anomaly Detection
Julia Wolleb, Florentin Bieder, Robin Sandkühler, Philippe C. Cattin
MICCAI 2022. [Paper] [Github]
8 Mar 2022

Towards performant and reliable undersampled MR reconstruction via diffusion model sampling
Cheng Peng, Pengfei Guo, S. Kevin Zhou, Vishal Patel, Rama Chellappa
arXiv 2022. [Paper] [Github]
8 Mar 2022

Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction
Yutong Xie, Quanzheng Li
MICCAI 2022. [Paper] [Github]
5 Mar 2022

MRI Reconstruction via Data Driven Markov Chain with Joint Uncertainty Estimation
Guanxiong Luo, Martin Heide, Martin Uecker
arXiv 2022. [Paper] [Github]
3 Feb 2022

Unsupervised Denoising of Retinal OCT with Diffusion Probabilistic Model
Dewei Hu, Yuankai K. Tao, Ipek Oguz
arXiv 2022. [Paper] [Github]
27 Jan 2022

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models
Yang Song¹, Liyue Shen¹, Lei Xing, Stefano Ermon
NeurIPS Workshop 2021. [Paper] [Github]
15 Nov 2021

Score-based diffusion models for accelerated MRI
Hyungjin Chung, Jong chul Ye
MIA 2021. [Paper] [Github]
8 Oct 2021

Video Generation

Imagen Video: High Definition Video Generation with Diffusion Models
Jonathan Ho¹, William Chan¹, Chitwan Saharia¹, Jay Whang¹, Ruiqi Gao, Alexey Gritsenko, Diederik P. Kingma, Ben Poole, Mohammad Norouzi, David J. Fleet, Tim Salimans
arXiv 2022. [Paper]
5 Oct 2022

Make-A-Video: Text-to-Video Generation without Text-Video Data
Uriel Singer, Adam Polyak, Thomas Hayes, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry Yang, Oron Ashual, Oran Gafni, Devi Parikh, Sonal Gupta, Yaniv Taigman
arXiv 2022. [Paper]
29 Sep 2022

Diffusion Models for Video Prediction and Infilling
Tobias Höppe, Arash Mehrjou, Stefan Bauer, Didrik Nielsen, Andrea Dittadi
arXiv 2022. [Paper]
15 Jun 2022

Flexible Diffusion Modeling of Long Videos
William Harvey, Saeid Naderiparizi, Vaden Masrani, Christian Weilbach, Frank Wood
arXiv 2022. [Paper] [Github]
23 May 2022

MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation
Vikram Voleti¹, Alexia Jolicoeur-Martineau¹, Christopher Pal
NeurIPS 2022. [Paper] [Github]
19 May 2022

Video Diffusion Models
Jonathan Ho¹, Tim Salimans¹, Alexey Gritsenko, William Chan, Mohammad Norouzi, David J. Fleet
NeurIPS 2022. [Paper]
7 Apr 2022

Diffusion Probabilistic Modeling for Video Generation
Ruihan Yang, Prakhar Srivastava, Stephan Mandt
arXiv 2022. [Paper] [Github]
16 Mar 2022

Point Cloud

LION: Latent Point Diffusion Models for 3D Shape Generation
Xiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic, Or Litany, Sanja Fidler, Karsten Kreis
NeurIPS 2022. [Paper] [Project]
12 Oct 2022

First Hitting Diffusion Models
Mao Ye, Lemeng Wu, Qiang Liu
NeruIPS 2022. [Paper]
2 Sep 2022

Let us Build Bridges: Understanding and Extending Diffusion Generative Models
Xingchao Liu, Lemeng Wu, Mao Ye, Qiang Liu
arXiv 2022. [Paper]
31 Aug 2022

PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition
Jiachen Sun, Weili Nie, Zhiding Yu, Z. Morley Mao, Chaowei Xiao
arXiv 2022. [Paper]
21 Aug 2022

A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion
Zhaoyang Lyu, Zhifeng Kong, Xudong Xu, Liang Pan, Dahua Lin
ICLR 2022. [Paper] [Github]
7 Dec 2021

Score-Based Point Cloud Denoising
Shitong Luo, Wei Hu
ICCV 2021. [Paper] [Github]
23 Jul 2021

3D Shape Generation and Completion through Point-Voxel Diffusion
Linqi Zhou, Yilun Du, Jiajun Wu
ICCV 2021. [Paper] [Project]
8 Apr 2021

Diffusion Probabilistic Models for 3D Point Cloud Generation
Shitong Luo, Wei Hu
CVPR 2021. [Paper] [Github]
2 Mar 2021

Mesh

Neural Volumetric Mesh Generator
Yan Zheng, Lemeng Wu, Xingchao Liu, Zhen Chen, Qiang Liu, Qixing Huang
arXiv 2022. [Paper]
6 Oct 2022

3D View

Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures
Gal Metzer¹, Elad Richardson¹, Or Patashnik, Raja Giryes, Daniel Cohen-Or
arXiv 2022. [Paper] [Github]
14 Nov 2022

Novel View Synthesis with Diffusion Models
Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, Mohammad Norouzi
arXiv 2022. [Paper]
6 Oct 2022

A Diffusion Model Predicts 3D Shapes from 2D Microscopy Images
Dominik J. E. Waibel, Ernst Röell, Bastian Rieck, Raja Giryes, Carsten Marr
arXiv 2022. [Paper]
30 Aug 2022

Human Motion Synthesis

ReFu: Refine and Fuse the Unobserved View for Detail-Preserving Single-Image 3D Human Reconstruction
Gyumin Shim¹, Minsoo Lee¹, Jaegul Choo
ACM 2022. [Paper]
9 Nov 2022

Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
Zhiyuan Ren, Zhihong Pan, Xin Zhou, Le Kang
arXiv 2022. [Paper]
22 Oct 2022

Denoising Diffusion Probabilistic Models for Styled Walking Synthesis
Edmund J. C. Findlay, Haozheng Zhang, Ziyi Chang, Hubert P. H. Shum
arXiv 2022. [Paper]
29 Sep 2022

Human Motion Diffusion Model
Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Amit H. Bermano, Daniel Cohen-Or
arXiv 2022. [Paper] [Project]
29 Sep 2022

SE(3)-DiffusionFields: Learning cost functions for joint grasp and motion optimization through diffusion
Julen Urain, Niklas Funk, Georgia Chalvatzaki, Jan Peters
arXiv 2022. [Paper] [Github]
8 Sep 2022

FLAME: Free-form Language-based Motion Synthesis & Editing
Jihoon Kim, Jiseob Kim, Sungjoon Choi
arXiv 2022. [Paper]
1 Sep 2022

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu
arXiv 2022. [Paper] [Project]
31 Aug 2022

Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion
Tianpei Gu¹, Guangyi Chen¹, Junlong Li, Chunze Lin, Yongming Rao, Jie Zhou, Jiwen Lu
CVPR 2022. [Paper] [Github]
25 Mar 2022

DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras
Ruizhi Shao, Zerong Zheng, Hongwen Zhang, Jingxiang Sun, Yebin Liu
ECCV 2022. [Paper] [Project] [Github]
16 Jul 2022

Adversarial Attack

DensePure: Understanding Diffusion Models towards Adversarial Robustness
Chaowei Xiao¹, Zhongzhu Chen¹, Kun Jin¹, Jiongxiao Wang¹, Weili Nie, Mingyan Liu, Anima Anandkumar, Bo Li, Dawn Song
NeurIPS 2022. [Paper]
1 Nov 2022

Improving Adversarial Robustness by Contrastive Guided Diffusion Process
Yidong Ouyang, Liyan Xie, Guang Cheng
arXiv 2022. [Paper]
18 Oct 2022

Differentially Private Diffusion Models
Tim Dockhorn, Tianshi Cao, Arash Vahdat, Karsten Kreis
arXiv 2022. [Paper] [Project]
18 Oct 2022

PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition
Jiachen Sun, Weili Nie, Zhiding Yu, Z. Morley Mao, Chaowei Xiao
arXiv 2022. [Paper]
21 Aug 2022

Threat Model-Agnostic Adversarial Defense using Diffusion Models
Tsachi Blau, Roy Ganz, Bahjat Kawar, Alex Bronstein, Michael Elad
arXiv 2022. [Paper]
17 Jul 2022

Back to the Source: Diffusion-Driven Test-Time Adaptation
Jin Gao¹, Jialing Zhang¹, Xihui Liu, Trevor Darrell, Evan Shelhamer, Dequan Wang
arXiv 2022. [Paper]
7 Jul 2022

Guided Diffusion Model for Adversarial Purification from Random Noise
Quanlin Wu, Hang Ye, Yuntian Gu
arXiv 2022. [Paper]
17 Jun 2022

(Certified!!) Adversarial Robustness for Free!
Nicholas Carlini, Florian Tramer, Krishnamurthy (Dj)Dvijotham, J. Zico Kolter
arXiv 2022. [Paper]
21 Jun 2022

Guided Diffusion Model for Adversarial Purification
Jinyi Wang¹, Zhaoyang Lyu¹, Dahua Lin, Bo Dai, Hongfei Fu
ICML 2022. [Paper] [Github]
30 May 2022

Diffusion Models for Adversarial Purification
Weili Nie, Brandon Guo, Yujia Huang, Chaowei Xiao, Arash Vahdat, Anima Anandkumar
ICML 2022. [Paper] [Project] [Github]
16 May 2022

TFDPM: Attack detection for cyber-physical systems with diffusion probabilistic models
Tijin Yan, Tong Zhou, Yufeng Zhan, Yuanqing Xia
arXiv 2021. [Paper]
20 Dec 2021

Adversarial purification with Score-based generative models
Jongmin Yoon, Sung Ju Hwang, Juho Lee
ICML 2021. [Paper] [Github]
11 Jun 2021

Miscellaneous

CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streaming
Qihua Zhou, Ruibin Li, Song Guo, Yi Liu, Jingcai Guo, Zhenda Xu
arXiv 2022. [Paper]
15 Nov 2022

ShadowDiffusion: Diffusion-based Shadow Removal using Classifier-driven Attention and Structure Preservation
Yeying Jin, Wenhan Yang, Wei Ye, Yuan Yuan, Robby T. Tan
arXiv 2022. [Paper]
15 Nov 2022

Extreme Generative Image Compression by Learning Text Embedding from Diffusion Models
Zhihong Pan, Xin Zhou, Hao Tian
arXiv 2022. [Paper]
14 Nov 2022

Denoising Diffusion Models for Out-of-Distribution Detection
Mark S. Graham, Walter H.L. Pinaya, Petru-Daniel Tudosiu, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso
arXiv 2022. [Paper]
14 Nov 2022

DriftRec: Adapting diffusion models to blind image restoration tasks
Simon Welker, Henry N. Chapman, Timo Gerkmann
arXiv 2022. [Paper]
12 Nov 2022

Evaluating a Synthetic Image Dataset Generated with Stable Diffusion
Andreas Stöckl
arXiv 2022. [Paper]
3 Nov 2022

On the detection of synthetic images generated by diffusion models
Riccardo Corvi, Davide Cozzolino, Giada Zingarini, Giovanni Poggi, Koki Nagano, Luisa Verdoliva
arXiv 2022. [Paper]
1 Nov 2022

DOLPH: Diffusion Models for Phase Retrieval
Shirin Shoushtari¹, Jiaming Liu¹, Ulugbek S. Kamilov
arXiv 2022. [Paper]
1 Nov 2022

A simple, efficient and scalable contrastive masked autoencoder for learning visual representations
Shlok Mishra, Joshua Robinson, Huiwen Chang, David Jacobs, Aaron Sarna, Aaron Maschinot, Dilip Krishnan
arXiv 2022. [Paper]
30 Oct 2022

Towards the Detection of Diffusion Model Deepfakes
Jonas Ricker, Simon Damm, Thorsten Holz, Asja Fischer
arXiv 2022. [Paper]
26 Oct 2022

Boomerang: Local sampling on image manifolds using diffusion models
Lorenzo Luzi, Ali Siahkoohi, Paul M Mayer, Josue Casco-Rodriguez, Richard Baraniuk
arXiv 2022. [Paper] [Colab]
21 Oct 2022

Deep Data Augmentation for Weed Recognition Enhancement: A Diffusion Probabilistic Model and Transfer Learning Based Approach
Dong Chen, Xinda Qi, Yu Zheng, Yuzhen Lu, Zhaojian Li
arXiv 2022. [Paper] [Github]
18 Oct 2022

Meta-Learning via Classifier(-free) Guidance
Elvis Nava¹, Seijin Kobayashi¹, Yifei Yin, Robert K. Katzschmann, Benjamin F. Grewe
arXiv 2022. [Paper]
17 Oct 2022

DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Diffusion Models
Zeyang Sha, Zheng Li, Ning Yu, Yang Zhang
arXiv 2022. [Paper]
13 Oct 2022

Markup-to-Image Diffusion Models with Scheduled Sampling
Yuntian Deng, Noriyuki Kojima, Alexander M. Rush
arXiv 2022. [Paper]
11 Oct 2022

What the DAAM: Interpreting Stable Diffusion Using Cross Attention
Raphael Tang, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Jimmy Lin, Ferhan Ture
arXiv 2022. [Paper] [Github]
10 Oct 2022

CLIP-Diffusion-LM: Apply Diffusion Model on Image Captioning
Shitong Xu
arXiv 2022. [Paper] [Github]
10 Oct 2022

JPEG Artifact Correction using Denoising Diffusion Restoration Models
Bahjat Kawar¹, Jiaming Song¹, Stefano Ermon, Michael Elad
arXiv 2022. [Paper]
23 Sep 2022

AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models
Nithin Gopalakrishnan Nair, Kangfu Mei, Vishal M Patel
arXiv 2022. [Paper]
24 Aug 2022

Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
Ozan Özdenizci, Robert Legenstein
arXiv 2022. [Paper] [Github]
29 Jul 2022

Deep Diffusion Models for Seismic Processing
Ricard Durall, Ammar Ghanim, Mario Fernandez, Norman Ettrich, Janis Keuper
arXiv 2022. [Paper]
21 Jul 2022

Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions
Emiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré, Max Welling
arXiv 2021. [Paper]
10 Feb 2021

Audio

Audio Generation

SDMuse: Stochastic Differential Music Editing and Generation via Hybrid Representation
Chen Zhang, Yi Ren, Kejun Zhang, Shuicheng Yan
arXiv 2022. [Paper] [Project]
1 Nov 2022

Full-band General Audio Synthesis with Score-based Diffusion
Santiago Pascual, Gautam Bhattacharya, Chunghsin Yeh, Jordi Pons, Joan Serrà
arXiv 2022. [Paper]
26 Oct 2022

Hierarchical Diffusion Models for Singing Voice Neural Vocoder
Naoya Takahashi, Mayank Kumar, Singh, Yuki Mitsufuji
arXiv 2022. [Paper]
14 Oct 2022

DDSP-based Singing Vocoders: A New Subtractive-based Synthesizer and A Comprehensive Evaluation
Da-Yi Wu¹, Wen-Yi Hsiao¹, Fu-Rong Yang, Oscar Friedman, Warren Jackson, Scott Bruzenak, Yi-Wen Liu, Yi-Hsuan Yang
ISMIR 2022. [Paper] [Github]
9 Aug 2022

ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech
Rongjie Huang¹, Zhou Zhao, Huadai Liu¹, Jinglin Liu, Chenye Cui, Yi Ren
arXiv 2022. [Paper] [Project]
13 Jul 2022

Adversarial Audio Synthesis with Complex-valued Polynomial Networks
Yongtao Wu, Grigorios G Chrysos, Volkan Cevher
arXiv 2022. [Paper]
14 Jun 2022

BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis
Yichong Leng, Zehua Chen, Junliang Guo, Haohe Liu, Jiawei Chen, Xu Tan, Danilo Mandic, Lei He, Xiang-Yang Li, Tao Qin, Sheng Zhao, Tie-Yan Liu
NeurIPS 2022. [Paper] [Github]
30 May 2022

FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis
Rongjie Huang¹, Max W. Y. Lam¹, Jun Wang, Dan Su, Dong Yu, Yi Ren, Zhou Zhao
IJCAI 2022. [Paper] [Project] [Github]
21 Apr 2022

SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shaping
Yuma Koizumi, Heiga Zen, Kohei Yatabe, Nanxin Chen, Michiel Bacchiani
arXiv 2022. [Paper]
31 Mar 2022

BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesis
Max W. Y. Lam, Jun Wang, Dan Su, Dong Yu
ICLR 2022. [Paper] [Github]
25 Mar 2022

ItôWave: Itô Stochastic Differential Equation Is All You Need For Wave Generation
Shoule Wu¹, Ziqiang Shi¹
CoRR 2022. [Paper] [Project]
29 Jan 2022

Denoising Diffusion Gamma Models
Eliya Nachmani¹, Robin San Roman¹, Lior Wolf
arXiv 2021. [Paper]
10 Oct 2021

Variational Diffusion Models
Diederik P. Kingma, Tim Salimans, Ben Poole, Jonathan Ho
NeurIPS 2021. [Paper] [Github]
1 Jul 2021

CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesis
Simon Rouard¹, Gaëtan Hadjeres¹
ISMIR 2021. [Paper] [Project]
14 Jun 2021

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior
Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu
ICLR 2022. [Paper] [Project]
11 Jun 2021

ItôTTS and ItôWave: Linear Stochastic Differential Equation Is All You Need For Audio Generation
Shoule Wu¹, Ziqiang Shi¹
arXiv 2022. [Paper] [Project]
17 May 2021

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
Jinglin Liu¹, Chengxi Li¹, Yi Ren¹, Feiyang Chen, Peng Liu, Zhou Zhao
AAAI 2022. [Paper] [Project] [Github]
6 May 2021

Symbolic Music Generation with Diffusion Models
Gautam Mittal, Jesse Engel, Curtis Hawthorne, Ian Simon
ISMIR 2021. [Paper] [Github]
30 Mar 2021

DiffWave: A Versatile Diffusion Model for Audio Synthesis
Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, Bryan Catanzaro
ICLR 2021 [Paper] [Github]
21 Sep 2020

WaveGrad: Estimating Gradients for Waveform Generation
Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mohammad Norouzi, William Chan
ICLR 2021. [Paper] [Project] [Github]
2 Sep 2020

Audio Conversion

DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversion
Songxiang Liu¹, Yuewen Cao¹, Dan Su, Helen Meng
IEEE 2021. [Paper] [Github]
28 May 2021

Diffusion-Based Voice Conversion with Fast Maximum Likelihood Sampling Scheme
Vadim Popov, Ivan Vovk, Vladimir Gogoryan, Tasnima Sadekova, Mikhail Kudinov, Jiansheng Wei
ICLR 2022. [Paper] [Project]
28 Sep 2021

Audio Enhancement

Unsupervised vocal dereverberation with diffusion-based generative models
Koichi Saito, Naoki Murata, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuhta Takida, Takao Fukui, Yuki Mitsufuji
arXiv 2022. [Paper]
8 Nov 2022

DiffPhase: Generative Diffusion-based STFT Phase Retrieval
Tal Peer, Simon Welker, Timo Gerkmann
arXiv 2022. [Paper]
8 Nov 2022

Cold Diffusion for Speech Enhancement
Hao Yen, François G. Germain, Gordon Wichern, Jonathan Le Roux
arXiv 2022. [Paper]
4 Nov 2022

Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration
Jean-Marie Lemercier, Julius Richter, Simon Welker, Timo Gerkmann
ICASSP [Paper] [Project] [Github]
4 Nov 2022

SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement
Zhibin Qiu, Mengfan Fu, Yinfeng Yu, LiLi Yin, Fuchun Sun, Hao Huang
ICASSP 2022. [Paper] [Github]
30 Oct 2022

A Versatile Diffusion-based Generative Refiner for Speech Enhancement
Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
arXiv 2022. [Paper]
27 Oct 2022

Conditioning and Sampling in Variational Diffusion Models for Speech Super-resolution
Chin-Yun Yu, Sung-Lin Yeh, György Fazekas, Hao Tang
arXiv 2022. [Paper] [Project] [Github]
27 Oct 2022

Solving Audio Inverse Problems with a Diffusion Model
Eloi Moliner, Jaakko Lehtinen, Vesa Välimäki
arXiv 2022. [Paper]
27 Oct 2022

Speech Enhancement and Dereverberation with Diffusion-based Generative Models
Julius Richter, Simon Welker, Jean-Marie Lemercier, Bunlong Lay, Timo Gerkmann
arXiv 2022. [Paper] [Project] [Github]
11 Aug 2022

NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates
Seungu Han, Junhyeok Lee
arXiv 2022. [Paper] [Project]
17 Jun 2022

Universal Speech Enhancement with Score-based Diffusion
Joan Serrà, Santiago Pascual, Jordi Pons, R. Oguz Araz, Davide Scaini
arXiv 2022. [Paper]
7 Jun 2022

Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain
Simon Welker, Julius Richter, Timo Gerkmann
InterSpeech 2022. [Paper] [Github]
31 Mar 2022

Conditional Diffusion Probabilistic Model for Speech Enhancement
Yen-Ju Lu, Zhong-Qiu Wang, Shinji Watanabe, Alexander Richard, Cheng Yu, Yu Tsao
IEEE 2022. [Paper] [Github]
10 Feb 2022

A Study on Speech Enhancement Based on Diffusion Probabilistic Model
Yen-Ju Lu¹, Yu Tsao¹, Shinji Watanabe
arXiv 2021. [Paper]
25 Jul 2021

Restoring degraded speech via a modified diffusion model
Jianwei Zhang, Suren Jayasuriya, Visar Berisha
Interspeech 2021. [Paper]
22 Apr 2021

NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling
Junhyeok Lee, Seungu Han
Interspeech 2021. [Paper] [Project] [Github]
6 Apr 2021

Text-to-Speech

NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS
Dongchao Yang, Songxiang Liu, Jianwei Yu, Helin Wang, Chao Weng, Yuexian Zou
arXiv 2022. [Paper]
4 Nov 2022

WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iteration
Yuma Koizumi, Kohei Yatabe, Heiga Zen, Michiel Bacchiani
arXiv 2022. [Paper] [Project]
3 Oct 2022

Diffsound: Discrete Diffusion Model for Text-to-sound Generation
Dongchao Yang, Jianwei Yu, Helin Wang, Wen Wang, Chao Weng, Yuexian Zou, Dong Yu
arXiv 2022. [Paper] [Project]
20 Jul 2022

Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models
Alon Levkovitch, Eliya Nachmani, Lior Wolf
arXiv 2022. [Paper] [Project]
5 Jun 2022

Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Data
Sungwon Kim¹, Heeseung Kim¹, Sungroh Yoon
arXiv 2022. [Paper] [Project]
30 May 2022

InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Training
Zehua Chen, Xu Tan, Ke Wang, Shifeng Pan, Danilo Mandic, Lei He, Sheng Zhao
ICASSP 2022. [Paper]
8 Feb 2022

DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs
Songxiang Liu, Dan Su, Dong Yu
arXiv 2022. [Paper] [Github]
28 Jan 2022

Guided-TTS:Text-to-Speech with Untranscribed Speech
Heeseung Kim, Sungwon Kim, Sungroh Yoon
ICML 2021. [Paper]
32 Nov 2021

EdiTTS: Score-based Editing for Controllable Text-to-Speech
Jaesung Tae¹, Hyeongju Kim¹, Taesu Kim
arXiv 2021. [Paper] [Project] [Github]
6 Oct 2021

WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesis
Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mohammad Norouzi, Najim Dehak, William Chan
arXiv 2021. [Paper] [Project] [Github] [Github2]
17 Jun 2021

Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech
Vadim Popov¹, Ivan Vovk¹, Vladimir Gogoryan, Tasnima Sadekova, Mikhail Kudinov
ICML 2021. [Paper] [Project] [Github]
13 May 2021

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
Jinglin Liu¹, Chengxi Li¹, Yi Ren¹, Feiyang Chen, Peng Liu, Zhou Zhao
arXiv 2021. [Paper] [Project] [Github]
6 May 2021

Diff-TTS: A Denoising Diffusion Model for Text-to-Speech
Myeonghun Jeong, Hyeongju Kim, Sung Jun Cheon, Byoung Jin Choi, Nam Soo Kim
Interspeech 2021. [Paper]
3 Apr 2021

Music Generation

Mandarin Singing Voice Synthesis with Denoising Diffusion Probabilistic Wasserstein GAN
Yin-Ping Cho, Yu Tsao, Hsin-Min Wang, Yi-Wen Liu
arXiv 2022. [Paper] [Project]
21 Sep 2022

Multi-instrument Music Synthesis with Spectrogram Diffusion
Curtis Hawthorne, Ian Simon, Adam Roberts, Neil Zeghidour, Josh Gardner, Ethan Manilow, Jesse Engel
ISMIR 2022. [Paper]
11 Jun 2022

Separation

Diffusion-based Generative Speech Source Separation
Robin Scheibler, Youna Ji, Soo-Whan Chung, Jaeuk Byun, Soyeon Choe, Min-Seok Choi
arXiv 2022. [Paper]
31 Oct 2022

Instrument Separation of Symbolic Music by Explicitly Guided Diffusion Model
Sangjun Han, Hyeongrae Ihm, DaeHan Ahn, Woohyung Lim
arXiv 2022. [Paper]
5 Sep 2022

Natural Language

Natural Language Generation

Self-conditioned Embedding Diffusion for Text Generation
Robin Strudel, Corentin Tallec, Florent Altché, Yilun Du, Yaroslav Ganin, Arthur Mensch, Will Grathwohl, Nikolay Savinov, Sander Dieleman, Laurent Sifre, Rémi Leblond
arXiv 2022. [Paper]
8 Nov 2022

DiffusER: Discrete Diffusion via Edit-based Reconstruction
Machel Reid, Vincent J. Hellendoorn, Graham Neubig
arXiv 2022. [Paper]
30 Oct 2022

SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
Xiaochuang Han, Sachin Kumar, Yulia Tsvetkov
arXiv 2022. [Paper]
31 Oct 2022

DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
Shansan Gong¹, Mukai Li¹, Jiangtao Feng, Zhiyong Wu, LingPeng Kong
arXiv 2022. [Paper]
17 Oct 2022

Composable Text Controls in Latent Space with ODEs
Guangyi Liu, Zeyu Feng, Yuan Gao, Zichao Yang, Xiaodan Liang, Junwei Bao, Xiaodong He, Shuguang Cui, Zhen Li, Zhiting Hu
arXiv 2022. [Paper] [Github]
1 Aug 2022

Structured Denoising Diffusion Models in Discrete State-Spaces
Jacob Austin¹, Daniel D. Johnson¹, Jonathan Ho, Daniel Tarlow, Rianne van den Berg
NeurIPS 2021. [Paper]
7 Jul 2021

Latent Diffusion Energy-Based Model for Interpretable Text Modeling
Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruigi Gao, Yixin Zhu, Song-Chun Zhu, Ying Nian Wu
ICML 2022. [Paper] [Github]
13 Jun 2022

Diffusion-LM Improves Controllable Text Generation
Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, Tatsunori B. Hashimoto
NeurIPS 2022. [Paper] [Github]
27 May 2022

Step-unrolled Denoising Autoencoders for Text Generation
Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aaron van den Oord
ICLR 2022. [Paper] [Github]
13 Dec 2021

Zero-Shot Translation using Diffusion Models
Eliya Nachmani¹, Shaked Dovrat¹
arXiv 2021. [Paper]
2 Nov 2021

Tabular and Time Series

Generation

TabDDPM: Modelling Tabular Data with Diffusion Models
Akim Kotelnikov, Dmitry Baranchuk, Ivan Rubachev, Artem Babenko
arXiv 2022. [Paper] [Github]
30 Sep 2022

Forecasting

Modeling Temporal Data as Continuous Functions with Process Diffusion
Marin Biloš, Kashif Rasul, Anderson Schneider, Yuriy Nevmyvaka, Stephan Günnemann
arXiv 2022. [Paper]
4 Nov 2022

Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models
Juan Miguel Lopez Alcaraz, Nils Strodthoff
arXiv 2022. [Paper] [Github]
19 Aug 2022

ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models
Tijin Yan, Hongwei Zhang, Tong Zhou, Yufeng Zhan, Yuanqing Xia
arXiv 2021. [Paper] [Github]
18 Jun 2021

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
Kashif Rasul, Calvin Seward, Ingmar Schuster, Roland Vollgraf
ICLR 2021. [Paper] [Github]
2 Feb 2021

Imputation

Modeling Temporal Data as Continuous Functions with Process Diffusion
Marin Biloš, Kashif Rasul, Anderson Schneider, Yuriy Nevmyvaka, Stephan Günnemann
arXiv 2022. [Paper]
4 Nov 2022

Diffusion models for missing value imputation in tabular data
Shuhan Zheng, Nontawat Charoenphakdee
NeurIPS 2022. [Paper]
31 Oct 2022

Neural Markov Controlled SDE: Stochastic Optimization for Continuous-Time Data
Sung Woo Park, Kyungjae Lee, Junseok Kwon
ICLR 2022. [Paper]
29 Sep 2021

Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models
Juan Miguel Lopez Alcaraz, Nils Strodthoff
arXiv 2022. [Paper] [Github]
19 Aug 2022

CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation
Yusuke Tashiro, Jiaming Song, Yang Song, Stefano Ermon
NeurIPS 2021. [Paper] [Github]
7 Jul 2021

Graph

Graph Generation

Fast Graph Generative Model via Spectral Diffusion
Tianze Luo, Zhanfeng Mo, Sinno Jialin Pan
arXiv 2022. [Paper]
16 Nov 2022

Diffusion Models for Graphs Benefit From Discrete State Spaces
Kilian Konstantin Haefeli, Karolis Martinkus, Nathanaël Perraudin, Roger Wattenhofer
NeurIPS 2022. [Paper]
4 Oct 2022

DiGress: Discrete Denoising diffusion for graph generation
Clement Vignac¹, Igor Krawczuk¹, Antoine Siraudin, Bohan Wang, Volkan Cevher, Pascal Frossard
arXiv 2022. [Paper]
29 Sep 2022

Permutation Invariant Graph Generation via Score-Based Generative Modeling
Chenhao Niu, Yang Song, Jiaming Song, Shengjia Zhao, Aditya Grover, Stefano Ermon
AISTATS 2021. [Paper] [Github]
2 Mar 2020

Molecular and Material Generation

ParticleGrid: Enabling Deep Learning using 3D Representation of Materials
Shehtab Zaman, Ethan Ferguson, Cecile Pereira, Denis Akhiyarov, Mauricio Araya-Polo, Kenneth Chiu
arXiv 2022. [Paper]
15 Nov 2022

Structure-based Drug Design with Equivariant Diffusion Models
Arne Schneuing¹, Yuanqi Du¹, Charles Harris, Arian Jamasb, Ilia Igashov, Weitao Du, Tom Blundell, Pietro Lió, Carla Gomes, Max Welling, Michael Bronstein, Bruno Correia
arXiv 2022. [Paper]
24 Oct 2022

Protein Sequence and Structure Co-Design with Equivariant Translation
Chence Shi, Chuanrui Wang, Jiarui Lu, Bozitao Zhong, Jian Tang
arXiv 2022. [Paper]
17 Oct 2022

Equivariant 3D-Conditional Diffusion Models for Molecular Linker Design
Ilia Igashov, Hannes Stärk, Clément Vignac, Victor Garcia Satorras, Pascal Frossard, Max Welling, Michael Bronstein, Bruno Correia
arXiv 2022. [Paper]
11 Oct 2022

Dynamic-Backbone Protein-Ligand Structure Prediction with Multiscale Generative Diffusion Models
Zhuoran Qiao, Weili Nie, Arash Vahdat, Thomas F. Miller III, Anima Anandkumar
arXiv 2022. [Paper]
30 Sep 2022

Equivariant Energy-Guided SDE for Inverse Molecular Design
Fan Bao¹, Min Zhao¹, Zhongkai Hao, Peiyao Li, Chongxuan Li, Jun Zhu
arXiv 2022. [Paper]
30 Sep 2022

Protein structure generation via folding diffusion
Kevin E. Wu, Kevin K. Yang, Rianne van den Berg, James Y. Zou, Alex X. Lu, Ava P. Amini
arXiv 2022. [Paper]
30 Sep 2022

MDM: Molecular Diffusion Model for 3D Molecule Generation
Lei Huang, Hengtong Zhang, Tingyang Xu, Ka-Chun Wong
arXiv 2022. [Paper]
13 Sep 2022

Diffusion-based Molecule Generation with Informative Prior Bridges
Lemeng Wu¹, Chengyue Gong¹, Xingchao Liu, Mao Ye, Qiang Liu
NeurIPS 2022. [Paper]
2 Sep 2022

Antigen-Specific Antibody Design and Optimization with Diffusion-Based Generative Models
Shitong Luo¹, Yufeng Su¹, Xingang Peng, Sheng Wang, Jian Peng, Jianzhu Ma
BioRXiv 2022. [Paper]
11 July 2022

Data-driven discovery of novel 2D materials by deep generative models
Peder Lyngby, Kristian Sommer Thygesen
arXiv 2022. [Paper]
24 Jun 2022

Score-based Generative Models for Calorimeter Shower Simulation
Vinicius Mikuni, Benjamin Nachman
arXiv 2022. [Paper]
17 Jun 2022

Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem
Brian L. Trippe¹, Jason Yim¹, Doug Tischer, Tamara Broderick, David Baker, Regina Barzilay, Tommi Jaakkola
CoRR 2022. [Paper]
8 Jun 2022'

Torsional Diffusion for Molecular Conformer Generation
Bowen Jing, Gabriele Corso, Regina Barzilay, Tommi S. Jaakkola
ICLR Workshop 2022. [Paper] [Github]
1 Jun 2022

Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Models
Namrata Anand, Tudor Achim
arXiv 2022. [Paper] [Project] [Github]
26 May 2022

A Score-based Geometric Model for Molecular Dynamics Simulations
Fang Wu¹, Qiang Zhang¹, Xurui Jin, Yinghui Jiang, Stan Z. Li
CoRR 2022. [Paper]
19 Apr 2022

Equivariant Diffusion for Molecule Generation in 3D
Emiel Hoogeboom¹, Victor Garcia Satorras¹, Clément Vignac, Max Welling
ICML 2022. [Paper] [Github]
31 Mar 2022

GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation
Minkai Xu, Lantao Yu, Yang Song, Chence Shi, Stefano Ermon, Jian Tang
ICLR 2022. [Paper] [Github]
6 Mar 2022

Crystal Diffusion Variational Autoencoder for Periodic Material Generation
Tian Xie¹, Xiang Fu¹, Octavian-Eugen Ganea¹, Regina Barzilay, Tommi Jaakkola
NeurIPS 2021. [Paper] [Github]
12 Oct 2021

Predicting Molecular Conformation via Dynamic Graph Score Matching
Shitong Luo, Chence Shi, Minkai Xu, Jian Tang
NeurIPS 2021. [Paper]
22 May 2021

Reinforcement Learning

LAD: Language Augmented Diffusion for Reinforcement Learning
Edwin Zhang, Yujie Lu, William Wang, Amy Zhang
NeurIPS Workshop 2022. [Paper]
27 Oct 2022

Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning
Zhendong Wang, Jonathan J Hunt, Mingyuan Zhou
arXiv 2022. [Paper] [Github]
12 Oct 2022

Offline Reinforcement Learning via High-Fidelity Generative Behavior Modeling
Huayu Chen, Cheng Lu, Chengyang Ying, Hang Su, Jun Zhu
arXiv 2022. [Paper]
29 Sep 2022

Planning with Diffusion for Flexible Behavior Synthesis
Michael Janner, Yilun Du, Joshua B. Tenenbaum, Sergey Levine
ICML 2022. [Paper] [Github]
20 May 2022

Theory

Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions
Hongrui Chen, Holden Lee, Jianfeng Lu
arXiv 2022. [Paper]
3 Nov 2022

Diffusion Models for Causal Discovery via Topological Ordering
Pedro Sanchez, Xiao Liu, Alison Q O'Neil, Sotirios A. Tsaftaris
arXiv 2022. [Paper] [Github]
12 Oct 2022

Regularizing Score-based Models with Score Fokker-Planck Equations
Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
arXiv 2022. [Paper]
9 Oct 2022

Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models
Louis Sharrock, Jack Simons, Song Liu, Mark Beaumont
arXiv 2022. [Paper]
10 Oct 2022

Analyzing Diffusion as Serial Reproduction
Raja Marjieh, Ilia Sucholutsky, Thomas A. Langlois, Nori Jacoby, Thomas L. Griffiths
arXiv 2022. [Paper]
29 Sep 2022

Convergence of score-based generative modeling for general data distributions
Holden Lee, Jianfeng Lu, Yixin Tan
arXiv 2022. [Paper]
26 Sep 2022

Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
Sitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li, Adil Salim, Anru R. Zhang
arXiv 2022. [Paper]
22 Sep 2022

Riemannian Diffusion Models
Chin-Wei Huang, Milad Aghajohari, Avishek Joey Bose, Prakash Panangaden, Aaron Courville
NeurIPS 2022. [Paper]
16 Aug 2022

Convergence of denoising diffusion models under the manifold hypothesis
Valentin De Bortoli
arXiv 2022. [Paper]
10 Aug 2022

Theory and Algorithms for Diffusion Processes on Riemannian Manifolds
Bowen Jing, Gabriele Corso, Jeffrey Chang, Regina Barzilay, Tommi Jaakkola
arXiv 2022. [Paper] [Github]
1 Jun 2022

Riemannian Score-Based Generative Modeling
Valentin De Bortoli¹, Emile Mathieu¹, Michael Hutchinson, James Thornton, Yee Whye Teh, Arnaud Doucet
arXiv 2022. [Paper]
6 Feb 2022

Interpreting diffusion score matching using normalizing flow
Wenbo Gong¹, Yingzhen Li¹
ICML Workshop 2021. [Paper]
21 Jul 2021

A Connection Between Score Matching and Denoising Autoencoders
Pascal Vincent
Neural Computation 2011. [Paper]
7 Jul 2011

Bayesian Learning via Stochastic Gradient Langevin Dynamics
Max Welling, Yee Whye Teh
ICML 2011. [Paper] [Github]
20 Apr 2022

Applications

StructDiffusion: Object-Centric Diffusion for Semantic Rearrangement of Novel Objects
Weiyu Liu, Tucker Hermans, Sonia Chernova, Chris Paxton
arXiv 2022. [Paper]
8 Nov 2022

Categorical SDEs with Simplex Diffusion
Pierre H. Richemond, Sander Dieleman, Arnaud Doucet
arXiv 2022. [Paper]
26 Oct 2022

From Points to Functions: Infinite-dimensional Representations in Diffusion Models
Sarthak Mittal, Guillaume Lajoie, Stefan Bauer, Arash Mehrjou
arXiv 2022. [Paper] [Github]
25 Oct 2022

Graphically Structured Diffusion Models
Christian Weilbach, William Harvey, Frank Wood
arXiv 2022. [Paper]
20 Oct 2022

TransFusion: Transcribing Speech with Multinomial Diffusion
Matthew Baas, Kevin Eloff, Herman Kamper
SACAIR 2022. [Paper] [Github]
14 Oct 2022

Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Prediction
Dong Wei, Huaijiang Sun, Bin Li, Jianfeng Lu, Weiqing Li, Xiaoning Sun, Shengxiang Hu
arXiv 2022. [Paper]
12 Oct 2022

A generic diffusion-based approach for 3D human pose prediction in the wild
Saeed Saadatnejad, Ali Rasekh, Mohammadreza Mofayezi, Yasamin Medghalchi, Sara Rajabzadeh, Taylor Mordan, Alexandre Alahi
arXiv 2022. [Paper]
11 Oct 2022

DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics
Ivan Kapelyukh, Vitalis Vosylius, Edward Johns
arXiv 2022. [Paper]
5 Oct 2022

Denoising Diffusion Error Correction Codes
Yoni Choukroun, Lior Wolf
arXiv 2022. [Paper]
16 Sep 2022

Vector Quantized Diffusion Model with CodeUnet for Text-to-Sign Pose Sequences Generation
Pan Xie, Qipeng Zhang, Zexian Li, Hao Tang, Yao Du, Xiaohui Hu
arXiv 2022. [Paper]
19 Aug 2022

TopoDiff: A Performance and Constraint-Guided Diffusion Model for Topology Optimization
François Mazé, Faez Ahmed
arXiv 2022. [Paper]
20 Aug 2022

DeScoD-ECG: Deep Score-Based Diffusion Model for ECG Baseline Wander and Noise Removal
Huayu Li, Gregory Ditzler, Janet Roveda, Ao Li
arXiv 2022. [Paper]
31 Jul 2022

Recommendation via Collaborative Diffusion Generative Model
Joojo Walker, Ting Zhong, Fengli Zhang, Qiang Gao, Fan Zhou
KSEM 2022. [Paper]
19 Jul 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Project] [Github]
15 Jun 2022

CARD: Classification and Regression Diffusion Models
Xizewen Han¹, Huangjie Zheng¹, Mingyuan Zhou
NeurIPS 2022. [Paper]
15 Jun 2022

Neural Diffusion Processes
Vincent Dutordoir, Alan Saul, Zoubin Ghahramani, Fergus Simpson
arXiv 2022. [Paper]
8 Jun 2022

Deep Diffusion Models for Robust Channel Estimation
Marius Arvinte, Jonathan I Tamir
arXiv 2021. [Paper] [Github]
16 Nov 2021

Realistic galaxy image simulation via score-based generative models
Michael J. Smith (Hertfordshire), James E. Geach, Ryan A. Jackson, Nikhil Arora, Connor Stone, Stéphane Courteau
MNRAS 2022. [Paper]
2 Nov 2021

Diffusion models for Handwriting Generation
Troy Luhman¹, Eric Luhman¹
arXiv 2020. [Paper] [Github]
13 Nov 2020

superbia-zyb / awesome-diffusion-models Goto Github PK

awesome-diffusion-models's Introduction

Contents

Resources

Introductory Posts

Introductory Papers

Introductory Videos

Introductory Lectures

Tutorial and Jupyter Notebook

Papers

Survey

Vision

Image Generation

Segmentation

Image-to-Image Translation

Super Resolution

Image Inpainting

Image Editing

Text-to-Image

Medical Imaging

Video Generation

Point Cloud

Mesh

3D View

Human Motion Synthesis

Adversarial Attack

Miscellaneous

Audio

Audio Generation

Audio Conversion

Audio Enhancement

Text-to-Speech

Music Generation

Separation

Natural Language

Natural Language Generation

Tabular and Time Series

Generation

Forecasting

Imputation

Graph

Graph Generation

Molecular and Material Generation

Reinforcement Learning

Theory

Applications

awesome-diffusion-models's People

Contributors

Recommend Projects

Recommend Topics

Recommend Org