Discrete Diffusion Reading Group

Exploring diffusion-based generative models on discrete spaces.

About the Reading Group

Diffusion LLMs are faster, more controllable successors to traditional LLMs and are rapidly gaining adoption. This reading group aims to build a community for exchanging and debating emerging ideas in this space. While our primary focus is discrete diffusion models for language, we also invite work that extends these methods to other modalities and applications—such as molecular design, drug discovery, and beyond. Each session features an author-led presentation followed by Q&A, with recordings shared on our YouTube channel.

Paper Discussions

Authors present their work followed by discussions and Q&A sessions

Recorded Sessions

All sessions are recorded and available on YouTube

Community

Stay informed through our email list and Twitter/X

Meet the Organizers

Subham Sekhar Sahoo

Subham Sahoo

Holds a Ph.D. from Cornell Tech, where he specialized in Diffusion Language Models. He has made foundational contributions to the field, with his work deployed at scale by Google, NVIDIA, and ByteDance across language generation and drug discovery.

Justin Deschenaux

Justin Deschenaux

PhD student in Machine Learning at EPFL, advised by Prof. Caglar Gulcehre. Previously completed Bachelor's and Master's degrees in Telecommunication System and interned at Apple MLR. His research interests include diffusion language models, fast generative models, and generalization.

Zhihan Yang

Zhihan Yang

PhD student at Cornell CS. Previously completed his Bachelor's degrees in Mathematics and Statistics at Carleton College. He is a winner of the CRA Outstanding Undergraduate Researcher Award and his research focuses on principled, controllable, and efficient generative models.

Upcoming Sessions

Next Session: TBD

Topic and date will be announced soon. Stay tuned!

Latest Past Sessions

View All Sessions

No Past Sessions Yet

Past sessions will appear here once we start recording.

Latest Relevant Videos

View All Videos
But How Do Diffusion Language Models Actually Work?
12:27

But How Do Diffusion Language Models Actually Work?

Jia-Bin Huang explores several ideas for applying diffusion models to language modeling

August 3, 2025 Click to read description
Simple Guidance Mechanisms for Discrete Diffusion Models
7:00

Simple Guidance Mechanisms for Discrete Diffusion Models

Simple Guidance Mechanisms for Discrete Diffusion Models (ICLR 2025 video)

April 15, 2025 Click to read description
Simple Diffusion Language Models
15:07

Simple Diffusion Language Models

Quick introduction to Masked Diffusion Language Models (MDLM) by Alexander Rush

July 3, 2024 Click to read description

Stay Updated

Get notified about new sessions and discussions

Follow on Twitter/X

Get updates about upcoming sessions and research highlights.

Follow @diffusion_llms

Join Email List

Receive announcements and session reminders via email.

To join, go to our Google Group, sign in with your Google account, and click "Join".

Join Group

Join Discord

Chat with the community and discuss papers.

Announcements posted on Twitter, Discord and Google Group.

Join Discord