Papers

My full list of papers can be found at my Google Scholar.

2026

Figure from NeuralOS: Towards Simulating Operating Systems via Neural Generative Models
NeuralOS: Towards Simulating Operating Systems via Neural Generative Models
Luke Rivard, Sun Sun, Hongyu Guo, Wenhu Chen, Yuntian Deng.
ICLR 2026 code
Figure from Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
Wei Liu, Ruochen Zhou, Yiyun Deng, Yuzhen Huang, Junteng Liu, Yuntian Deng, Yizhe Zhang, Junxian He.
ICLR 2026

2025

Figure from Interactive Training: Feedback-Driven Neural Network Optimization
Interactive Training: Feedback-Driven Neural Network Optimization
Wentao Zhang, Yang Young Lu, Yuntian Deng.
EMNLP 2025 Demo code
Figure from From Chat Logs to Collective Insights: Aggregative Question Answering
From Chat Logs to Collective Insights: Aggregative Question Answering
Wentao Zhang, Woojeong Kim, Yuntian Deng.
EMNLP 2025 (Oral)
Figure from Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Zhangchen Xu, Fengqing Jiang, Luyao Niu, Yuntian Deng, Radha Poovendran, Yejin Choi, Bill Yuchen Lin.
ICLR 2025 code
Figure from WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
Bill Yuchen Lin, Yuntian Deng, Khyathi Chandu, Faeze Brahman, Abhilasha Ravichander, Valentina Pyatkin, Nouha Dziri, Ronan Le Bras, Yejin Choi.
ICLR 2025 (Spotlight) code

2024

Figure from From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step
From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step
Yuntian Deng, Yejin Choi, Stuart Shieber.
arXiv 2024 code
Figure from Implicit Chain of Thought Reasoning via Knowledge Distillation
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber.
arXiv 2023 code
Figure from WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries
WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries
Wenting Zhao, Tanya Goyal, Yu Ying Chiu, Liwei Jiang, Benjamin Newman, Abhilasha Ravichander, Khyathi Chandu, Ronan Le Bras, Claire Cardie, Yuntian Deng, Yejin Choi.
arXiv 2024
Figure from WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild
WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild
Yuntian Deng, Wenting Zhao, Jack Hessel, Xiang Ren, Claire Cardie, Yejin Choi.
EMNLP 2024 Demo code
Figure from WildChat: 1M ChatGPT Interaction Logs in the Wild
WildChat: 1M ChatGPT Interaction Logs in the Wild
Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, Yuntian Deng.
ICLR 2024 (Spotlight) code
Featured in the Washington Post
Used in OpenAI's o1 for safety evaluation
Used in Anthropic's Claude 3 for evaluating refusals
Figure from MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
Jinjie Ni, Fuzhao Xue, Xiang Yue, Yuntian Deng, Mahir Shah, Kabir Jain, Graham Neubig, Yang You.
NeurIPS 2024 code

2023

Figure from Tree Prompting: Efficient Task Adaptation without Fine-Tuning
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
John Xavier Morris*, Chandan Singh*, Alexander M. Rush, Jianfeng Gao, Yuntian Deng.
EMNLP 2023 code
Figure from Markup-to-Image Diffusion Models with Scheduled Sampling
Markup-to-Image Diffusion Models with Scheduled Sampling
Yuntian Deng, Noriyuki Kojima, Alexander M. Rush.
ICLR 2023
Figure from Semi Parametric Inducing Point Networks
Semi Parametric Inducing Point Networks
Richa Rastogi, Yair Schiff, Alon Hacohen, Zhaozhi Li, Ian Lee, Yuntian Deng, Mert R. Sabuncu, Volodymyr Kuleshov.
ICLR 2023

2022

Figure from Model Criticism for Long-Form Text Generation
Model Criticism for Long-Form Text Generation
Yuntian Deng, Volodymyr Kuleshov, Alexander M Rush.
EMNLP 2022
Figure from GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics
GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics
Maxim Zvyagin*, Alexander Brace*, Kyle Hippe*, Yuntian Deng*, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot, Murali Emani, Sam Foreman, Zhen Xie, Diangen Lin, Maulik Shukla, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin, Rick Stevens, Anima Anandkumar, Venkatram Vishwanath, Arvind Ramanathan.
ACM Gordon Bell Special Prize for Covid Research

2021

Figure from Low-Rank Constraints for Fast Inference in Structured Models
Low-Rank Constraints for Fast Inference in Structured Models
Justin Chiu*, Yuntian Deng*, Alexander M. Rush.
NeurIPS 2021 slides
Figure from Sequence-to-Lattice Models for Fast Translation
Sequence-to-Lattice Models for Fast Translation
Yuntian Deng, Alexander M. Rush.
EMNLP 2021 Findings slides
Figure from Rationales for Sequential Predictions
Rationales for Sequential Predictions
Keyon Vafa, Yuntian Deng, David Blei, Alexander Rush.
EMNLP 2021 (oral)
Figure from Residual Energy-Based Models for Text
Residual Energy-Based Models for Text
Anton Bakhtin*, Yuntian Deng*, Sam Gross, Myle Ott, Marc'Aurelio Ranzato, Arthur Szlam.
JMLR 2021

2020

Figure from Cascaded Text Generation with Markov Transformers
Cascaded Text Generation with Markov Transformers
Yuntian Deng, Alexander M. Rush.
NeurIPS 2020 slides
Figure from Residual Energy-Based Models for Text Generation
Residual Energy-Based Models for Text Generation
Yuntian Deng, Anton Bakhtin, Myle Ott, Arthur Szlam, Marc'Aurelio Ranzato.
ICLR 2020 code slides
Referenced by Meta's Llama 2
Referenced by the diffusion paper (DDPM)
Figure from AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference
AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference
Thierry Tambe, En-Yu Yang, Zishen Wan, Yuntian Deng, Vijay Janapa Reddi, Alexander Rush, David Brooks, Gu-Yeon Wei.
DAC 2020 (Best Paper)

2019

Figure from Neural Linguistic Steganography
Neural Linguistic Steganography
Zachary Ziegler*, Yuntian Deng*, Alexander Rush.
EMNLP 2019 (oral)
Figure from Challenges in end-to-end neural scientific table recognition
Challenges in end-to-end neural scientific table recognition
Yuntian Deng, David Rosenberg, Gideon Mann.
ICDAR 2019

2018

Figure from Latent Alignment and Variational Attention
Latent Alignment and Variational Attention
Yuntian Deng*, Yoon Kim*, Justin Chiu, Demi Guo, Alexander M. Rush.
NeurIPS 2018 code
Figure from Bottom-Up Abstractive Summarization
Bottom-Up Abstractive Summarization
Sebastian Gehrmann, Yuntian Deng, Alexander Rush.
EMNLP 2018

2017

Figure from Image-to-Markup Generation with Coarse-to-Fine Attention
Image-to-Markup Generation with Coarse-to-Fine Attention
Yuntian Deng, Anssi Kanervisto, Jeffrey Ling, and Alexander M. Rush.
ICML 2017 code slides
Figure from OpenNMT: Open-Source Toolkit for Neural Machine Translation
OpenNMT: Open-Source Toolkit for Neural Machine Translation
Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander M. Rush.
ACL 2017 Demo (Best Demo Runner-up) code
Figure from Learning Latent Space Models with Angular Constraints
Learning Latent Space Models with Angular Constraints
Pengtao Xie, Yuntian Deng, Yi Zhou, Abhimanu Kumar, Yaoliang Yu, James Zou, Eric P Xing.
ICML 2017
Figure from Neural Machine Translation with Recurrent Attention Modeling
Neural Machine Translation with Recurrent Attention Modeling
Zichao Yang, Zhiting Hu, Yuntian Deng, Chris Dyer, Alex Smola.
EACL 2017 slides
Figure from Dropout with expectation-linear regularization
Dropout with expectation-linear regularization
Xuezhe Ma, Yingkai Gao, Zhiting Hu, Yaoliang Yu, Yuntian Deng, Eduard Hovy.
ICLR 2017

2016

Figure from Learning Concept Taxonomies from Multi-modal Data
Learning Concept Taxonomies from Multi-modal Data
Hao Zhang, Zhiting Hu, Yuntian Deng, Mrinmaya Sachan, Zhicheng Yan, Eric P. Xing.
ACL 2016

2015

Figure from Diversifying Restricted Boltzmann Machine for Document Modeling
Diversifying Restricted Boltzmann Machine for Document Modeling
Pengtao Xie, Yuntian Deng, Eric P. Xing.
KDD 2015
Figure from Entity Hierarchy Embedding
Entity Hierarchy Embedding
Zhiting Hu, Poyao Huang, Yuntian Deng, Yingkai Gao, Eric P. Xing.
ACL 2015