Papers

My full list of papers can be found at my Google Scholar.

2026

Compile by Training: Turning Natural-Language Specifications into Local Neural Functions
Yuntian Deng, Pengyu Nie, Stuart Shieber.
EMNLP 2026 Demo
Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs
Wentao Zhang, Shariyar Murtaza, Junaid Bhatti, Utkarsh Soni, Yifan Nie, Eugene Wen, Yuntian Deng.
EMNLP 2026 Findings
Figure from Program-as-Weights: A Programming Paradigm for Fuzzy Functions
Program-as-Weights: A Programming Paradigm for Fuzzy Functions
Wentao Zhang*, Liliana Hotsko*, Woojeong Kim*, Pengyu Nie, Stuart Shieber, Yuntian Deng.
arXiv 2026 code
Figure from NeuralOS: Towards Simulating Operating Systems via Neural Generative Models
NeuralOS: Towards Simulating Operating Systems via Neural Generative Models
Luke Rivard, Sun Sun, Hongyu Guo, Wenhu Chen, Yuntian Deng.
ICLR 2026 code
Figure from Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution
Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution
Liliana Hotsko, Yinxi Li, Yuntian Deng, Pengyu Nie.
arXiv 2026
Figure from DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities
DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities
Sajad Ebrahimi, Nima Jamali, Bardia Shirsalimian, Kelly McConvey, Wentao Zhang, Jalehsadat Mahdavimoghaddam, Maksym Taranukhin, Maura R. Grossman, Vered Shwartz, Yuntian Deng, Ebrahim Bagheri.
arXiv 2026
Figure from The CIFAR Synthetic Evidence Corpus for Detecting AI-Generated Evidence
The CIFAR Synthetic Evidence Corpus for Detecting AI-Generated Evidence
Kelly McConvey, Jalehsadat Mahdavimoghaddam, Nima Jamali, Maksym Taranukhin, Sajad Ebrahimi, Wentao Zhang, Karen Eltis, Yuntian Deng, Maura R. Grossman, Vered Shwartz, Ebrahim Bagheri.
arXiv 2026
Figure from The AI Observatory: A Public Measure of Real-World AI Use
The AI Observatory: A Public Measure of Real-World AI Use
Shayne Longpre, Anka Reuel, Dayeon Ki, Zhiping Zhang, Cathy Mengying Fang, Chuanyang Jin, Jennifer Mickel, Cedric Deslandes Whitney, Niloofar Mireshghallah, Victor Ojewale, Megan Richards, Ariel N. Lee, Alex Pentland, Tianshi Li, Yuntian Deng, Sara Hooker, Mykel Kochenderfer, Sanmi Koyejo.
Preprint
Featured on The Washington Post homepage
Long-form coverage in MIT Technology Review
Figure from Long Grounded Thoughts: Synthesizing Visual Problems and Reasoning Chains at Scale
Long Grounded Thoughts: Synthesizing Visual Problems and Reasoning Chains at Scale
David Acuna, Chao-Han Huck Yang, Yuntian Deng, Jaehun Jung, Ximing Lu, Prithviraj Ammanabrolu, Hyunwoo Kim, Yuan-Hong Liao, Yejin Choi.
ICML 2026
Figure from TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar
TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar
Yinxi Li, Yuntian Deng, Pengyu Nie.
ACL 2026
Figure from Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
Wei Liu, Ruochen Zhou, Yiyun Deng, Yuzhen Huang, Junteng Liu, Yuntian Deng, Yizhe Zhang, Junxian He.
ICLR 2026

2025

Figure from Interactive Training: Feedback-Driven Neural Network Optimization
Interactive Training: Feedback-Driven Neural Network Optimization
Wentao Zhang, Yang Young Lu, Yuntian Deng.
EMNLP 2025 Demo code
Figure from From Chat Logs to Collective Insights: Aggregative Question Answering
From Chat Logs to Collective Insights: Aggregative Question Answering
Wentao Zhang, Woojeong Kim, Yuntian Deng.
EMNLP 2025 (Oral)
Figure from Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls
Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls
Xiaoyan Bai, Itamar Pres, Yuntian Deng, Chenhao Tan, Stuart Shieber, Fernanda Viégas, Martin Wattenberg, Andrew Lee.
arXiv 2025
Figure from The Leaderboard Illusion
The Leaderboard Illusion
Shivalika Singh, Yiyang Nan, Alex Wang, Daniel D'Souza, Sayash Kapoor, Ahmet Üstün, Sanmi Koyejo, Yuntian Deng, Shayne Longpre, Noah A. Smith, Beyza Ermis, Marzieh Fadaee, Sara Hooker.
NeurIPS 2025 Datasets & Benchmarks Track
Figure from Mix-of-Language-Experts Architecture for Multilingual Programming
Mix-of-Language-Experts Architecture for Multilingual Programming
Yifan Zong, Yuntian Deng, Pengyu Nie.
LLM4Code 2025
Figure from Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Zhangchen Xu, Fengqing Jiang, Luyao Niu, Yuntian Deng, Radha Poovendran, Yejin Choi, Bill Yuchen Lin.
ICLR 2025 code
Figure from WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
Bill Yuchen Lin, Yuntian Deng, Khyathi Chandu, Faeze Brahman, Abhilasha Ravichander, Valentina Pyatkin, Nouha Dziri, Ronan Le Bras, Yejin Choi.
ICLR 2025 (Spotlight) code

2024

Figure from From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step
From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step
Yuntian Deng, Yejin Choi, Stuart Shieber.
arXiv 2024 code
Figure from WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries
WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries
Wenting Zhao, Tanya Goyal, Yu Ying Chiu, Liwei Jiang, Benjamin Newman, Abhilasha Ravichander, Khyathi Chandu, Ronan Le Bras, Claire Cardie, Yuntian Deng, Yejin Choi.
arXiv 2024
Figure from WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild
WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild
Yuntian Deng, Wenting Zhao, Jack Hessel, Xiang Ren, Claire Cardie, Yejin Choi.
EMNLP 2024 Demo code
Figure from WildChat: 1M ChatGPT Interaction Logs in the Wild
WildChat: 1M ChatGPT Interaction Logs in the Wild
Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, Yuntian Deng.
ICLR 2024 (Spotlight) code
Featured in the Washington Post
Used in OpenAI's o1 for safety evaluation
Used in Anthropic's Claude 3 for evaluating refusals
Figure from MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
Jinjie Ni, Fuzhao Xue, Xiang Yue, Yuntian Deng, Mahir Shah, Kabir Jain, Graham Neubig, Yang You.
NeurIPS 2024 code

2023

Figure from Implicit Chain of Thought Reasoning via Knowledge Distillation
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber.
arXiv 2023 code
Figure from Tree Prompting: Efficient Task Adaptation without Fine-Tuning
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
John Xavier Morris*, Chandan Singh*, Alexander M. Rush, Jianfeng Gao, Yuntian Deng.
EMNLP 2023 code
Figure from Markup-to-Image Diffusion Models with Scheduled Sampling
Markup-to-Image Diffusion Models with Scheduled Sampling
Yuntian Deng, Noriyuki Kojima, Alexander M. Rush.
ICLR 2023
Figure from Semi-Parametric Inducing Point Networks and Neural Processes
Semi-Parametric Inducing Point Networks and Neural Processes
Richa Rastogi, Yair Schiff, Alon Hacohen, Zhaozhi Li, Ian Lee, Yuntian Deng, Mert R. Sabuncu, Volodymyr Kuleshov.
ICLR 2023
Figure from GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics
GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics
Maxim Zvyagin*, Alexander Brace*, Kyle Hippe*, Yuntian Deng*, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot-Sasson, Murali Emani, Sam Foreman, Zhen Xie, Diangen Lin, Maulik Shukla, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin, Rick Stevens, Anima Anandkumar, Venkatram Vishwanath, Arvind Ramanathan.
The International Journal of High Performance Computing Applications 2023 (ACM Gordon Bell Special Prize for COVID-19 Research)

2022

Figure from Model Criticism for Long-Form Text Generation
Model Criticism for Long-Form Text Generation
Yuntian Deng, Volodymyr Kuleshov, Alexander M Rush.
EMNLP 2022

2021

Figure from Low-Rank Constraints for Fast Inference in Structured Models
Low-Rank Constraints for Fast Inference in Structured Models
Justin Chiu*, Yuntian Deng*, Alexander M. Rush.
NeurIPS 2021 slides
Figure from Sequence-to-Lattice Models for Fast Translation
Sequence-to-Lattice Models for Fast Translation
Yuntian Deng, Alexander M. Rush.
EMNLP 2021 Findings slides
Figure from Rationales for Sequential Predictions
Rationales for Sequential Predictions
Keyon Vafa, Yuntian Deng, David Blei, Alexander Rush.
EMNLP 2021 (Oral)
Figure from Residual Energy-Based Models for Text
Residual Energy-Based Models for Text
Anton Bakhtin*, Yuntian Deng*, Sam Gross, Myle Ott, Marc'Aurelio Ranzato, Arthur Szlam.
JMLR 2021

2020

Figure from Cascaded Text Generation with Markov Transformers
Cascaded Text Generation with Markov Transformers
Yuntian Deng, Alexander M. Rush.
NeurIPS 2020 slides
Figure from Residual Energy-Based Models for Text Generation
Residual Energy-Based Models for Text Generation
Yuntian Deng, Anton Bakhtin, Myle Ott, Arthur Szlam, Marc'Aurelio Ranzato.
ICLR 2020 code slides
Referenced by Meta's Llama 2
Referenced by the diffusion paper (DDPM)
Figure from Algorithm-Hardware Co-Design of Adaptive Floating-Point Encodings for Resilient Deep Learning Inference
Algorithm-Hardware Co-Design of Adaptive Floating-Point Encodings for Resilient Deep Learning Inference
Thierry Tambe, En-Yu Yang, Zishen Wan, Yuntian Deng, Vijay Janapa Reddi, Alexander Rush, David Brooks, Gu-Yeon Wei.
DAC 2020 (Best Paper Award)

2019

Figure from Real or Fake? Learning to Discriminate Machine from Human Generated Text
Real or Fake? Learning to Discriminate Machine from Human Generated Text
Anton Bakhtin, Sam Gross, Myle Ott, Yuntian Deng, Marc'Aurelio Ranzato, Arthur Szlam.
arXiv 2019
Figure from Neural Linguistic Steganography
Neural Linguistic Steganography
Zachary Ziegler*, Yuntian Deng*, Alexander Rush.
EMNLP 2019 (Oral)
Figure from Challenges in end-to-end neural scientific table recognition
Challenges in end-to-end neural scientific table recognition
Yuntian Deng, David Rosenberg, Gideon Mann.
ICDAR 2019

2018

Figure from Latent Alignment and Variational Attention
Latent Alignment and Variational Attention
Yuntian Deng*, Yoon Kim*, Justin Chiu, Demi Guo, Alexander M. Rush.
NeurIPS 2018 code
Figure from Bottom-Up Abstractive Summarization
Bottom-Up Abstractive Summarization
Sebastian Gehrmann, Yuntian Deng, Alexander Rush.
EMNLP 2018

2017

Figure from Image-to-Markup Generation with Coarse-to-Fine Attention
Image-to-Markup Generation with Coarse-to-Fine Attention
Yuntian Deng, Anssi Kanervisto, Jeffrey Ling, and Alexander M. Rush.
ICML 2017 code slides
Figure from OpenNMT: Open-Source Toolkit for Neural Machine Translation
OpenNMT: Open-Source Toolkit for Neural Machine Translation
Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, Alexander M. Rush.
ACL 2017 Demo (Best Demonstration Paper Runner-Up) code
Figure from Learning Latent Space Models with Angular Constraints
Learning Latent Space Models with Angular Constraints
Pengtao Xie, Yuntian Deng, Yi Zhou, Abhimanu Kumar, Yaoliang Yu, James Zou, Eric P Xing.
ICML 2017
Figure from Neural Machine Translation with Recurrent Attention Modeling
Neural Machine Translation with Recurrent Attention Modeling
Zichao Yang, Zhiting Hu, Yuntian Deng, Chris Dyer, Alex Smola.
EACL 2017 slides
Figure from Dropout with expectation-linear regularization
Dropout with expectation-linear regularization
Xuezhe Ma, Yingkai Gao, Zhiting Hu, Yaoliang Yu, Yuntian Deng, Eduard Hovy.
ICLR 2017

2016

Figure from Learning Concept Taxonomies from Multi-modal Data
Learning Concept Taxonomies from Multi-modal Data
Hao Zhang, Zhiting Hu, Yuntian Deng, Mrinmaya Sachan, Zhicheng Yan, Eric P. Xing.
ACL 2016

2015

Figure from Diversifying Restricted Boltzmann Machine for Document Modeling
Diversifying Restricted Boltzmann Machine for Document Modeling
Pengtao Xie, Yuntian Deng, Eric P. Xing.
KDD 2015
Figure from Entity Hierarchy Embedding
Entity Hierarchy Embedding
Zhiting Hu, Poyao Huang, Yuntian Deng, Yingkai Gao, Eric P. Xing.
ACL 2015