Publications
* denotes equal contribution.
DySCO: Dynamic Attention-Scaling Decoding for Long-Context LMs
Xi Ye*, Wuwei Zhang*, Fangcong Yin, Howard Yen, Danqi Chen.
Preprint, 2026.
[Paper][Code]
Xi Ye*, Wuwei Zhang*, Fangcong Yin, Howard Yen, Danqi Chen.
Preprint, 2026.
[Paper][Code]
Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
Howard Yen, Yoonsang Lee, Ashwin Paranjape, Mengzhou Xia, Thejas Venkatesh, Jack Hessel, Danqi Chen, Yuhao Zhang.
To Appear in Proceedings of COLM, 2026.
[Paper][Code]
Howard Yen, Yoonsang Lee, Ashwin Paranjape, Mengzhou Xia, Thejas Venkatesh, Jack Hessel, Danqi Chen, Yuhao Zhang.
To Appear in Proceedings of COLM, 2026.
[Paper][Code]
Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks
Yoonsang Lee, Howard Yen, Xi Ye, Danqi Chen.
To Appear in Proceedings of COLM, 2026.
[Paper][Code]
Yoonsang Lee, Howard Yen, Xi Ye, Danqi Chen.
To Appear in Proceedings of COLM, 2026.
[Paper][Code]
Precise Information Control in Long-Form Text Generation
Jacqueline He, Howard Yen*, Margaret Li*, Shuyue Stella Li, Zhiyuan Zeng, Weijia Shi, Yulia Tsvetkov, Danqi Chen, Pang Wei Koh, and Luke Zettlemoyer.
Proceedings of NeurIPS, 2025.
[Paper][Code]
Jacqueline He, Howard Yen*, Margaret Li*, Shuyue Stella Li, Zhiyuan Zeng, Weijia Shi, Yulia Tsvetkov, Danqi Chen, Pang Wei Koh, and Luke Zettlemoyer.
Proceedings of NeurIPS, 2025.
[Paper][Code]
Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking
Wuwei Zhang, Fangcong Yin, Howard Yen, Danqi Chen, and Xi Ye.
Proceedings of EMNLP, 2025.
[Paper][Code]
Wuwei Zhang, Fangcong Yin, Howard Yen, Danqi Chen, and Xi Ye.
Proceedings of EMNLP, 2025.
[Paper][Code]
LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
Xi Ye, Fangcong Yin, Yinghui He, Joie Zhang, Howard Yen, Tianyu Gao, Greg Durrett, and Danqi Chen.
Proceedings of COLM, 2025.
[Paper][Code][Site]
Xi Ye, Fangcong Yin, Yinghui He, Joie Zhang, Howard Yen, Tianyu Gao, Greg Durrett, and Danqi Chen.
Proceedings of COLM, 2025.
[Paper][Code][Site]
How to Train Long-Context Language Models (Effectively)
Tianyu Gao*, Alexander Wettig*, Howard Yen, and Danqi Chen.
Proceedings of ACL, 2025.
[Paper][Code]
Tianyu Gao*, Alexander Wettig*, Howard Yen, and Danqi Chen.
Proceedings of ACL, 2025.
[Paper][Code]
Improving Interpersonal Communication by Simulating Audiences with Language Models
Ryan Liu, Howard Yen, Raja Marjieh, Thomas L. Griffiths, and Ranjay Krishna.
Proceedings of CogSci, 2025.
[Paper][Code]
Ryan Liu, Howard Yen, Raja Marjieh, Thomas L. Griffiths, and Ranjay Krishna.
Proceedings of CogSci, 2025.
[Paper][Code]
HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly
Howard Yen, Tianyu Gao, Minmin Hou, Ke Ding, Daniel Fleischer, Peter Izsak, Moshe Wasserblat, and Danqi Chen.
Proceedings of ICLR, 2025.
[Paper][Code][Site][Blog]
Howard Yen, Tianyu Gao, Minmin Hou, Ke Ding, Daniel Fleischer, Peter Izsak, Moshe Wasserblat, and Danqi Chen.
Proceedings of ICLR, 2025.
[Paper][Code][Site][Blog]
BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
Hongjin Su*, Howard Yen*, Mengzhou Xia*, Weijia Shi, Niklas Muennighoff, Han-yu Wang, Haisu Liu, Quan Shi, Zachary S. Siegel, Michael Tang, Ruoxi Sun, Jinsung Yoon, Sercan O. Arik, Danqi Chen, and Tao Yu.
Proceedings of ICLR, 2025. Spotlight (top 5.1%).
[Paper][Code][Site]
Hongjin Su*, Howard Yen*, Mengzhou Xia*, Weijia Shi, Niklas Muennighoff, Han-yu Wang, Haisu Liu, Quan Shi, Zachary S. Siegel, Michael Tang, Ruoxi Sun, Jinsung Yoon, Sercan O. Arik, Danqi Chen, and Tao Yu.
Proceedings of ICLR, 2025. Spotlight (top 5.1%).
[Paper][Code][Site]
MMTEB: Massive Multilingual Text Embedding Benchmark
Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, ..., Howard Yen, ..., Orion Weller, Siva Reddy, Niklas Muennighoff.
Proceedings of ICLR, 2025.
[Paper][Code]
Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, ..., Howard Yen, ..., Orion Weller, Siva Reddy, Niklas Muennighoff.
Proceedings of ICLR, 2025.
[Paper][Code]
Long-Context Language Modeling with Parallel Context Encoding
Howard Yen, Tianyu Gao, and Danqi Chen.
Proceedings of ACL, 2024.
[Paper][Code]
Howard Yen, Tianyu Gao, and Danqi Chen.
Proceedings of ACL, 2024.
[Paper][Code]