I am a Research Scientist at Apple AI/ML, working on multimodal learning for Apple Foundation Models. I completed my Ph.D. in Computer Science at UCLA, advised by Prof. Nanyun (Violet) Peng, focusing on multimodal learning. During my Ph.D., I received the Amazon PhD Fellowship and the JPMC PhD Fellowship. I earned my M.S. at Carnegie Mellon University under Prof. Graham Neubig, specializing in NLP, and my B.S. from the KYM Honors School at Nanjing University.
Publications ( show selected )
Apple Intelligence Foundation Language Models 2025
Tech Report 2025
Re-ReST: Reflection-Reinforced Self-Training for Language Agents
Zi-Yi Dou, Cheng-Fu Yang, Xueqing Wu, Kai-Wei Chang, Nanyun Peng
EMNLP 2024
VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models
Haoyi Qiu*, Wenbo Hu*, Zi-Yi Dou, Nanyun Peng
ACL-Findings 2024
DesCo: Learning Object Recognition with Rich Language Descriptions
Liunian Harold Li*, Zi-Yi Dou*, Nanyun Peng, Kai-Wei Chang
NeurIPS 2023
Masked Path Modeling for Vision-and-Language Navigation
Zi-Yi Dou, Feng Gao, Nanyun Peng
EMNLP-Findings 2023
FOAM: A Follower-aware Speaker Model for Vision-and-Language Navigation
Zi-Yi Dou, Nanyun Peng
NAACL 2022
Explainaboard: An Explainable Leaderboard for NLP
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaicheng Chang, Junqi Dai, Yixin Liu, Zi-Yi Dou, Graham Neubig
ACL 2021 Demo Best Demo
awesome-align: Word Alignment by Fine-tuning Embeddings on Parallel Corpora
Zi-Yi Dou, Graham Neubig
EACL 2021
CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems
Yiran Chen, Pengfei Liu, Ming Zhong, Zi-Yi Dou, Danqing Wang, Xipeng Qiu, Xuanjing Huang
EMNLP-Findings 2020
TICO-19: the Translation Initiative for COvid-19
Antonios Anastasopoulos, Alessandro Cattelan, Zi-Yi Dou, Marcello Federico, Christian Federman, Dmitriy Genzel, Francisco Guzmán, Junjie Hu, Macduff Hughes, Philipp Koehn, Rosie Lazar, Will Lewis, Graham Neubig, Mengmeng Niu, Alp Öktem, Eric Paquin, Grace Tang, Sylwia Tur
EMNLP 2020 Workshop on NLP-COVID
A Deep Reinforced Model for Zero-Shot Cross-Lingual Summarization with Bilingual Semantic Similarity Rewards
Zi-Yi Dou, Sachin Kumar, Yulia Tsvetkov
ACL 2020 Workshop on Neural Generation and Translation
Domain Differential Adaptation for Neural Machine Translation
Zi-Yi Dou, Xinyi Wang, Junjie Hu, Graham Neubig
EMNLP 2019 Workshop on Neural Generation and Translation
Information Aggregation for Multi-Head Attention
Jian Li, Baosong Yang, Zi-Yi Dou, Xing Wang, Michael R. Lyu, Zhaopeng Tu
NAACL 2019
Exploiting Deep Representations for Neural Machine Translation
Zi-Yi Dou, Zhaopeng Tu, Xing Wang, Shuming Shi, Tong Zhang
EMNLP 2018
Unsupervised Bilingual Lexicon Induction via Latent Variable Models
Zi-Yi Dou, Zhi-Hao Zhou, Shujian Huang
EMNLP 2018
SkipNet: Learning Dynamic Routing in Convolutional Networks
Xin Wang, Fisher Yu, Zi-Yi Dou, Trevor Darrel, Joseph E. Gonzalez
ECCV 2018
Experience
Apple AI/ML, 01/2025-
Research Scientist at the Multimodal Foundation Model team
Meta AI, 06/2024-10/2024
Research Intern with the Segment Anything (SAM) team at FAIR Perception
Meta AI, 06/2023-12/2023
Research Intern with the Ego4D team at FAIR Multimodal Foundations
Microsoft, 05/2021-08/2021 & 06/2022-09/2022
Research Intern at Project Florence-Vision and Language
Tencent AI Lab, 02/2018-08/2018
Research Intern at the Machine Translation Team
Education
University of California, Los Angeles, 08/2020-01/2025
Ph.D. in Computer Science
Carnegie Mellon University, 08/2018-08/2020
Master of Science in Language Technologies
Nanjing University, 09/2014-07/2018
Bachelor of Science in Computer Science, Minor in Statistics
Service
Area Chair for ACL, EMNLP, ACL Rolling Review
Reviewer for ACL, EMNLP, NAACL, ACL Rolling Review, ICML, NeurIPS, ICLR, CVPR, ICCV, ECCV, AAAI