I am a final-year Ph.D. student in Computer Science at UCLA, under the guidance of Prof. Nanyun (Violet) Peng. I earned my M.S. from the Language Technologies Institute at Carnegie Mellon University, where I was advised by Prof. Graham Neubig. Prior to that, I obtained my B.S. from the KYM Honors School at Nanjing University.
During my Ph.D., my research has centered on vision-language learning. I have worked on pretraining image-language and video-language models, applying them to perception and embodied tasks. Previously, I focused on natural language processing, particularly in the areas of multilingual learning and text generation.
I am a recipient of the Amazon PhD Fellowship and the J.P. Morgan Chase PhD Fellowship.
Publications ( show selected | show all | show by topic )
Topics:
Multimodal Learning |
Model Evaluation |
Embodied Agents |
Multilingual Learning |
Text Generation
(* indicates equal contribution)
Re-ReST: Reflection-Reinforced Self-Training for Language Agents
Zi-Yi Dou, Cheng-Fu Yang, Xueqing Wu, Kai-Wei Chang, Nanyun Peng
EMNLP 2024
VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models
Haoyi Qiu*, Wenbo Hu*, Zi-Yi Dou, Nanyun Peng
ACL-Findings 2024
Masked Path Modeling for Vision-and-Language Navigation
Zi-Yi Dou, Feng Gao, Nanyun Peng
EMNLP-Findings 2023
FOAM: A Follower-aware Speaker Model for Vision-and-Language Navigation
Zi-Yi Dou, Nanyun Peng
NAACL 2022
Explainaboard: An Explainable Leaderboard for NLP
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaicheng Chang, Junqi Dai, Yixin Liu, Zi-Yi Dou, Graham Neubig
ACL 2021 Demo Best Demo
awesome-align: Word Alignment by Fine-tuning Embeddings on Parallel Corpora
Zi-Yi Dou, Graham Neubig
EACL 2021
CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems
Yiran Chen, Pengfei Liu, Ming Zhong, Zi-Yi Dou, Danqing Wang, Xipeng Qiu, Xuanjing Huang
EMNLP-Findings 2020
TICO-19: the Translation Initiative for COvid-19
Antonios Anastasopoulos, Alessandro Cattelan, Zi-Yi Dou, Marcello Federico, Christian Federman, Dmitriy Genzel, Francisco Guzmán, Junjie Hu, Macduff Hughes, Philipp Koehn, Rosie Lazar, Will Lewis, Graham Neubig, Mengmeng Niu, Alp Öktem, Eric Paquin, Grace Tang, Sylwia Tur
EMNLP 2020 Workshop on NLP-COVID
A Deep Reinforced Model for Zero-Shot Cross-Lingual Summarization with Bilingual Semantic Similarity Rewards
Zi-Yi Dou, Sachin Kumar, Yulia Tsvetkov
ACL 2020 Workshop on Neural Generation and Translation
Domain Differential Adaptation for Neural Machine Translation
Zi-Yi Dou, Xinyi Wang, Junjie Hu, Graham Neubig
EMNLP 2019 Workshop on Neural Generation and Translation
Information Aggregation for Multi-Head Attention
Jian Li, Baosong Yang, Zi-Yi Dou, Xing Wang, Michael R. Lyu, Zhaopeng Tu
NAACL 2019
Exploiting Deep Representations for Neural Machine Translation
Zi-Yi Dou, Zhaopeng Tu, Xing Wang, Shuming Shi, Tong Zhang
EMNLP 2018
Unsupervised Bilingual Lexicon Induction via Latent Variable Models
Zi-Yi Dou, Zhi-Hao Zhou, Shujian Huang
EMNLP 2018
SkipNet: Learning Dynamic Routing in Convolutional Networks
Xin Wang, Fisher Yu, Zi-Yi Dou, Trevor Darrel, Joseph E. Gonzalez
ECCV 2018
Internships
Meta AI, 06/2024-09/2024
Research Intern at FAIR Perception
Meta AI, 06/2023-09/2023
Research Intern at FAIR Multimodal Foundations
Microsoft, 05/2021-08/2021 & 06/2022-09/2022
Research Intern at Project Florence-Vision and Language
Tencent AI Lab, 02/2018-08/2018
Research Intern at the Machine Translation Team
Education
University of California, Los Angeles, 08/2020-Present
Ph.D. Student in Computer Science
Carnegie Mellon University, 08/2018-08/2020
Master of Science in Language Technologies
Nanjing University, 09/2014-07/2018
Bachelor of Science in Computer Science, Minor in Statistics
Service
Area Chair for ACL, EMNLP, ACL Rolling Review
Reviewer for ACL, EMNLP, NAACL, ACL Rolling Review, ICML, NeurIPS, ICLR, CVPR, ICCV, ECCV, AAAI