I am Xunjian Yin, a third-year Master’s student at the Wangxuan Institute of Computer Technology at Peking University supervised by Prof. Xiaojun Wan. Previously, I earned my B.S. in Computer Science from Peking University. I worked as an intern at Microsoft. Currently, I am a visiting student at UCSB NLP Group, supervised by Professor William Wang.

My research focuses on advancing Large Language Models, particularly in integrating new information. This includes: (1) benchmarking internal knowledge boundaries of LLMs (PGDC), (2) evaluating LLM generalization with new knowledge (Alcuna), (3) proposing the task and the solution on temporal knowledge editing (AToKe), (4) unsupervised methods for LLM self-alignment by resolve their internal contradictions (ContraSolver), (5) Gödel Agent, a self-referential framework designed for recursive self-improvement. (6) Reverse Model, pretrained with last token prediction.

Through these efforts, I strive to push the frontiers of LLM capabilities, ensuring they remain robust and adaptable in an ever-evolving information landscape.

I’m seeking 25 Fall Ph.D. opportunities! Feel free to reach out to me if you’re interested in my research!

Recent News

• 2024-10: One paper accepted to EMNLP 2023
• 2024-05: One paper accepted to ACL 2024
• 2023-12: One paper accepted to AAAI 2024
• 2023-10: Two papers accepted to EMNLP 2023

Preprints

• Gödel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement
  Xunjian Yin, Xinyi Wang, Liangming Pan, Xiaojun Wan, William Yang Wang
  arXiv:2410.04444 [paper] [code]
• ContraSolver: Self-Alignment of Language Models by Resolving Internal Preference Contradictions
  Xu Zhang*, Xunjian Yin*, Xiaojun Wan
  arXiv:2406.08842 [paper]

Selected Publications

• Themis: Towards Flexible and Interpretable NLG Evaluation
  Xinyu Hu, Li Lin, Mingqi Gao, Xunjian Yin, Xiaojun Wan
  EMNLP 2024 [paper] [code]
• Benchmarking Knowledge Boundary for Large Language Model: A Different Perspective on Model Evaluation
  Xunjian Yin*, Xu Zhang*, Jie Ruan, Xiaojun Wan
  ACL 2024 [paper] [code]
• History Matters: Temporal Knowledge Editing in Large Language Model
  Xunjian Yin, Jin Jiang, Liming Yang, Xiaojun Wan
  AAAI 2024 [pdf] [code]
• ALCUNA: Large Language Models Meet New Knowledge
  Xunjian Yin*, Baizhou Huang*, Xiaojun Wan
  EMNLP 2023 [pdf] [code]
• Exploring Context-Aware Evaluation Metrics for Machine Translation
  Xinyu Hu, Xunjian Yin, Xiaojun Wan
  EMNLP 2023 findings [pdf] [code]
• Overview of the NLPCC 2023 Shared Task: Chinese Spelling Check
  Xunjian Yin, Xiaojun Wan, Dan Zhang, Linlin Yu, Long Yu
  NLPCC 2023 [pdf] [code]
• How Do Seq2Seq Models Perform on End-to-End Data-to-Text Generation?
  Xunjian Yin, Xiaojun Wan
  ACL 2022 [pdf] [code]

Academic Services

• Reviewer: ACL 2023, ACL ARR 2023, ACL ARR 2024, NeurIPS 2024, ICLR 2025
• NLPCC Shared Task 8 track chair
• Volunteer: AAAI 2024, ACL 2024