I am currently a visiting researcher working in the INK Lab at University of Southern California (USC), and will join the Viterbi School of Engineering – Computer Science Department at USC as a Postdoctoral Research Associate in Fall 2024, advised by Xiang Ren. I received my Ph.D. from Fudan University in October 2023, under the supervision of Zhongyu Wei. Before that, I received my Bachelor’s degree in Software Engineering from Fudan University. During my PhD, I’ve also spent time with the INK Lab at University of Southern California, advised by Xiang Ren.

My primary research interests include Natural Language Processing and Machine Reasoning, with a current focus on testing and improving LLMs Reasoning and Neuro-symbolic Integration.

Preprint

• Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation
  Siyuan Wang, Zhuohan Long, Zhihao Fan, Zhongyu Wei, Xuanjing Huang.
  Arxiv. [code]

• AI Hospital: Interactive Evaluation and Collaboration of LLMs as Intern Doctors for Clinical Diagnosis
  Zhihao Fan, Jialong Tang, Wei Chen, Siyuan Wang, Zhongyu Wei, Jun Xie, Fei Huang, Jingren Zhou.
  Arxiv. [code]

Selected Publications

(Full list see Google Scholar)

• Symbolic Working Memory Enhances Language Models for Complex Rule Application
  Siyuan Wang, Zhongyu Wei, Yejin Choi, Xiang Ren.
  EMNLP 2024. [code]

• From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking
  Siyuan Wang*, Zhuohan Long*, Zhihao Fan, Zhongyu Wei.(*Equal Contribution)
  EMNLP 2024. [Survey]

• Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs
  Siyuan Wang, Zhongyu Wei, Yejin Choi, Xiang Ren.
  ACL 2024. [code]

• ALaRM: Align Language Models via Hierarchical Rewards Modeling
  Yuhang Lai, Siyuan Wang, Shujun Liu, Xuanjing Huang, Zhongyu Wei.
  ACL-Findings 2024. [code]

• Multi-Objective Forward Reasoning and Multi-Reward Backward Refinement for Product Review Summarization
  Libo Sun, Siyuan Wang, Meng Han, Ruofei Lai, Xinyu Zhang, Xuanjing Huang, Zhongyu Wei.
  COLING 2024. [data]

• Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs
  Siyuan Wang, Zhongyu Wei, Meng Han, Zhihao Fan, Haijun Shan, Qi Zhang, Xuanjing Huang.
  ACL 2023. [code]

• Unifying Structure Reasoning and Language Pre-training for Complex Reasoning Tasks
  Siyuan Wang, Zhongyu Wei, Jiarong Xu, Taishan Li and Zhihao Fan.
  TASLP 2023.

• Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering
  Siyuan Wang, Zhongyu Wei, Zhihao Fan, Qi Zhang and Xuanjing Huang.
  COLING 2022. [code]

• From LSAT: The Progress and Challenges of Complex Reasoning
  Siyuan Wang, Zhongkun Liu, Wanjun Zhong, Ming Zhou, Zhongyu Wei, Zhumin Chen, Nan Duan.
  TASLP 2022.

• Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text
  Siyuan Wang, Zhongyu Wei, Zhihao Fan, Zengfeng Huang, Weijian Sun, Qi Zhang and Xuanjing Huang.
  ACL-Findings 2022. [code] [blog]

• Analytical Reasoning of Text
  Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan.
  NAACL-Findings 2022. [data&code]

• Fine-Grained Element Identification in Complaint Text of Internet Fraud
  Tong Liu*, Siyuan Wang*, Jingchao Fu, Lei Chen, Zhongyu Wei, Yaqi Liu, Heng Ye, Liaosa Xu, Weiqiang Wang, Xuanjing Huang.(*Equal Contribution)
  CIKM 2021.

• TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning
  Zhihao Fan, Zhongyu Wei, Siyuan Wang, Ruize Wang, Zejun Li, Haijun Shan, Xuanjing Huang.
  IJCAI 2021. [code]

• PathQG: Neural Question Generation from Facts
  Siyuan Wang, Zhongyu Wei, Zhihao Fan, Zengfeng Huang, Weijian Sun, Qi Zhang and Xuanjing Huang.
  EMNLP 2020. [code]

• A Multi-Agent Communication Framework for Question-Worthy Phrase Extraction and Question Generation
  Siyuan Wang, Zhongyu Wei, Zhihao Fan, Yang Liu and Xuanjing Huang.
  AAAI 2019.

Experience

• Fudan University. DISC Lab. Oct 2017 - Present
  • Graduate Research Assistant \& Research Assistant. Advisor: Zhongyu Wei
  • Focus:
    • Knowledge Modeling for Question Generation
    • Flexible Interpretability and Generalizability of Complex Reasoning
    • LLMs Evaluation \& Alignment
• University of Southern California. Ink Lab. Jan 2023 - Present
  • Visiting Researcher. Advisor: Xiang Ren
  • Focus: LLMs Reasoning with Logical Rules
• Langboat Tech. Feb 2021 - May 2021
  • Research Intern. Advisor: Ming Zhou
  • Focus: Neuro-symbolic Exploration for Complex Reasoning
• Microsoft Research Asia. NLC Group. Sep 2020 - Feb. 2021
  • Research Intern. Advisor: Duyu Tang
  • Focus: Symbolic Logic-driven Logical Reasoning

Professional Service

• Co-Organizer
  • Program Committee Chair of CSSNLP 2021, Organizing Committee of CSSNLP 2020
• Program Committee (Reviewer)
  • ACL Rolling Review 2021-2023, ACL, AAAI, IJCAI, EMNLP, NAACL, NLPCC, IEEE/ACM Trans. on ASLP(TASLP), ACM Trans. on ALLIP (TALLIP)
• Invited Talk
  • Jul 2023, Talk “How to Cope with the Changes Brought about by LLMs?” at CCAC 2023 Student Seminar.
  • Oct 2021, Talk “A Brief Probe on Writing an Academic Rebuttal.” at CCL 2021 Student Seminar.