I am a third year Ph.D. student in information at University of Arizona. My advisor is Peter Jansen. I received my M.S. degree in computer science from University of Michigan and my B.S. degree in microelectronic engineering from Fudan University.

My research interests are mainly in natural language processing. Specifically, I worked on multi-modal question answering and more recently I am interested in text virtual environments or text games. I built text environments as well as the agents for these environments, and I view these tasks as challenging reasoning benchmarks for large language models. I also work on code generation.

Before I worked in natural language processing, I had research experiences in medical image processing and embedded systems.

Some of my personal interests include reading fictions and history, soccers, and traveling.

Contact

email: ruoyaowang@arizona.edu

Publications

• ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games.
  Ruoyao Wang, Graham Todd, Xingdi Yuan, Ziang Xiao, Marc-Alexandre Côté, Peter Jansen.
  EMNLP 2023
  [pdf]

• Self-Supervised Behavior Cloned Transformers are Path Crawlers for Text Games.
  Ruoyao Wang, Peter Jansen.
  EMNLP 2023 Findings
  [pdf]

• How to use academic and digital fingerprints to catch and eliminate contract cheating during online multiple-choice examinations: a case study.
  Meaghan Emery-Wetherell, Ruoyao Wang.
  Assessment & Evaluation in Higher Education
  [paper]

• Behavior Cloned Transformers are Neurosymbolic Reasoners.
  Ruoyao Wang, Peter Jansen, Marc-Alexandre Côté, Prithviraj Ammanabrolu.
  EACL 2023
  [pdf]

• ScienceWorld: Is your Agent Smarter than a 5th Grader?. Ruoyao Wang*, Peter Jansen*, Marc-Alexandre Côté, Prithviraj Ammanabrolu.
  EMNLP 2022
  [pdf] [code] [project]

• FIBER: Fill-in-the-Blanks as a Challenging Video Understanding Evaluation Framework.
  Santiago Castro, Ruoyao Wang, Pingxuan Huang, Ian Stewart, Oana Ignat, Nan Liu, Jonathan C. Stroud, Rada Mihalcea.
  ACL 2022
  [pdf] [code]

• LifeQA: A Real-life Dataset for Video Question Answering.
  Santiago Castro, Mahmoud Azab, Jonathan C. Stroud, Cristina Noujaim, Ruoyao Wang, Jia Deng, Rada Mihalcea.
  LREC 2020
  [pdf] [code] [project]

• High-resolution image reconstruction for portable ultrasound imaging devices.
  Ruoyao Wang, Zhenghan Fang, Jiaqi Gu, Yi Guo, Shicong Zhou, Yuanyuan Wang, Cai Chang and Jinhua Yu.
  EURASIP Journal on Advances in Signal Processing
  [pdf]

• Remote Embedded Simulation System for SW/HW Co-design Based On Dynamic Partial Reconfiguration.
  Jiaqi Gu, Ruoyao Wang, Jian Wang, Jinmei Lai and Qinghua Duan.
  IEEE International Conference on ASIC (ASICON) 2017
  [pdf]