I'm an integrated M.S.–Ph.D. student in Data Science at Seoul National University, advised by Yohan Jo in the HOLI Lab.
I study how language-model agents behave in practice: how they use and trust tools, interact with users, and express values and personas through their actions. I develop evaluations that connect model behavior to concrete tasks and changing contexts. My goal is to use these measurements to improve agent reliability and build more faithful simulations of people and fictional characters.
Research Interests
-
[Agent Reliability] How agents use tools and interact with users
I study recurring agent behaviors, failures caused by unreliable tools, and the effects of user behavior on task completion.
- how they approach everyday tasks arXiv'26
- how they use and trust tools ACL-Main'26 arXiv'26
- how they respond to non-collaborative users ICLR'26
-
[Human Simulation] How values and personas translate into behavior
I evaluate whether models' expressed values and personas predict their behavior, and whether simulated characters adapt to the right context and point in time.
- how to measure values through decisions in context ACL-Main'25 EACL-Findings'26
- whether personas carry over to behavior EMNLP-Main'26
- how characters change over time EMNLP-Main'26
My research asks: How can we measure and improve agent behavior across tasks and social contexts?
I'm currently seeking a summer research internship in agents, alignment, or social simulation, and I'm always open to collaboration. Feel free to reach out at opusdeisong@snu.ac.kr.
News
-
ArcANE and Human Psychometric Questionnaires Mischaracterize LLM Behavior accepted to EMNLP 2026 (Main).
-
Awarded the Presidential Science Scholarship for Graduate Students (2026–2027) by the Ministry of Science and ICT.
-
PA-Tool accepted to ACL 2026 (Main).
-
Psychometric Item Validation Using Virtual Respondents accepted to TACL.
Earlier news
-
Non-Collaborative User Simulators for Tool Agents accepted to ICLR 2026.
-
Quantifying Data Contamination in Psychometric Evaluations of LLMs accepted to EACL 2026 Findings.
-
Value Portrait accepted to ACL 2025 (Main).