Keynotes

Keynote 1

Title: Fact checking is dead — Long live fact checking
Abstract:

Fact checking is dead. Long live fact checking!
The race between misinformation generation and verification is becoming increasingly unequal. AI can produce and adapt misleading content faster than reactive fact checking can investigate and correct it. This keynote advances a polemical argument: if our response remains checking claims after they circulate, misinformation wins. As AI mediation becomes ubiquitous across how we learn, communicate, and decide, the information retrieval community must help society get ahead of this cycle. This challenge demands both proactive systems and a more informed, critical citizenry. Bringing people along requires making critical inquiry part of everyday encounters with AI-mediated information. People need the capacity to question how AI frames an issue, selects evidence, omits perspectives, and presents uncertainty. Where did this information come from? What supports it? What is missing? Whose interests and assumptions shape what I see? Systems must support this inquiry by modelling both information and its value to human understanding and decision-making.

Drawing on insights from the NUS iGyro project, this keynote outlines a vision for the next stage of AI-mediated information retrieval and its implications for the community’s research agenda: helping citizens question, evaluate, and shape the mediation on which they increasingly depend.

Min-Yen Kan (BS; MS; PhD Columbia Univ.; SACM, SIEEE) is an Associate Professor and Vice Dean of Undergraduate Studies at the National University of Singapore. Min is an active member of the Association of Computational Linguistics (ACL), currently serving as a co-chair for its Ethics Committee. He is also the survey editor for the Journal of AI Research (JAIR).

His research interests include digital libraries, natural language processing and information retrieval. Specific projects include work in the areas of scientific discourse analysis, fact verification, full-text literature mining, lexical semantics, and the socio-ethical alignment and reasoning aspects of large language models. He leads the Web Information Retrieval / Natural Language Processing Group (WING.NUS).

Keynote 2

Title: Evaluating Language Models beyond Task Performance
Abstract:

Evaluation has been a central topic in information retrieval, natural language processing, and more recently generative AI. Although task performance remains a key concern in evaluating large language models, a user-centric approach requires consideration of many other factors and dimensions. In this talk, I will discuss some of these considerations, including bias, safety, and culture, with a particular focus on the evaluation of vision-language models.

Jing Jiang is a Professor in the School of Computing at the Australian National University. Her research focuses on the applied side of natural language processing, with topics including information extraction, topic modelling, sentiment analysis, social media analysis, question answering, and the evaluation of vision-language models. She served as a program co-chair for the Conference on Empirical Methods in Natural Language Processing (EMNLP) 2019, as an action editor for the Transactions of the Association for Computational Linguistics (TACL), and currently serves as one of the Editors-in-Chief of ACL Rolling Review (ARR). Jing received her PhD degree in Computer Science from the University of Illinois at Urbana-Champaign and her B.S. and M.S. degrees from Stanford University. She was named one of the Singapore 100 Women in Tech in 2021.