About us

NTCIR (NII Testbeds and Community for Information Access Research) is a series of evaluation conferences focusing on information access with East Asian languages and English. NTCIR-19 invites task proposals within the field of information access, with a specific interest in LLM-related research, generative IR, and quality evaluation of content generated by LLMs.

Important Dates

Mon, Apr 7, 2025
Task Proposal Submission Due (Extended)
Thu, May 15, 2025
Acceptance Notification of Task Proposals
Tue, Jun 10, 2025
NTCIR-18 Conference
Thu, Jan 1, 2026
Dataset release
Thu, Jan 1, 2026
Dry run
Sun, Mar 1, 2026
Formal run
Sat, Aug 1, 2026
Evaluation results return
Sat, Aug 1, 2026
Task overview release (draft)
Tue, Sep 1, 2026
Submission due of participant papers (draft)
Sun, Nov 1, 2026
Camera-ready participant paper due

Call For Paper

Information Access
Large language models (LLMs)
Generative information retrieval (IR)
Generative queries
Conversational search
Evaluation using LLM
RAG

NTCIR-19 invites new task proposals within the expansive field of information access. Organizing an evaluation task entails pinpointing significant research challenges, strategically addressing them through collaboration with fellow researchers, and developing the requisite evaluation framework to propel advancements in the state of the art.

Committee

Program Co-Chairs

Qingyao Ai

Tsinghua University, China

Chung-Chi Chen

National Institute of Advanced Industrial Science and Technology (AIST), Japan

Shoko Wakamiya

Nara Institute of Science and Technology (NAIST), Japan

General Chairs

Charles Clarke

University of Waterloo, Canada

Noriko Kando

National Institute of Informatics, Japan

Makoto P. Kato

University of Tsukuba, Japan

Yiqun Liu

Tsinghua University, China