About us

NTCIR (NII Testbeds and Community for Information Access Research) is a series of evaluation conferences focusing on information access with East Asian languages and English. NTCIR-19 invites task proposals within the field of information access, with a specific interest in LLM-related research, generative IR, and quality evaluation of content generated by LLMs.

Important Dates

Mon, Apr 7, 2025

Task Proposal Submission Due (Extended)

Thu, May 15, 2025

Acceptance Notification of Task Proposals

Tue, Jun 10, 2025

NTCIR-18 Conference

Thu, Jan 1, 2026

Dataset release

Thu, Jan 1, 2026

Dry run

Sun, Mar 1, 2026

Formal run

Sat, Aug 1, 2026

Evaluation results return

Sat, Aug 1, 2026

Task overview release (draft)

Tue, Sep 1, 2026

Submission due of participant papers (draft)

Sun, Nov 1, 2026

Camera-ready participant paper due

Paper Submission

Research Paper Submission Tracks

Information Access

Large language models (LLMs)

Generative information retrieval (IR)

Generative queries

Conversational search

Evaluation using LLM

RAG

Call for Papers Description

NTCIR-19 invites new task proposals within the expansive field of information access. Organizing an evaluation task entails pinpointing significant research challenges, strategically addressing them through collaboration with fellow researchers, and developing the requisite evaluation framework to propel advancements in the state of the art.