Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Jina-reranker-v3: Last but Not Late Interaction for Listwise Document Reranking

Created by
  • Haebom

Author

Feng Wang, Yuqing Li, Han Xiao

Outline

Jina-reranker-v3 is a multilingual listwise reranker with 0.6B parameters that introduces "last but not late" interactions. Unlike late interaction models like ColBERT, it applies causal attention to the query and all candidate documents within the same context window, enabling rich interactions before extracting contextual embeddings from the final tokens of each document. This model achieves state-of-the-art BEIR performance with 61.94 nDCG@10, while being significantly smaller than comparable models.

Takeaways, Limitations

Enables rich interactivity between queries and documents through a "last but not late" interaction model.
Improved efficiency with a much smaller size (0.6B parameter) than other models with the same performance.
Achieving state-of-the-art performance on the BEIR benchmark.
Limitations is not explicitly mentioned in the paper (it cannot be determined from the abstract alone).
👍