摘要
1 Introduction.Inspired by the impressive success of BERT[1]in various NLP applications,researchers have attempted to apply pretrained language models to information retrieval,and existing BERT-based retrieval models obtain improved performance on passage retrieval[2-4].Since BERT has the limitation that the maximum length of tokens is only 512,however,simply applying those models to the task of long document retrieval derives suboptimal results.
基金
supported by the Key Research and Development Program of Hubei Province(2020BAB017)
Scientific Research Center Program of National Language Commission(ZDI135-135)
the Fundamental Research Funds for the Central Universities(CCNU22QN015).
