OAG-BERT: Towards a Unified Backbone Language Model for Academic Knowledge Services
Published in The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2022
This paper is about training large language model on top of scientific data.
Recommended citation: Liu, Xiao & Yin, Da & Zheng, Jingnan & Zhang, Xingjian & Zhang, Peng & Yang, Hongxia & Yuxiao, Dong & Tang, Jie. (2022). OAG-BERT: Towards a Unified Backbone Language Model for Academic Knowledge Services. 3418-3428. 10.1145/3534678.3539210. http://keg.cs.tsinghua.edu.cn/jietang/publications/KDD22-Liu-et-al-OAG-BERT.pdf