内容简介：The problem of automatically augmenting a knowledge base with facts expressed in natural language is known as Knowledge Base Population (KBP). This problem has been extensively studied in the last couple of decades; however, progress has been slow in part
EMNLP 2019 paper , dataset , leaderboard and code
Knowledge bases (also known as knowledge graphs or ontologies) are valuable resources for developing intelligence applications, including search, question answering, and recommendation systems. However, high-quality knowledge bases still mostly rely on structured data curated by humans. Such reliance on human curation is a major obstacle to the creation of comprehensive, always-up-to-date knowledge bases such as the Diffbot Knowledge Graph .
The problem of automatically augmenting a knowledge base with facts expressed in natural language is known as Knowledge Base Population (KBP). This problem has been extensively studied in the last couple of decades; however, progress has been slow in part because of the lack of benchmark datasets.
KnowledgeNet is a benchmark dataset for populating Wikidata with facts expressed in natural language on the web. Facts are of the form (subject; property; object), where subject and object are linked to Wikidata. For instance, the dataset contains text expressing the fact ( Gennaro Basile ; RESIDENCE; Moravia ), in the passage:
“Gennaro Basile was an Italian painter, born in Naples but active in the German-speaking countries. He settled at Brunn, in Moravia, and lived about 1756…”
KBP has been mainly evaluated via annual contests promoted by TAC . TAC evaluations are performed manually and are hard to reproduce for new systems . Unlike TAC, KnowledgeNet employs an automated and reproducible way to evaluate KBP systems at any time, rather than once a year. We hope a faster evaluation cycle will accelerate the rate of improvement for KBP.
Please refer to our EMNLP 2019 Paper for details on KnowlegeNet, but here are some takeaways:
- State-of-the-art models (using BERT ) are far from achieving human performance (0.504 vs 0.822).
- The traditional pipeline approach for this problem is severely limited by error propagation.
- KnowledgeNet enables the development of end-to-end systems, which are a promising solution for addressing error propagation.
以上所述就是小编给大家介绍的《KnowledgeNet: A Benchmark for Knowledge Base Population》，希望对大家有所帮助，如果大家有任何疑问请给我留言，小编会及时回复大家的。在此也非常感谢大家对 码农网 的支持！
猜你喜欢:
本站部分资源来源于网络，本站转载出于传递更多信息之目的，版权归原作者或者来源机构所有，如转载稿涉及版权问题，请联系我们。
火的礼物：人类与计算技术的终极博弈（第4版）
【美】Baase,Sara（莎拉芭氏） / 郭耀、李琦 / 电子工业出版社 / 89.00
《火的礼物：人类与计算技术的终极博弈 （第4版）》是一本讲解与计算技术相关的社会、法律和伦理问题的综合性读物。《火的礼物：人类与计算技术的终极博弈 （第4版）》以希腊神话中普罗米修斯送给人类的火的礼物作为类比，针对当前IT技术与互联网迅速发展带来的一些社会问题，从法律和道德的角度详细分析了计算机技术对隐私权、言论自由、知识产权与著作权、网络犯罪等方面带来的新的挑战和应对措施，讲解了计算技术对人类的......一起来看看 《火的礼物：人类与计算技术的终极博弈（第4版）》 这本书的介绍吧!
