Contained in:
Book Chapter

Automatic Verification of References of Wikidata Statements

  • Elena Simperl
  • Odinaldo Rodrigues
  • Albert Meroño-Peñuela
  • Kholoud Saad Alghamdi
  • Gabriel Maia Rocha Amaral
  • Nathan Schneider Gavenski
  • Jongmo Kim
  • Miriam Redi
  • Yiwen Xing
  • Bohui Zhang
  • Yihang Zhao

Wikidata is one of the world's most important data assets. It is used by search engines, virtual assistants, fact checkers, and in over 800 Wikimedia projects. Wikidata contains 1.65 billion statements about over 116 million data items, edited by nearly 25 thousand editors. Manually checking whether Wikidata statements are supported by references is a slow process that does not scale with size. Given the overall number of statements to check, the collaborative nature of Wikidata, and the fact that referenced documents can change over time, preserving the quality of the references is an onerous process requiring continuous intervention. This paper present ProVe – a tool to assist in the automatic verification and assessment of the quality of the references of Wikidata items.

  • Keywords:
  • Wikidata,
  • quality assurance,
  • reference verification,
  • artificial intelligence,
  • computational tools,
+ Show More

Elena Simperl

King's College London, United Kingdom - ORCID: 0000-0003-1722-947X

Odinaldo Rodrigues

King's College London, United Kingdom - ORCID: 0000-0001-7823-1034

Albert Meroño-Peñuela

King's College London, United Kingdom - ORCID: 0000-0003-4646-5842

Kholoud Saad Alghamdi

University of Jeddah, Saudi Arabia - ORCID: 0000-0003-0261-9977

Gabriel Maia Rocha Amaral

King's College London, United Kingdom - ORCID: 0000-0002-4482-5376

Nathan Schneider Gavenski

King's College London, United Kingdom - ORCID: 0000-0003-0578-3086

Jongmo Kim

King's College London, United Kingdom - ORCID: 0000-0002-4984-1674

Miriam Redi

Wikimedia Foundation

Yiwen Xing

Oxford e-Research Centre, United Kingdom - ORCID: 0000-0003-1521-6616

Bohui Zhang

King's College London, United Kingdom - ORCID: 0000-0001-5430-1624

Yihang Zhao

King's College London, United Kingdom - ORCID: 0009-0009-2436-8145

  1. Amaral, Gabriel, Alessandro Piscopo, Lucie-Aimée Kaffee, Odinaldo Rodrigues, and Elena Simperl. 2021. “Assessing the Quality of Sources in Wikidata Across Languages: A Hybrid Approach.” Journal of Data and Information Quality 13 (4): 1–35.
  2. Amaral, Gabriel, Odinaldo Rodrigues, and Elena Simperl. 2022. “WDV: A Broad Data Verbalisation Dataset Built from Wikidata.” In The Semantic Web – ISWC 2022, edited by Ulrike Sattler, Aidan Hogan, Maria Keet, Valentina Presutti, João Paulo A. Almeida, Hideaki Takeda, Pierre Monnin, Giuseppe Pirrò, and Claudia d’Amato, 556–74. Cham: Springer International Publishing.
  3. Amaral, Gabriel, Odinaldo Rodrigues, and Elena Simperl. 2023. “ProVe: A Pipeline for Automated Provenance Verification of Knowledge Graphs against Textual Sources.” Semantic Web DOI: 10.3233/SW-233467
  4. Färber, Michael, Frederic Bartscherer, Carsten Menne, and Achim Rettinger. 2018. “Linked Data Quality of DBpedia, Freebase, Opencyc, Wikidata, and Yago.” Semantic Web 9 (1): 77–129.
  5. Gardent, Claire, Anastasia Shimorina, Shashi Narayan, and Laura Perez-Beltrachini. 2017. “The WebNLG Challenge: Generating Text from RDF Data.” In Proceedings of the 10th International Conference on Natural Language Generation, 124–33.
  6. Honnibal, Matthew, Ines Montani, Sofie Van Landeghem, and Adriane Boyd. 2020. “SpaCy: Industrial-Strength Natural Language Processing in Python.” DOI: 10.5281/zenodo.1212303
  7. Ji, Shaoxiong, Shirui Pan, Erik Cambria, Pekka Marttinen, and Philip S. Yu. 2022. “A Survey on Knowledge Graphs: Representation, Acquisition, and Applications.” IEEE Transactions on Neural Networks and Learning Systems 33 (2): 494–514 DOI: 10.1109/TNNLS.2021.3070843
  8. Krötzsch, Markus, and Gerhard Weikum. 2016. “JWS Special Issue on Knowledge Graphs.” Journal of Web Semantics. International Center for Computational Logic. https://iccl.inf.tu-dresden.de/web/JWS_special_issue_on_Knowledge_Graphs/en.
  9. Malyshev, Stanislav, Markus Krötzsch, Larry González, Julius Gonsior, and Adrian Bielefeldt. 2018. “Getting the Most out of Wikidata: Semantic Technology Usage in Wikipedia’s Knowledge Graph.” In International Semantic Web Conference, 376–94.
  10. McAndrew, Ewan, and Clea Strathmann. 2021. “Quality Assurance and Reliability.” Wikidata Quality Assurance and Reliability. Edinburgh: The University of Edinburgh. https://www.ed.ac.uk/information-services/help-consultancy/is-skills/wikimedia/wikidata/quality-assurance-and-reliability.
  11. Paulheim, Heiko. 2016. “Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods.” Semantic Web 8: 489–508.
  12. Piscopo, Alessandro, Lucie-Aimée Kaffee, Chris Phethean, and Elena Simperl. 2017. “Provenance Information in a Collaborative Knowledge Graph: An Evaluation of Wikidata External References.” In International Semantic Web Conference, 542–58.
  13. Raffel, Colin, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu, et al. 2020. “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.” Journal of Machine Learning Research 21 (140): 1–67.
  14. Soleimani, Amir, Christof Monz, and Marcel Worring. 2020. “BERT for Evidence Retrieval and Claim Verification.” In European Conference on Information Retrieval, 359–66.
  15. Thorne, James, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. “FEVER: A Large-Scale Dataset for Fact Extraction and VERification.” In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1, 809–19. New Orleans: Association for Computational Linguistics DOI: 10.18653/v1/N18-1074
  16. Wang, Xiangyu, Lyuzhou Chen, Taiyu Ban, Muhammad Usman, Yifeng Guan, Shikang Liu, Tianhao Wu, and Huanhuan Chen. 2021. “Knowledge Graph Quality Control: A Survey.” Fundamental Research 1 (5): 607-26 DOI: 10.1016/j.fmre.2021.09.003
  17. Zaveri, Amrapali, Anisa Rula, Andrea Maurino, Ricardo Pietrobon, Jens Lehmann, and Soeren Auer. 2016. “Quality Assessment for Linked Data: A Survey.” Semantic Web 7 (1): 63–93.
PDF
  • Publication Year: 2026
  • Pages: 263-271
  • Content License: CC BY 4.0
  • © 2026 Author(s)

XML
  • Publication Year: 2026
  • Content License: CC BY 4.0
  • © 2026 Author(s)

Chapter Information

Chapter Title

Automatic Verification of References of Wikidata Statements

Authors

Elena Simperl, Odinaldo Rodrigues, Albert Meroño-Peñuela, Kholoud Saad Alghamdi, Gabriel Maia Rocha Amaral, Nathan Schneider Gavenski, Jongmo Kim, Miriam Redi, Yiwen Xing, Bohui Zhang, Yihang Zhao

Language

English

DOI

10.36253/979-12-215-1010-2.31

Peer Reviewed

Publication Year

2026

Copyright Information

© 2026 Author(s)

Content License

CC BY 4.0

Metadata License

CC0 1.0

Bibliographic Information

Book Title

Wikidata e la ricerca. Condividere esperienze / Wikidata and Research. Sharing Experiences

Book Subtitle

Atti del Convegno, Firenze, 5-6 giugno 2025 / Conference proceedings, Florence, 5-6 June 2025

Editors

Elena Marangoni, Camillo Carlo Pellizzari di San Girolamo

Peer Reviewed

Number of Pages

378

Publication Year

2026

Copyright Information

© 2026 Author(s)

Content License

CC BY 4.0

Metadata License

CC0 1.0

Publisher Name

Firenze University Press

DOI

10.36253/979-12-215-1010-2

ISBN Print

979-12-215-1009-6

eISBN (pdf)

979-12-215-1010-2

Series Title

Studi e saggi

Series ISSN

2704-6478

Series E-ISSN

2704-5919

12

Fulltext
downloads

17

Views

Export Citation

1,503

Open Access Books

in the Catalogue

3,436

Book Chapters

6,234,628

Fulltext
downloads

5,673

Authors

from 1201 Research Institutions

of 67 Nations

77

scientific boards

from 416 Research Institutions

of 46 Nations

1,413

Referees

from 411 Research Institutions

of 41 Nations