Contenuto in:
Capitolo

Automatic Verification of References of Wikidata Statements

  • Elena Simperl
  • Odinaldo Rodrigues
  • Albert Meroño-Peñuela
  • Kholoud Saad Alghamdi
  • Gabriel Maia Rocha Amaral
  • Nathan Schneider Gavenski
  • Jongmo Kim
  • Miriam Redi
  • Yiwen Xing
  • Bohui Zhang
  • Yihang Zhao

Wikidata is one of the world's most important data assets. It is used by search engines, virtual assistants, fact checkers, and in over 800 Wikimedia projects. Wikidata contains 1.65 billion statements about over 116 million data items, edited by nearly 25 thousand editors. Manually checking whether Wikidata statements are supported by references is a slow process that does not scale with size. Given the overall number of statements to check, the collaborative nature of Wikidata, and the fact that referenced documents can change over time, preserving the quality of the references is an onerous process requiring continuous intervention. This paper present ProVe – a tool to assist in the automatic verification and assessment of the quality of the references of Wikidata items.

  • Keywords:
  • Wikidata,
  • quality assurance,
  • reference verification,
  • artificial intelligence,
  • computational tools,
+ Mostra di più

Elena Simperl

King's College London, United Kingdom - ORCID: 0000-0003-1722-947X

Odinaldo Rodrigues

King's College London, United Kingdom - ORCID: 0000-0001-7823-1034

Albert Meroño-Peñuela

King's College London, United Kingdom - ORCID: 0000-0003-4646-5842

Kholoud Saad Alghamdi

University of Jeddah, Saudi Arabia - ORCID: 0000-0003-0261-9977

Gabriel Maia Rocha Amaral

King's College London, United Kingdom - ORCID: 0000-0002-4482-5376

Nathan Schneider Gavenski

King's College London, United Kingdom - ORCID: 0000-0003-0578-3086

Jongmo Kim

King's College London, United Kingdom - ORCID: 0000-0002-4984-1674

Miriam Redi

Wikimedia Foundation

Yiwen Xing

Oxford e-Research Centre, United Kingdom - ORCID: 0000-0003-1521-6616

Bohui Zhang

King's College London, United Kingdom - ORCID: 0000-0001-5430-1624

Yihang Zhao

King's College London, United Kingdom - ORCID: 0009-0009-2436-8145

  1. Amaral, Gabriel, Alessandro Piscopo, Lucie-Aimée Kaffee, Odinaldo Rodrigues, and Elena Simperl. 2021. “Assessing the Quality of Sources in Wikidata Across Languages: A Hybrid Approach.” Journal of Data and Information Quality 13 (4): 1–35.
  2. Amaral, Gabriel, Odinaldo Rodrigues, and Elena Simperl. 2022. “WDV: A Broad Data Verbalisation Dataset Built from Wikidata.” In The Semantic Web – ISWC 2022, edited by Ulrike Sattler, Aidan Hogan, Maria Keet, Valentina Presutti, João Paulo A. Almeida, Hideaki Takeda, Pierre Monnin, Giuseppe Pirrò, and Claudia d’Amato, 556–74. Cham: Springer International Publishing.
  3. Amaral, Gabriel, Odinaldo Rodrigues, and Elena Simperl. 2023. “ProVe: A Pipeline for Automated Provenance Verification of Knowledge Graphs against Textual Sources.” Semantic Web DOI: 10.3233/SW-233467
  4. Färber, Michael, Frederic Bartscherer, Carsten Menne, and Achim Rettinger. 2018. “Linked Data Quality of DBpedia, Freebase, Opencyc, Wikidata, and Yago.” Semantic Web 9 (1): 77–129.
  5. Gardent, Claire, Anastasia Shimorina, Shashi Narayan, and Laura Perez-Beltrachini. 2017. “The WebNLG Challenge: Generating Text from RDF Data.” In Proceedings of the 10th International Conference on Natural Language Generation, 124–33.
  6. Honnibal, Matthew, Ines Montani, Sofie Van Landeghem, and Adriane Boyd. 2020. “SpaCy: Industrial-Strength Natural Language Processing in Python.” DOI: 10.5281/zenodo.1212303
  7. Ji, Shaoxiong, Shirui Pan, Erik Cambria, Pekka Marttinen, and Philip S. Yu. 2022. “A Survey on Knowledge Graphs: Representation, Acquisition, and Applications.” IEEE Transactions on Neural Networks and Learning Systems 33 (2): 494–514 DOI: 10.1109/TNNLS.2021.3070843
  8. Krötzsch, Markus, and Gerhard Weikum. 2016. “JWS Special Issue on Knowledge Graphs.” Journal of Web Semantics. International Center for Computational Logic. https://iccl.inf.tu-dresden.de/web/JWS_special_issue_on_Knowledge_Graphs/en.
  9. Malyshev, Stanislav, Markus Krötzsch, Larry González, Julius Gonsior, and Adrian Bielefeldt. 2018. “Getting the Most out of Wikidata: Semantic Technology Usage in Wikipedia’s Knowledge Graph.” In International Semantic Web Conference, 376–94.
  10. McAndrew, Ewan, and Clea Strathmann. 2021. “Quality Assurance and Reliability.” Wikidata Quality Assurance and Reliability. Edinburgh: The University of Edinburgh. https://www.ed.ac.uk/information-services/help-consultancy/is-skills/wikimedia/wikidata/quality-assurance-and-reliability.
  11. Paulheim, Heiko. 2016. “Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods.” Semantic Web 8: 489–508.
  12. Piscopo, Alessandro, Lucie-Aimée Kaffee, Chris Phethean, and Elena Simperl. 2017. “Provenance Information in a Collaborative Knowledge Graph: An Evaluation of Wikidata External References.” In International Semantic Web Conference, 542–58.
  13. Raffel, Colin, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu, et al. 2020. “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.” Journal of Machine Learning Research 21 (140): 1–67.
  14. Soleimani, Amir, Christof Monz, and Marcel Worring. 2020. “BERT for Evidence Retrieval and Claim Verification.” In European Conference on Information Retrieval, 359–66.
  15. Thorne, James, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. “FEVER: A Large-Scale Dataset for Fact Extraction and VERification.” In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1, 809–19. New Orleans: Association for Computational Linguistics DOI: 10.18653/v1/N18-1074
  16. Wang, Xiangyu, Lyuzhou Chen, Taiyu Ban, Muhammad Usman, Yifeng Guan, Shikang Liu, Tianhao Wu, and Huanhuan Chen. 2021. “Knowledge Graph Quality Control: A Survey.” Fundamental Research 1 (5): 607-26 DOI: 10.1016/j.fmre.2021.09.003
  17. Zaveri, Amrapali, Anisa Rula, Andrea Maurino, Ricardo Pietrobon, Jens Lehmann, and Soeren Auer. 2016. “Quality Assessment for Linked Data: A Survey.” Semantic Web 7 (1): 63–93.
PDF
  • Anno di pubblicazione: 2026
  • Pagine: 263-271

XML
  • Anno di pubblicazione: 2026

Informazioni sul capitolo

Titolo del capitolo

Automatic Verification of References of Wikidata Statements

Autori

Elena Simperl, Odinaldo Rodrigues, Albert Meroño-Peñuela, Kholoud Saad Alghamdi, Gabriel Maia Rocha Amaral, Nathan Schneider Gavenski, Jongmo Kim, Miriam Redi, Yiwen Xing, Bohui Zhang, Yihang Zhao

Lingua

Inglese

DOI

10.36253/979-12-215-1010-2.31

Opera sottoposta a peer review

Anno di pubblicazione

2026

Copyright

© 2026 Author(s)

Licenza d'uso

CC BY 4.0

Licenza dei metadati

CC0 1.0

Informazioni bibliografiche

Titolo del libro

Wikidata e la ricerca. Condividere esperienze / Wikidata and Research. Sharing Experiences

Sottotitolo del libro

Atti del Convegno, Firenze, 5-6 giugno 2025 / Conference proceedings, Florence, 5-6 June 2025

Curatori

Elena Marangoni, Camillo Carlo Pellizzari di San Girolamo

Opera sottoposta a peer review

Numero di pagine

378

Anno di pubblicazione

2026

Copyright

© 2026 Author(s)

Licenza d'uso

CC BY 4.0

Licenza dei metadati

CC0 1.0

Editore

Firenze University Press

DOI

10.36253/979-12-215-1010-2

ISBN Print

979-12-215-1009-6

eISBN (pdf)

979-12-215-1010-2

Collana

Studi e saggi

ISSN della collana

2704-6478

e-ISSN della collana

2704-5919

0

Download dei libri

0

Visualizzazioni

Salva la citazione

1.500

Libri in accesso aperto

in catalogo

3.407

Capitoli di Libri

6.027.628

Download dei libri

5.666

Autori

da 1201 Istituzioni e centri di ricerca

di 67 Nazioni

77

scientific boards

da 414 Istituzioni e centri di ricerca

di 46 Nazioni

1.409

I referee

da 410 Istituzioni e centri di ricerca

di 40 Nazioni