Assessing the Reliability and Scientific Rigor of References in Wikidata. Schuster, H., Anjomshoaa, A., & Polleres, A. In Salatino, A. A., Mannocci, A., Osborne, F., Schimmler, S., & Rehm, G., editors, Proceedings of the 4th International Workshop on Scientific Knowledge (Sci-K), co-located with 23rd International Semantic Web Conference (ISWC 2024), volume 3780, of CEUR Workshop Proceedings, November, 2024. CEUR-WS.org. Paper abstract bibtex Wikidata is a rapidly growing user-edited open knowledge graph that provides easy access to structured data. Since Wikidata allows contradictory information, references are crucial for supporting statements and tracking the source of information. Consequently, investigating the use, types, and scientific value of references within Wikidata is essential. In this paper, we will first conduct a heuristic evaluation of Wikidata references using a sampling method. Subsequently, we will focus on a specific category of references, Digital Object Identifiers (DOIs), known for citing scientific publications. Our sampled Wikidata statements analysis indicates widespread adoption of the DOI system within Wikidata. To assess the quality of scholarly resources referenced in Wikidata, we used percentile metrics derived from the OpenAlex platform. Additionally, h-index indicators from OpenAlex were employed to evaluate the credibility of these sources and determine whether the Wikidata citations originated from reputable sources or publishers. Our findings show that papers in the social and physical sciences tend to perform better in Wikidata compared to OpenAlex. Moreover, while top-tier journals dominate citations in OpenAlex—particularly in the health and life sciences— Wikidata shows a higher citation rate for mid-tier and emerging journals. This indicates a broader representation of scholarly contributions within Wikidata.
@inproceedings{schu-etal-2024SciK,
booktitle = {Proceedings of the 4th International Workshop on Scientific Knowledge (Sci-K), co-located with 23rd International Semantic Web Conference (ISWC 2024)},
editor = {Angelo A. Salatino and Andrea Mannocci and Francesco Osborne and Sonja Schimmler and Georg Rehm},
title = {Assessing the Reliability and Scientific Rigor of References in {Wikidata}},
author = {Hannah Schuster and Amin Anjomshoaa and Axel Polleres},
url = {https://ceur-ws.org/Vol-3780/paper7.pdf},
year = 2024,
month = nov,
day = 12,
abstract = {Wikidata is a rapidly growing user-edited open knowledge graph that provides easy access to structured data.
Since Wikidata allows contradictory information, references are crucial for supporting statements and tracking
the source of information. Consequently, investigating the use, types, and scientific value of references within
Wikidata is essential. In this paper, we will first conduct a heuristic evaluation of Wikidata references using a
sampling method. Subsequently, we will focus on a specific category of references, Digital Object Identifiers
(DOIs), known for citing scientific publications. Our sampled Wikidata statements analysis indicates widespread
adoption of the DOI system within Wikidata. To assess the quality of scholarly resources referenced in Wikidata,
we used percentile metrics derived from the OpenAlex platform. Additionally, h-index indicators from OpenAlex
were employed to evaluate the credibility of these sources and determine whether the Wikidata citations originated
from reputable sources or publishers. Our findings show that papers in the social and physical sciences tend
to perform better in Wikidata compared to OpenAlex. Moreover, while top-tier journals dominate citations in
OpenAlex—particularly in the health and life sciences— Wikidata shows a higher citation rate for mid-tier and
emerging journals. This indicates a broader representation of scholarly contributions within Wikidata.},
series = {{CEUR} Workshop Proceedings},
volume = 3780,
publisher = {CEUR-WS.org},
}
Downloads: 0
{"_id":"WouSsaBmhoENLZ5iL","bibbaseid":"schuster-anjomshoaa-polleres-assessingthereliabilityandscientificrigorofreferencesinwikidata-2024","author_short":["Schuster, H.","Anjomshoaa, A.","Polleres, A."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","booktitle":"Proceedings of the 4th International Workshop on Scientific Knowledge (Sci-K), co-located with 23rd International Semantic Web Conference (ISWC 2024)","editor":[{"firstnames":["Angelo","A."],"propositions":[],"lastnames":["Salatino"],"suffixes":[]},{"firstnames":["Andrea"],"propositions":[],"lastnames":["Mannocci"],"suffixes":[]},{"firstnames":["Francesco"],"propositions":[],"lastnames":["Osborne"],"suffixes":[]},{"firstnames":["Sonja"],"propositions":[],"lastnames":["Schimmler"],"suffixes":[]},{"firstnames":["Georg"],"propositions":[],"lastnames":["Rehm"],"suffixes":[]}],"title":"Assessing the Reliability and Scientific Rigor of References in Wikidata","author":[{"firstnames":["Hannah"],"propositions":[],"lastnames":["Schuster"],"suffixes":[]},{"firstnames":["Amin"],"propositions":[],"lastnames":["Anjomshoaa"],"suffixes":[]},{"firstnames":["Axel"],"propositions":[],"lastnames":["Polleres"],"suffixes":[]}],"url":"https://ceur-ws.org/Vol-3780/paper7.pdf","year":"2024","month":"November","day":"12","abstract":"Wikidata is a rapidly growing user-edited open knowledge graph that provides easy access to structured data. Since Wikidata allows contradictory information, references are crucial for supporting statements and tracking the source of information. Consequently, investigating the use, types, and scientific value of references within Wikidata is essential. In this paper, we will first conduct a heuristic evaluation of Wikidata references using a sampling method. Subsequently, we will focus on a specific category of references, Digital Object Identifiers (DOIs), known for citing scientific publications. Our sampled Wikidata statements analysis indicates widespread adoption of the DOI system within Wikidata. To assess the quality of scholarly resources referenced in Wikidata, we used percentile metrics derived from the OpenAlex platform. Additionally, h-index indicators from OpenAlex were employed to evaluate the credibility of these sources and determine whether the Wikidata citations originated from reputable sources or publishers. Our findings show that papers in the social and physical sciences tend to perform better in Wikidata compared to OpenAlex. Moreover, while top-tier journals dominate citations in OpenAlex—particularly in the health and life sciences— Wikidata shows a higher citation rate for mid-tier and emerging journals. This indicates a broader representation of scholarly contributions within Wikidata.","series":"CEUR Workshop Proceedings","volume":"3780","publisher":"CEUR-WS.org","bibtex":"@inproceedings{schu-etal-2024SciK,\nbooktitle = {Proceedings of the 4th International Workshop on Scientific Knowledge (Sci-K), co-located with 23rd International Semantic Web Conference (ISWC 2024)},\neditor = {Angelo A. Salatino and Andrea Mannocci and Francesco Osborne and Sonja Schimmler and Georg Rehm},\ntitle = {Assessing the Reliability and Scientific Rigor of References in {Wikidata}},\nauthor = {Hannah Schuster and Amin Anjomshoaa and Axel Polleres},\nurl = {https://ceur-ws.org/Vol-3780/paper7.pdf},\nyear = 2024,\nmonth = nov,\nday = 12,\nabstract = {Wikidata is a rapidly growing user-edited open knowledge graph that provides easy access to structured data.\nSince Wikidata allows contradictory information, references are crucial for supporting statements and tracking\nthe source of information. Consequently, investigating the use, types, and scientific value of references within\nWikidata is essential. In this paper, we will first conduct a heuristic evaluation of Wikidata references using a\nsampling method. Subsequently, we will focus on a specific category of references, Digital Object Identifiers\n(DOIs), known for citing scientific publications. Our sampled Wikidata statements analysis indicates widespread\nadoption of the DOI system within Wikidata. To assess the quality of scholarly resources referenced in Wikidata,\nwe used percentile metrics derived from the OpenAlex platform. Additionally, h-index indicators from OpenAlex\nwere employed to evaluate the credibility of these sources and determine whether the Wikidata citations originated\nfrom reputable sources or publishers. Our findings show that papers in the social and physical sciences tend\nto perform better in Wikidata compared to OpenAlex. Moreover, while top-tier journals dominate citations in\nOpenAlex—particularly in the health and life sciences— Wikidata shows a higher citation rate for mid-tier and\nemerging journals. This indicates a broader representation of scholarly contributions within Wikidata.},\nseries = {{CEUR} Workshop Proceedings},\nvolume = 3780,\npublisher = {CEUR-WS.org},\n}\n\n","author_short":["Schuster, H.","Anjomshoaa, A.","Polleres, A."],"editor_short":["Salatino, A. A.","Mannocci, A.","Osborne, F.","Schimmler, S.","Rehm, G."],"key":"schu-etal-2024SciK","id":"schu-etal-2024SciK","bibbaseid":"schuster-anjomshoaa-polleres-assessingthereliabilityandscientificrigorofreferencesinwikidata-2024","role":"author","urls":{"Paper":"https://ceur-ws.org/Vol-3780/paper7.pdf"},"metadata":{"authorlinks":{}},"downloads":0,"html":""},"bibtype":"inproceedings","biburl":"www.polleres.net/mypublications.bib","dataSources":["gixxkiKt6rtWGoKSh"],"keywords":[],"search_terms":["assessing","reliability","scientific","rigor","references","wikidata","schuster","anjomshoaa","polleres"],"title":"Assessing the Reliability and Scientific Rigor of References in Wikidata","year":2024}