Assessing Data Quality: An Approach and An Application. McMann, K., Pemstein, D., Seim, B., Teorell, J., & Lindberg, S. Political Analysis, September, 2021. ECC: 0000000 Publisher: Cambridge University Press
Assessing Data Quality: An Approach and An Application [link]Paper  doi  abstract   bibtex   
Political scientists routinely face the challenge of assessing the quality (validity and reliability) of measures in order to use them in substantive research. While stand-alone assessment tools exist, researchers rarely combine them comprehensively. Further, while a large literature informs data producers, data consumers lack guidance on how to assess existing measures for use in substantive research. We delineate a three-component practical approach to data quality assessment that integrates complementary multimethod tools to assess: (1) content validity; (2) the validity and reliability of the data generation process; and (3) convergent validity. We apply our quality assessment approach to the corruption measures from the Varieties of Democracy (V-Dem) project, both illustrating our rubric and unearthing several quality advantages and disadvantages of the V-Dem measures, compared to other existing measures of corruption.
@article{mcmann_assessing_2021,
	title = {Assessing {Data} {Quality}: {An} {Approach} and {An} {Application}},
	issn = {1047-1987, 1476-4989},
	shorttitle = {Assessing {Data} {Quality}},
	url = {https://www.cambridge.org/core/journals/political-analysis/article/abs/assessing-data-quality-an-approach-and-an-application/F7119E284BEC1E3FF2FA9206FC760BD9#article},
	doi = {10.1017/pan.2021.27},
	abstract = {Political scientists routinely face the challenge of assessing the quality (validity and reliability) of measures in order to use them in substantive research. While stand-alone assessment tools exist, researchers rarely combine them comprehensively. Further, while a large literature informs data producers, data consumers lack guidance on how to assess existing measures for use in substantive research. We delineate a three-component practical approach to data quality assessment that integrates complementary multimethod tools to assess: (1) content validity; (2) the validity and reliability of the data generation process; and (3) convergent validity. We apply our quality assessment approach to the corruption measures from the Varieties of Democracy (V-Dem) project, both illustrating our rubric and unearthing several quality advantages and disadvantages of the V-Dem measures, compared to other existing measures of corruption.},
	language = {en},
	urldate = {2021-10-30},
	journal = {Political Analysis},
	author = {McMann, Kelly and Pemstein, Daniel and Seim, Brigitte and Teorell, Jan and Lindberg, Staffan},
	month = sep,
	year = {2021},
	note = {ECC: 0000000 
Publisher: Cambridge University Press},
	keywords = {Bayesian IRT, corruption, reliability, validity},
	pages = {1--24},
}

Downloads: 0