The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests. Uygun Tunç, D., Tunç, M. N., & Lakens, D. Theory & Psychology, March, 2023. Publisher: SAGE Publications Ltd
The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests [link]Paper  doi  abstract   bibtex   
Researchers commonly make dichotomous claims based on continuous test statistics. Many have branded the practice as a misuse of statistics and criticize scientists for the widespread application of hypothesis tests to tentatively reject a hypothesis (or not) depending on whether a p-value is below or above an alpha level. Although dichotomous claims are rarely explicitly defended, we argue they play an important epistemological and pragmatic role in science. The epistemological function of dichotomous claims consists in transforming data into quasibasic statements, which are tentatively accepted singular facts that can corroborate or falsify theoretical claims. This transformation requires a prespecified methodological decision procedure such as Neyman-Pearson hypothesis tests. From the perspective of methodological falsificationism these decision procedures are necessary, as probabilistic statements (e.g., continuous test statistics) cannot function as falsifiers of substantive hypotheses. The pragmatic function of dichotomous claims is to facilitate scrutiny and criticism among peers by generating contestable claims, a process referred to by Popper as ?conjectures and refutations.? We speculate about how the surprisingly widespread use of a 5% alpha level might have facilitated this pragmatic function. Abandoning dichotomous claims, for example because researchers commonly misuse p-values, would sacrifice their crucial epistemic and pragmatic functions.
@article{uygun_tunc_epistemic_2023,
	title = {The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests},
	issn = {0959-3543},
	url = {https://doi.org/10.1177/09593543231160112},
	doi = {10.1177/09593543231160112},
	abstract = {Researchers commonly make dichotomous claims based on continuous test statistics. Many have branded the practice as a misuse of statistics and criticize scientists for the widespread application of hypothesis tests to tentatively reject a hypothesis (or not) depending on whether a p-value is below or above an alpha level. Although dichotomous claims are rarely explicitly defended, we argue they play an important epistemological and pragmatic role in science. The epistemological function of dichotomous claims consists in transforming data into quasibasic statements, which are tentatively accepted singular facts that can corroborate or falsify theoretical claims. This transformation requires a prespecified methodological decision procedure such as Neyman-Pearson hypothesis tests. From the perspective of methodological falsificationism these decision procedures are necessary, as probabilistic statements (e.g., continuous test statistics) cannot function as falsifiers of substantive hypotheses. The pragmatic function of dichotomous claims is to facilitate scrutiny and criticism among peers by generating contestable claims, a process referred to by Popper as ?conjectures and refutations.? We speculate about how the surprisingly widespread use of a 5\% alpha level might have facilitated this pragmatic function. Abandoning dichotomous claims, for example because researchers commonly misuse p-values, would sacrifice their crucial epistemic and pragmatic functions.},
	language = {en},
	urldate = {2023-03-16},
	journal = {Theory \& Psychology},
	author = {Uygun Tunç, Duygu and Tunç, Mehmet Necip and Lakens, Daniël},
	month = mar,
	year = {2023},
	note = {Publisher: SAGE Publications Ltd},
	keywords = {Quantitative Methods, Social and Behavioral Sciences, Theory and Philosophy of Science, basic statements, dichotomous claims, methodological falsificationism, statisitical hypothesis testing, theory testing},
	pages = {09593543231160112},
}

Downloads: 0