All metrics are equal, but some metrics are more equal than others: A systematic search and review on the use of the term ‘metric’. Adroher, N. D., Prodinger, B., Fellinghauer, C. S., & Tennant, A. PLOS ONE, 13(3):e0193861, March, 2018. Publisher: Public Library of Science![All metrics are equal, but some metrics are more equal than others: A systematic search and review on the use of the term ‘metric’ [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex Objective To examine the use of the term ‘metric’ in health and social sciences’ literature, focusing on the interval scale implication of the term in Modern Test Theory (MTT). Materials and methods A systematic search and review on MTT studies including ‘metric’ or ‘interval scale’ was performed in the health and social sciences literature. The search was restricted to 2001–2005 and 2011–2015. A Text Mining algorithm was employed to operationalize the eligibility criteria and to explore the uses of ‘metric’. The paradigm of each included article (Rasch Measurement Theory (RMT), Item Response Theory (IRT) or both), as well as its type (Theoretical, Methodological, Teaching, Application, Miscellaneous) were determined. An inductive thematic analysis on the first three types was performed. Results 70.6\% of the 1337 included articles were allocated to RMT, and 68.4\% were application papers. Among the number of uses of ‘metric’, it was predominantly a synonym of ‘scale’; as adjective, it referred to measurement or quantification. Three incompatible themes ‘only RMT/all MTT/no MTT models can provide interval measures’ were identified, but ‘interval scale’ was considerably more mentioned in RMT than in IRT. Conclusion ‘Metric’ is used in many different ways, and there is no consensus on which MTT metric has interval scale properties. Nevertheless, when using the term ‘metric’, the authors should specify the level of the metric being used (ordinal, ordered, interval, ratio), and justify why according to them the metric is at that level.
@article{adroher_all_2018,
title = {All metrics are equal, but some metrics are more equal than others: {A} systematic search and review on the use of the term ‘metric’},
volume = {13},
issn = {1932-6203},
shorttitle = {All metrics are equal, but some metrics are more equal than others},
url = {https://dx.plos.org/10.1371/journal.pone.0193861},
doi = {10.1371/journal.pone.0193861},
abstract = {Objective To examine the use of the term ‘metric’ in health and social sciences’ literature, focusing on the interval scale implication of the term in Modern Test Theory (MTT). Materials and methods A systematic search and review on MTT studies including ‘metric’ or ‘interval scale’ was performed in the health and social sciences literature. The search was restricted to 2001–2005 and 2011–2015. A Text Mining algorithm was employed to operationalize the eligibility criteria and to explore the uses of ‘metric’. The paradigm of each included article (Rasch Measurement Theory (RMT), Item Response Theory (IRT) or both), as well as its type (Theoretical, Methodological, Teaching, Application, Miscellaneous) were determined. An inductive thematic analysis on the first three types was performed. Results 70.6{\textbackslash}\% of the 1337 included articles were allocated to RMT, and 68.4{\textbackslash}\% were application papers. Among the number of uses of ‘metric’, it was predominantly a synonym of ‘scale’; as adjective, it referred to measurement or quantification. Three incompatible themes ‘only RMT/all MTT/no MTT models can provide interval measures’ were identified, but ‘interval scale’ was considerably more mentioned in RMT than in IRT. Conclusion ‘Metric’ is used in many different ways, and there is no consensus on which MTT metric has interval scale properties. Nevertheless, when using the term ‘metric’, the authors should specify the level of the metric being used (ordinal, ordered, interval, ratio), and justify why according to them the metric is at that level.},
language = {en},
number = {3},
urldate = {2021-06-02},
journal = {PLOS ONE},
author = {Adroher, Núria Duran and Prodinger, Birgit and Fellinghauer, Carolina Saskia and Tennant, Alan},
editor = {Huang, Jinhai},
month = mar,
year = {2018},
note = {Publisher: Public Library of Science},
pages = {e0193861},
}
Downloads: 0
{"_id":"DPxkkBRiQGy2yv8gf","bibbaseid":"adroher-prodinger-fellinghauer-tennant-allmetricsareequalbutsomemetricsaremoreequalthanothersasystematicsearchandreviewontheuseofthetermmetric-2018","authorIDs":[],"author_short":["Adroher, N. D.","Prodinger, B.","Fellinghauer, C. S.","Tennant, A."],"bibdata":{"bibtype":"article","type":"article","title":"All metrics are equal, but some metrics are more equal than others: A systematic search and review on the use of the term ‘metric’","volume":"13","issn":"1932-6203","shorttitle":"All metrics are equal, but some metrics are more equal than others","url":"https://dx.plos.org/10.1371/journal.pone.0193861","doi":"10.1371/journal.pone.0193861","abstract":"Objective To examine the use of the term ‘metric’ in health and social sciences’ literature, focusing on the interval scale implication of the term in Modern Test Theory (MTT). Materials and methods A systematic search and review on MTT studies including ‘metric’ or ‘interval scale’ was performed in the health and social sciences literature. The search was restricted to 2001–2005 and 2011–2015. A Text Mining algorithm was employed to operationalize the eligibility criteria and to explore the uses of ‘metric’. The paradigm of each included article (Rasch Measurement Theory (RMT), Item Response Theory (IRT) or both), as well as its type (Theoretical, Methodological, Teaching, Application, Miscellaneous) were determined. An inductive thematic analysis on the first three types was performed. Results 70.6\\% of the 1337 included articles were allocated to RMT, and 68.4\\% were application papers. Among the number of uses of ‘metric’, it was predominantly a synonym of ‘scale’; as adjective, it referred to measurement or quantification. Three incompatible themes ‘only RMT/all MTT/no MTT models can provide interval measures’ were identified, but ‘interval scale’ was considerably more mentioned in RMT than in IRT. Conclusion ‘Metric’ is used in many different ways, and there is no consensus on which MTT metric has interval scale properties. Nevertheless, when using the term ‘metric’, the authors should specify the level of the metric being used (ordinal, ordered, interval, ratio), and justify why according to them the metric is at that level.","language":"en","number":"3","urldate":"2021-06-02","journal":"PLOS ONE","author":[{"propositions":[],"lastnames":["Adroher"],"firstnames":["Núria","Duran"],"suffixes":[]},{"propositions":[],"lastnames":["Prodinger"],"firstnames":["Birgit"],"suffixes":[]},{"propositions":[],"lastnames":["Fellinghauer"],"firstnames":["Carolina","Saskia"],"suffixes":[]},{"propositions":[],"lastnames":["Tennant"],"firstnames":["Alan"],"suffixes":[]}],"editor":[{"propositions":[],"lastnames":["Huang"],"firstnames":["Jinhai"],"suffixes":[]}],"month":"March","year":"2018","note":"Publisher: Public Library of Science","pages":"e0193861","bibtex":"@article{adroher_all_2018,\n\ttitle = {All metrics are equal, but some metrics are more equal than others: {A} systematic search and review on the use of the term ‘metric’},\n\tvolume = {13},\n\tissn = {1932-6203},\n\tshorttitle = {All metrics are equal, but some metrics are more equal than others},\n\turl = {https://dx.plos.org/10.1371/journal.pone.0193861},\n\tdoi = {10.1371/journal.pone.0193861},\n\tabstract = {Objective To examine the use of the term ‘metric’ in health and social sciences’ literature, focusing on the interval scale implication of the term in Modern Test Theory (MTT). Materials and methods A systematic search and review on MTT studies including ‘metric’ or ‘interval scale’ was performed in the health and social sciences literature. The search was restricted to 2001–2005 and 2011–2015. A Text Mining algorithm was employed to operationalize the eligibility criteria and to explore the uses of ‘metric’. The paradigm of each included article (Rasch Measurement Theory (RMT), Item Response Theory (IRT) or both), as well as its type (Theoretical, Methodological, Teaching, Application, Miscellaneous) were determined. An inductive thematic analysis on the first three types was performed. Results 70.6{\\textbackslash}\\% of the 1337 included articles were allocated to RMT, and 68.4{\\textbackslash}\\% were application papers. Among the number of uses of ‘metric’, it was predominantly a synonym of ‘scale’; as adjective, it referred to measurement or quantification. Three incompatible themes ‘only RMT/all MTT/no MTT models can provide interval measures’ were identified, but ‘interval scale’ was considerably more mentioned in RMT than in IRT. Conclusion ‘Metric’ is used in many different ways, and there is no consensus on which MTT metric has interval scale properties. Nevertheless, when using the term ‘metric’, the authors should specify the level of the metric being used (ordinal, ordered, interval, ratio), and justify why according to them the metric is at that level.},\n\tlanguage = {en},\n\tnumber = {3},\n\turldate = {2021-06-02},\n\tjournal = {PLOS ONE},\n\tauthor = {Adroher, Núria Duran and Prodinger, Birgit and Fellinghauer, Carolina Saskia and Tennant, Alan},\n\teditor = {Huang, Jinhai},\n\tmonth = mar,\n\tyear = {2018},\n\tnote = {Publisher: Public Library of Science},\n\tpages = {e0193861},\n}\n\n","author_short":["Adroher, N. D.","Prodinger, B.","Fellinghauer, C. S.","Tennant, A."],"editor_short":["Huang, J."],"key":"adroher_all_2018","id":"adroher_all_2018","bibbaseid":"adroher-prodinger-fellinghauer-tennant-allmetricsareequalbutsomemetricsaremoreequalthanothersasystematicsearchandreviewontheuseofthetermmetric-2018","role":"author","urls":{"Paper":"https://dx.plos.org/10.1371/journal.pone.0193861"},"metadata":{"authorlinks":{}},"html":""},"bibtype":"article","biburl":"https://bibbase.org/zotero/iagogv","creationDate":"2020-07-20T14:12:52.827Z","downloads":0,"keywords":[],"search_terms":["metrics","equal","metrics","more","equal","others","systematic","search","review","use","term","metric","adroher","prodinger","fellinghauer","tennant"],"title":"All metrics are equal, but some metrics are more equal than others: A systematic search and review on the use of the term ‘metric’","year":2018,"dataSources":["DRtAYnGdoBJyEZ2H7","ovn29uG6Mbp3JWCRR"]}