Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination. Hejri, S. M., Jalili, M., Muijtjens, A. M. M., & Van Der Vleuten, C. P. M. Journal of Research in Medical Sciences : The Official Journal of Isfahan University of Medical Sciences, 18(10):887–891, October, 2013. ![Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper abstract bibtex Background: One of the methods used for standard setting is the borderline regression method (BRM). This study aims to assess the reliability of BRM when the pass-fail standard in an objective structured clinical examination (OSCE) was calculated by averaging the BRM standards obtained for each station separately. Materials and Methods: In nine stations of the OSCE with direct observation the examiners gave each student a checklist score and a global score. Using a linear regression model for each station, we calculated the checklist score cut-off on the regression equation for the global scale cut-off set at 2. The OSCE pass-fail standard was defined as the average of all station's standard. To determine the reliability, the root mean square error (RMSE) was calculated. The R2 coefficient and the inter-grade discrimination were calculated to assess the quality of OSCE. Results: The mean total test score was 60.78. The OSCE pass-fail standard and its RMSE were 47.37 and 0.55, respectively. The R2 coefficients ranged from 0.44 to 0.79. The inter-grade discrimination score varied greatly among stations. Conclusion: The RMSE of the standard was very small indicating that BRM is a reliable method of setting standard for OSCE, which has the advantage of providing data for quality assurance.
@article{hejri_assessing_2013,
title = {Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination},
volume = {18},
issn = {1735-1995},
url = {https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3897074/},
abstract = {Background:
One of the methods used for standard setting is the borderline regression method (BRM). This study aims to assess the reliability of BRM when the pass-fail standard in an objective structured clinical examination (OSCE) was calculated by averaging the BRM standards obtained for each station separately.
Materials and Methods:
In nine stations of the OSCE with direct observation the examiners gave each student a checklist score and a global score. Using a linear regression model for each station, we calculated the checklist score cut-off on the regression equation for the global scale cut-off set at 2. The OSCE pass-fail standard was defined as the average of all station's standard. To determine the reliability, the root mean square error (RMSE) was calculated. The R2 coefficient and the inter-grade discrimination were calculated to assess the quality of OSCE.
Results:
The mean total test score was 60.78. The OSCE pass-fail standard and its RMSE were 47.37 and 0.55, respectively. The R2 coefficients ranged from 0.44 to 0.79. The inter-grade discrimination score varied greatly among stations.
Conclusion:
The RMSE of the standard was very small indicating that BRM is a reliable method of setting standard for OSCE, which has the advantage of providing data for quality assurance.},
number = {10},
urldate = {2022-02-06},
journal = {Journal of Research in Medical Sciences : The Official Journal of Isfahan University of Medical Sciences},
author = {Hejri, Sara Mortaz and Jalili, Mohammad and Muijtjens, Arno M. M. and Van Der Vleuten, Cees P. M.},
month = oct,
year = {2013},
pmid = {24497861},
pmcid = {PMC3897074},
pages = {887--891},
}
Downloads: 0
{"_id":"kBp6hDSJwBZvSN2q3","bibbaseid":"hejri-jalili-muijtjens-vandervleuten-assessingthereliabilityoftheborderlineregressionmethodasastandardsettingprocedureforobjectivestructuredclinicalexamination-2013","author_short":["Hejri, S. M.","Jalili, M.","Muijtjens, A. M. M.","Van Der Vleuten, C. P. M."],"bibdata":{"bibtype":"article","type":"article","title":"Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination","volume":"18","issn":"1735-1995","url":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3897074/","abstract":"Background: One of the methods used for standard setting is the borderline regression method (BRM). This study aims to assess the reliability of BRM when the pass-fail standard in an objective structured clinical examination (OSCE) was calculated by averaging the BRM standards obtained for each station separately. Materials and Methods: In nine stations of the OSCE with direct observation the examiners gave each student a checklist score and a global score. Using a linear regression model for each station, we calculated the checklist score cut-off on the regression equation for the global scale cut-off set at 2. The OSCE pass-fail standard was defined as the average of all station's standard. To determine the reliability, the root mean square error (RMSE) was calculated. The R2 coefficient and the inter-grade discrimination were calculated to assess the quality of OSCE. Results: The mean total test score was 60.78. The OSCE pass-fail standard and its RMSE were 47.37 and 0.55, respectively. The R2 coefficients ranged from 0.44 to 0.79. The inter-grade discrimination score varied greatly among stations. Conclusion: The RMSE of the standard was very small indicating that BRM is a reliable method of setting standard for OSCE, which has the advantage of providing data for quality assurance.","number":"10","urldate":"2022-02-06","journal":"Journal of Research in Medical Sciences : The Official Journal of Isfahan University of Medical Sciences","author":[{"propositions":[],"lastnames":["Hejri"],"firstnames":["Sara","Mortaz"],"suffixes":[]},{"propositions":[],"lastnames":["Jalili"],"firstnames":["Mohammad"],"suffixes":[]},{"propositions":[],"lastnames":["Muijtjens"],"firstnames":["Arno","M.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Van","Der","Vleuten"],"firstnames":["Cees","P.","M."],"suffixes":[]}],"month":"October","year":"2013","pmid":"24497861","pmcid":"PMC3897074","pages":"887–891","bibtex":"@article{hejri_assessing_2013,\n\ttitle = {Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination},\n\tvolume = {18},\n\tissn = {1735-1995},\n\turl = {https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3897074/},\n\tabstract = {Background:\nOne of the methods used for standard setting is the borderline regression method (BRM). This study aims to assess the reliability of BRM when the pass-fail standard in an objective structured clinical examination (OSCE) was calculated by averaging the BRM standards obtained for each station separately.\n\nMaterials and Methods:\nIn nine stations of the OSCE with direct observation the examiners gave each student a checklist score and a global score. Using a linear regression model for each station, we calculated the checklist score cut-off on the regression equation for the global scale cut-off set at 2. The OSCE pass-fail standard was defined as the average of all station's standard. To determine the reliability, the root mean square error (RMSE) was calculated. The R2 coefficient and the inter-grade discrimination were calculated to assess the quality of OSCE.\n\nResults:\nThe mean total test score was 60.78. The OSCE pass-fail standard and its RMSE were 47.37 and 0.55, respectively. The R2 coefficients ranged from 0.44 to 0.79. The inter-grade discrimination score varied greatly among stations.\n\nConclusion:\nThe RMSE of the standard was very small indicating that BRM is a reliable method of setting standard for OSCE, which has the advantage of providing data for quality assurance.},\n\tnumber = {10},\n\turldate = {2022-02-06},\n\tjournal = {Journal of Research in Medical Sciences : The Official Journal of Isfahan University of Medical Sciences},\n\tauthor = {Hejri, Sara Mortaz and Jalili, Mohammad and Muijtjens, Arno M. M. and Van Der Vleuten, Cees P. M.},\n\tmonth = oct,\n\tyear = {2013},\n\tpmid = {24497861},\n\tpmcid = {PMC3897074},\n\tpages = {887--891},\n}\n\n","author_short":["Hejri, S. M.","Jalili, M.","Muijtjens, A. M. M.","Van Der Vleuten, C. P. M."],"key":"hejri_assessing_2013","id":"hejri_assessing_2013","bibbaseid":"hejri-jalili-muijtjens-vandervleuten-assessingthereliabilityoftheborderlineregressionmethodasastandardsettingprocedureforobjectivestructuredclinicalexamination-2013","role":"author","urls":{"Paper":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3897074/"},"metadata":{"authorlinks":{}},"html":""},"bibtype":"article","biburl":"https://bibbase.org/zotero/robin.marlow","dataSources":["ix72eqAAMGCuupBaz"],"keywords":[],"search_terms":["assessing","reliability","borderline","regression","method","standard","setting","procedure","objective","structured","clinical","examination","hejri","jalili","muijtjens","van der vleuten"],"title":"Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination","year":2013}