Comparing the Performance of Propensity Score Methods in Healthcare Database Studies with Rare Outcomes. Franklin, J. M., Eddings, W., Austin, P. C., Stuart, E. A., & Schneeweiss, S. Stat Med, January, 2017.
doi  abstract   bibtex   
Nonrandomized studies of treatments from electronic healthcare databases are critical for producing the evidence necessary to making informed treatment decisions, but often rely on comparing rates of events observed in a small number of patients. In addition, studies constructed from electronic healthcare databases, for example, administrative claims data, often adjust for many, possibly hundreds, of potential confounders. Despite the importance of maximizing efficiency when there are many confounders and few observed outcome events, there has been relatively little research on the relative performance of different propensity score methods in this context. In this paper, we compare a wide variety of propensity-based estimators of the marginal relative risk. In contrast to prior research that has focused on specific statistical methods in isolation of other analytic choices, we instead consider a method to be defined by the complete multistep process from propensity score modeling to final treatment effect estimation. Propensity score model estimation methods considered include ordinary logistic regression, Bayesian logistic regression, lasso, and boosted regression trees. Methods for utilizing the propensity score include pair matching, full matching, decile strata, fine strata, regression adjustment using one or two nonlinear splines, inverse propensity weighting, and matching weights. We evaluate methods via a 'plasmode' simulation study, which creates simulated datasets on the basis of a real cohort study of two treatments constructed from administrative claims data. Our results suggest that regression adjustment and matching weights, regardless of the propensity score model estimation method, provide lower bias and mean squared error in the context of rare binary outcomes. Copyright 2017 John Wiley & Sons, Ltd.
@article{fra17com,
  title = {Comparing the Performance of Propensity Score Methods in Healthcare Database Studies with Rare Outcomes},
  abstract = {Nonrandomized studies of treatments from electronic healthcare databases are critical for producing the evidence necessary to making informed treatment decisions, but often rely on comparing rates of events observed in a small number of patients. In addition, studies constructed from electronic healthcare databases, for example, administrative claims data, often adjust for many, possibly hundreds, of potential confounders. Despite the importance of maximizing efficiency when there are many confounders and few observed outcome events, there has been relatively little research on the relative performance of different propensity score methods in this context. In this paper, we compare a wide variety of propensity-based estimators of the marginal relative risk. In contrast to prior research that has focused on specific statistical methods in isolation of other analytic choices, we instead consider a method to be defined by the complete multistep process from propensity score modeling to final treatment effect estimation. Propensity score model estimation methods considered include ordinary logistic regression, Bayesian logistic regression, lasso, and boosted regression trees. Methods for utilizing the propensity score include pair matching, full matching, decile strata, fine strata, regression adjustment using one or two nonlinear splines, inverse propensity weighting, and matching weights. We evaluate methods via a 'plasmode' simulation study, which creates simulated datasets on the basis of a real cohort study of two treatments constructed from administrative claims data. Our results suggest that regression adjustment and matching weights, regardless of the propensity score model estimation method, provide lower bias and mean squared error in the context of rare binary outcomes. Copyright  2017 John Wiley \& Sons, Ltd.},
  journal = {Stat Med},
  doi = {10.1002/sim.7250},
  author = {Franklin, Jessica M. and Eddings, Wesley and Austin, Peter C. and Stuart, Elizabeth A. and Schneeweiss, Sebastian},
  month = jan,
  year = {2017},
  keywords = {propensity-score,covariable-adjustment,epub-replace},
  pages = {n/a},
  citeulike-article-id = {14281729},
  citeulike-attachment-1 = {fra17com.pdf; /pdf/user/harrelfe/article/14281729/1102672/fra17com.pdf; 1f5fe6204e1398690f6b3f39020f8561d32247ad},
  citeulike-linkout-0 = {http://dx.doi.org/10.1002/sim.7250},
  day = {1},
  posted-at = {2017-02-17 13:30:43},
  priority = {2},
  annote = {Included regression adjustment for spline of propensity in the comparison, which came out as co-winner with weighted matching.}
}

Downloads: 0