Design-comparable effect sizes in multiple baseline designs: A general modeling framework

Authors

James E. Pustejovsky

Larry V. Hedges

William R. Shadish

Published

October 1, 2014

In single-case research, the multiple baseline design is a widely used approach for evaluating the effects of interventions on individuals. Multiple baseline designs involve repeated measurement of outcomes over time and the controlled introduction of a treatment at different times for different individuals. This article outlines a general framework for defining effect sizes in multiple baseline designs that are directly comparable to the standardized mean difference from a between-subjects randomized experiment. The target, design-comparable effect size parameter can be estimated using restricted maximum likelihood together with a small sample correction analogous to Hedges’s g. The approach is demonstrated using hierarchical linear models that include baseline time trends and treatment-by-time interactions. A simulation compares the performance of the proposed estimator to that of an alternative, and an application illustrates the model-fitting process.

Back to top

Citation

BibTeX citation:
@article{pustejovsky2014,
  author = {Pustejovsky, James E. and Hedges, Larry V. and Shadish,
    William R.},
  title = {Design-Comparable Effect Sizes in Multiple Baseline Designs:
    {A} General Modeling Framework},
  journal = {Journal of Educational and Behavioral Statistics},
  volume = {39},
  number = {5},
  pages = {368-393},
  date = {2014-10-01},
  url = {https://doi.org/10.3102/1076998614547577},
  doi = {10.1016/j.jsp.2018.02.003},
  langid = {en}
}
For attribution, please cite this work as:
Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R. (2014). Design-comparable effect sizes in multiple baseline designs: A general modeling framework. Journal of Educational and Behavioral Statistics, 39(5), 368–393. https://doi.org/10.1016/j.jsp.2018.02.003