A preliminary data analysis workflow for meta-analysis of dependent effect sizes

Authors

James E. Pustejovsky

Jingru Zhang

Elizabeth Tipton

Published

May 8, 2025

In many fields of application, meta-analyses routinely involve dependent effect size estimates and hierarchical data structures. Statistical methods for analyzing dependent effect sizes are now well developed, but there has been less attention to the initial stages of data analysis, prior to formal modeling. We propose a generic workflow for preliminary, exploratory analyses of meta-analytic databases, which focuses on validating the integrity of the input data and informing decisions about subsequent statistical modeling. The workflow entails creating summaries and visualizations of features of the primary studies included in the meta-analysis in order to understand the structure and distribution of the data, especially with respect to between- and within-study variation. We illustrate the workflow using data from previously published meta-analyses and discuss connections between the preliminary analysis and subsequent statistical modeling strategies.

Back to top

Citation

BibTeX citation:
@misc{pustejovsky2025,
  author = {Pustejovsky, James E. and Zhang, Jingru and Tipton,
    Elizabeth},
  title = {A Preliminary Data Analysis Workflow for Meta-Analysis of
    Dependent Effect Sizes},
  date = {2025-05-08},
  url = {https://osf.io/preprints/metaarxiv/vfsqx_v1},
  doi = {10.31222/osf.io/vfsqx_v1},
  langid = {en}
}
For attribution, please cite this work as:
Pustejovsky, J. E., Zhang, J., & Tipton, E. (2025). A preliminary data analysis workflow for meta-analysis of dependent effect sizes. https://doi.org/10.31222/osf.io/vfsqx_v1