A comparison of 20 heterogeneity variance estimators in statistical synthesis of results from studies (Journal article)

Πετροπούλου, Μαρία/ Μαυρίδης, Δημήτρης


When we synthesize research findings via meta-analysis, it is common to assume that the true underlying effect differs across studies. There is a plethora of estimation methods available for the between-study variability. The widely used DerSimonian and Laird estimation method has been challenged but knowledge for the overall performance of heterogeneity estimators is incomplete. We identified 20 heterogeneity estimators in the literature and evaluated their performance in terms of bias, type error I rate and power via a simulation study. Moreover, we compared the Knapp and Hartung and the Wald-type method for estimating confidence interval for the summary estimate. Although previous simulation studies have suggested the Paule-Mandel (PM) estimator, it has not been compared with all the available estimators. For dichotomous outcomes, estimating heterogeneity through Markov Chain Monte Carlo is a good choice if the prior distribution for heterogeneity is informed by published Cochrane reviews. Non parametric bootstrap (DLb) performs well for all assessment criteria for both dichotomous and continuous outcomes. The positive DerSimonian and Laird (DLp) and the Hartung-Makambi (HM) estimators can be an alternative choice for dichotomous outcome when the heterogeneity values are close to 𝟎.𝟎𝟕 and for continuous outcome for all and for medium heterogeneity values (𝟎.𝟎𝟏,𝟎.𝟎𝟓), respectively. Hence, they are heterogeneity estimators (DLb; DLp) which perform better than the suggested PM. Maximum likelihood (ML) provide the best performance for both types of outcome in the absence of heterogeneity.
Alternative title / Subtitle: A simulation study
Institution and School/Department of submitter: Πανεπιστήμιο Ιωαννίνων. Σχολή Επιστημών Αγωγής. Παιδαγωγικό Τμήμα Δημοτικής Εκπαίδευσης.
Keywords: bias,type I error,heterogeneity variance estimators,power,simulation study
URI: http://olympias.lib.uoi.gr/jspui/handle/123456789/29117
Publisher: Wiley
Appears in Collections:Άρθρα σε επιστημονικά περιοδικά ( Ανοικτά)

Files in This Item:
File Description SizeFormat 
Heterogeneity- Simulation study.pdfΚύριο Άρθρο643.07 kBAdobe PDFView/Open
figures_supplementary.pdfΣυμπληρωματικοί πίνακες592.63 kBAdobe PDFView/Open
sup-0001-supplementary.pdfΣυμπληρωματικά στοιχεία316.47 kBAdobe PDFView/Open



 Please use this identifier to cite or link to this item:
http://olympias.lib.uoi.gr/jspui/handle/123456789/29117
  This item is a favorite for 0 people.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.