<i>P</i> value-driven methods were underpowered to detect publication bias: analysis of Cochrane review meta-analyses


Furuya-Kanamori L., Xu C., Lin L., Tinh Doan T. D., Chu H., Thalib L., ...Daha Fazla

JOURNAL OF CLINICAL EPIDEMIOLOGY, cilt.118, ss.86-92, 2020 (SCI-Expanded, Scopus) identifier identifier identifier

  • Yayın Türü: Makale / Derleme
  • Cilt numarası: 118
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1016/j.jclinepi.2019.11.011
  • Dergi Adı: JOURNAL OF CLINICAL EPIDEMIOLOGY
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Agricultural & Environmental Science Database, CAB Abstracts, CINAHL, EMBASE, MEDLINE, DIALNET
  • Sayfa Sayıları: ss.86-92
  • Yıldız Teknik Üniversitesi Adresli: Hayır

Özet

Objectives: The aim of the study was to investigate the effect of number of studies in a meta-analysis on the detection of publication bias using P value-driven methods. Methods: The proportion of meta-analyses detected by Egger's, Harbord's, Peters', and Begg's tests to have asymmetry suggestive of publication bias were examined in 5,014 meta-analyses from Cochrane reviews. P values were also assessed in meta-analyses with varying number of studies, whereas symmetry was held constant. A simulation study was conducted to investigate if the above tests underestimate or overestimate the presence of publication bias. Results: The proportion of meta-analyses detected as asymmetrical via Egger's, Harbord's, Peters', and Begg's tests decreased by 42.6%, 41.1%, 29.3%, and 28.3%, respectively, when the median number of studies in the meta-analysis decreased from 87 to 14. P values decreased as the number of studies increased in the meta-analysis, despite the level of symmetry remaining constant. The simulation study confirmed that when publication bias is present, P value tests underestimate the presence of publication bias, particularly when study numbers are small. Conclusion: P value-based tests used for the detection of publication bias-related asymmetry in meta-analysis require careful examination, as they underestimate asymmetry. Alternative methods not dependent on the number of studies are preferable. (C) 2019 Elsevier Inc. All rights reserved.