Statistical controversies in clinical research

Overlap and errors in the meta-analyses of microRNA genetic association studies in cancers

J. H. Park, M. Eisenhut, H. J. van der Vliet, Jaeil Shin

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Background: Various errors in the design, conduct, and analysis of medical and public health research studies can produce false results and waste valuable resources. While systematic reviews and meta-analyses are arguably considered the most dependable source of evidence-based medicine, increasing numbers of studies are indicating that, on the contrary to the public's belief, many of these investigations are redundant, erroneous, and even biased. Methods: Ninety-four meta-analyses on microRNA polymorphism and risk of cancer were extracted from Pubmed database on August 2016. Two investigators independently extracted data (i.e. number of studies, ethnicity, number of cases/controls, bias, etc.) from each meta-analysis. PROSPERO registration status and reference status were also recorded. Results: Among the 217 microRNA gene-variant cancer associations reported by 94 published meta-analyses, 37% had overlapping results and were extracted from the exact identical case-control studies. However, not one meta-analysis was registered into PROSPERO. Thirty-one percent of the overlapping associations referenced a previous meta-analysis investigating the same association; although only 36% of these overlapping associations referenced earlier meta-analysis that had the same overlapping results. Seventy-four percent of these references were limited to mere citations. Twenty-six percent of the overlapping associations from 16 meta-analyses showed discordant results, and of these, 87% of the genotype comparisons were found significant, contrary to the initial reports of being non-significant. However, no association was noteworthy in regards to false positive rate probability calculations at a given prior probability of 0.001 and 0.000001 and statistical power to detect an odds ratio (OR) of 1.1 and 1.5. Conclusions: Genetic association meta-analyses were by far more redundant, erroneous, and lacking references than initially expected. Careful search of similar studies, attention to small details, and inclination to reference previous works are needed. This paper proposes potential solutions for these problems in hopes of standardizing research efforts and in improving the quality of medical research.

Original languageEnglish
Article numbermdx024
Pages (from-to)1169-1182
Number of pages14
JournalAnnals of Oncology
Volume28
Issue number6
DOIs
Publication statusPublished - 2017 Jun 1

Fingerprint

Genetic Association Studies
MicroRNAs
Meta-Analysis
Research
Neoplasms
Evidence-Based Medicine
Neoplasm Genes
PubMed
Case-Control Studies
Biomedical Research
Public Health
Odds Ratio
Genotype
Research Personnel
Databases

All Science Journal Classification (ASJC) codes

  • Hematology
  • Oncology

Cite this

@article{eead194270ce4acbb7327bfe04027e9a,
title = "Statistical controversies in clinical research: Overlap and errors in the meta-analyses of microRNA genetic association studies in cancers",
abstract = "Background: Various errors in the design, conduct, and analysis of medical and public health research studies can produce false results and waste valuable resources. While systematic reviews and meta-analyses are arguably considered the most dependable source of evidence-based medicine, increasing numbers of studies are indicating that, on the contrary to the public's belief, many of these investigations are redundant, erroneous, and even biased. Methods: Ninety-four meta-analyses on microRNA polymorphism and risk of cancer were extracted from Pubmed database on August 2016. Two investigators independently extracted data (i.e. number of studies, ethnicity, number of cases/controls, bias, etc.) from each meta-analysis. PROSPERO registration status and reference status were also recorded. Results: Among the 217 microRNA gene-variant cancer associations reported by 94 published meta-analyses, 37{\%} had overlapping results and were extracted from the exact identical case-control studies. However, not one meta-analysis was registered into PROSPERO. Thirty-one percent of the overlapping associations referenced a previous meta-analysis investigating the same association; although only 36{\%} of these overlapping associations referenced earlier meta-analysis that had the same overlapping results. Seventy-four percent of these references were limited to mere citations. Twenty-six percent of the overlapping associations from 16 meta-analyses showed discordant results, and of these, 87{\%} of the genotype comparisons were found significant, contrary to the initial reports of being non-significant. However, no association was noteworthy in regards to false positive rate probability calculations at a given prior probability of 0.001 and 0.000001 and statistical power to detect an odds ratio (OR) of 1.1 and 1.5. Conclusions: Genetic association meta-analyses were by far more redundant, erroneous, and lacking references than initially expected. Careful search of similar studies, attention to small details, and inclination to reference previous works are needed. This paper proposes potential solutions for these problems in hopes of standardizing research efforts and in improving the quality of medical research.",
author = "Park, {J. H.} and M. Eisenhut and {van der Vliet}, {H. J.} and Jaeil Shin",
year = "2017",
month = "6",
day = "1",
doi = "10.1093/annonc/mdx024",
language = "English",
volume = "28",
pages = "1169--1182",
journal = "Annals of Oncology",
issn = "0923-7534",
publisher = "Oxford University Press",
number = "6",

}

Statistical controversies in clinical research : Overlap and errors in the meta-analyses of microRNA genetic association studies in cancers. / Park, J. H.; Eisenhut, M.; van der Vliet, H. J.; Shin, Jaeil.

In: Annals of Oncology, Vol. 28, No. 6, mdx024, 01.06.2017, p. 1169-1182.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Statistical controversies in clinical research

T2 - Overlap and errors in the meta-analyses of microRNA genetic association studies in cancers

AU - Park, J. H.

AU - Eisenhut, M.

AU - van der Vliet, H. J.

AU - Shin, Jaeil

PY - 2017/6/1

Y1 - 2017/6/1

N2 - Background: Various errors in the design, conduct, and analysis of medical and public health research studies can produce false results and waste valuable resources. While systematic reviews and meta-analyses are arguably considered the most dependable source of evidence-based medicine, increasing numbers of studies are indicating that, on the contrary to the public's belief, many of these investigations are redundant, erroneous, and even biased. Methods: Ninety-four meta-analyses on microRNA polymorphism and risk of cancer were extracted from Pubmed database on August 2016. Two investigators independently extracted data (i.e. number of studies, ethnicity, number of cases/controls, bias, etc.) from each meta-analysis. PROSPERO registration status and reference status were also recorded. Results: Among the 217 microRNA gene-variant cancer associations reported by 94 published meta-analyses, 37% had overlapping results and were extracted from the exact identical case-control studies. However, not one meta-analysis was registered into PROSPERO. Thirty-one percent of the overlapping associations referenced a previous meta-analysis investigating the same association; although only 36% of these overlapping associations referenced earlier meta-analysis that had the same overlapping results. Seventy-four percent of these references were limited to mere citations. Twenty-six percent of the overlapping associations from 16 meta-analyses showed discordant results, and of these, 87% of the genotype comparisons were found significant, contrary to the initial reports of being non-significant. However, no association was noteworthy in regards to false positive rate probability calculations at a given prior probability of 0.001 and 0.000001 and statistical power to detect an odds ratio (OR) of 1.1 and 1.5. Conclusions: Genetic association meta-analyses were by far more redundant, erroneous, and lacking references than initially expected. Careful search of similar studies, attention to small details, and inclination to reference previous works are needed. This paper proposes potential solutions for these problems in hopes of standardizing research efforts and in improving the quality of medical research.

AB - Background: Various errors in the design, conduct, and analysis of medical and public health research studies can produce false results and waste valuable resources. While systematic reviews and meta-analyses are arguably considered the most dependable source of evidence-based medicine, increasing numbers of studies are indicating that, on the contrary to the public's belief, many of these investigations are redundant, erroneous, and even biased. Methods: Ninety-four meta-analyses on microRNA polymorphism and risk of cancer were extracted from Pubmed database on August 2016. Two investigators independently extracted data (i.e. number of studies, ethnicity, number of cases/controls, bias, etc.) from each meta-analysis. PROSPERO registration status and reference status were also recorded. Results: Among the 217 microRNA gene-variant cancer associations reported by 94 published meta-analyses, 37% had overlapping results and were extracted from the exact identical case-control studies. However, not one meta-analysis was registered into PROSPERO. Thirty-one percent of the overlapping associations referenced a previous meta-analysis investigating the same association; although only 36% of these overlapping associations referenced earlier meta-analysis that had the same overlapping results. Seventy-four percent of these references were limited to mere citations. Twenty-six percent of the overlapping associations from 16 meta-analyses showed discordant results, and of these, 87% of the genotype comparisons were found significant, contrary to the initial reports of being non-significant. However, no association was noteworthy in regards to false positive rate probability calculations at a given prior probability of 0.001 and 0.000001 and statistical power to detect an odds ratio (OR) of 1.1 and 1.5. Conclusions: Genetic association meta-analyses were by far more redundant, erroneous, and lacking references than initially expected. Careful search of similar studies, attention to small details, and inclination to reference previous works are needed. This paper proposes potential solutions for these problems in hopes of standardizing research efforts and in improving the quality of medical research.

UR - http://www.scopus.com/inward/record.url?scp=85021125248&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85021125248&partnerID=8YFLogxK

U2 - 10.1093/annonc/mdx024

DO - 10.1093/annonc/mdx024

M3 - Article

VL - 28

SP - 1169

EP - 1182

JO - Annals of Oncology

JF - Annals of Oncology

SN - 0923-7534

IS - 6

M1 - mdx024

ER -