DOI: 10.4244/EIJV6I2A29

Duplicate meta-analyses on coronary bifurcation strategies: when more is less?

The Editors solicited the opinion of a respected expert on meta-analyses to share his thoughts
on this subject.

What should clinical research be? Should it be an exclusive endeavour of the enlightened elites? Or should it be the mass product of countless independent individuals? Actually, it depends on the quality of the specific research product and on its practical use. The same applies to systematic reviews and meta-analyses. I wish only a few skilled institutions could control all current and future meta-analyses in interventional cardiology. I also wish I could be co-author of many of them! But the truth is: reality is different, and we must adapt.

Heras et al highlight in this issue the uncanny occurrence of four different systematic reviews published within a very short time from four independent groups on the same topic, namely coronary bifurcation strategies1-5. This phenomenon, which we have described in the past in detail and also commented twice in this very journal6-8, raises a number of important issues, which are relevant for researchers, clinicians, and patients alike.

First, why did this happen? As previously clarified, clinical research is a collective endeavour based on competition and gratification of the first ever to describe a novelty. Systematic reviews share with other types of research these features. Thus, multiple investigators may simultaneously conduct similar experiments/reviews and submit for publication almost at the same time. This occurrence is not uncommon, has been described elsewhere in detail,6 and its incidence is rising given the increase in the number of medical journals worldwide and the reduction in time from submission to publication of scientific manuscripts.

Second, what are be consequences of this phenomenon? Heras et al share with us their “worrying considerations… in that there has been a waste of reviewers’ and readers’ time and published pages”. Whereas duplicate meta-analyses may confound the busy reader by providing conflicting results, they also offer the very same reader the opportunity to understand in greater detail how the reviewing process works, and which meta-analyses are to be trusted and why. In addition, systematic reviews, even when duplicate, do an excellent job for journals. In 2006 we described 10 meta-analyses published in less than two years on the same topic (namely acetylcysteine for the prevention of contrast associated nephropathy)6. More than five years later, all of the 10 systematic reviews significantly outperformed the corresponding journal average citations (p<0.01 at both parametric and non-parametric tests), demonstrating that publishing a systematic review yields well for a journal, even if there are several similar ones already published (Table 1; Figure 1).

Figure 1. Association between normalised citations in Institute for Scientific Information Web of Science and impact factor of the corresponding journals for 10 duplicate systematic reviews and meta-analyses published between 2003 and 2005 on acetylcysteine for the prevention of contrast associated nephropathy. Systematic reviews consistently and significantly outperformed the journal impact factor in terms of citations.

Third, what can we do about it? We could ban all systematic reviews and meta-analyses from medical journals, as was wily suggested by some opinion leaders. Or, we could desist from taking any action against this phenomenon. Our recommendation is to create an international web registry to enable prospective registration of systematic reviews, in as much as the Cochrane Collaboration does for its own reviews and clinicaltrials.gov does for clinical trials.9 Journal editors could require the registration number of meta-analyses under evaluation, and concomitantly check on such registry for duplicates, before committing to publication. However, there is no such registry yet, and we might still have to wait a number of years before any suitable one is developed.

Winston Churchill once stated “Democracy is the worst form of government except all the others that have been tried”. Unfortunately, peer review and the current approach to publishing systematic reviews is also the worst form possible, except all the others that have been tried.


References

Volume 6 Number 2
Jun 30, 2010
Volume 6 Number 2
View full issue


Key metrics

On the same subject

Editorial

10.4244/EIJ-E-23-00052 Mar 18, 2024
Comparative preclinical assessment of drug-coated balloons: a blessing and a curse for clinical translation
Joner M and Wild L
free

Debate

10.4244/EIJ-E-24-00005 Mar 18, 2024
Ischaemic and viability testing for guiding PCI are overrated: pros and cons
McEntegart M et al
free

Original Research

10.4244/EIJ-D-23-00783 Mar 18, 2024
Redo-TAVI with the ACURATE neo2 and Prime XL for balloon-expandable transcatheter heart valve failure
Meier D et al
Trending articles
281.53

State-of-the-Art Review

10.4244/EIJ-D-21-00695 Nov 19, 2021
Transcatheter treatment for tricuspid valve disease
Praz F et al
free
243.2

State of the art

10.4244/EIJ-D-21-01117 Sep 20, 2022
Recanalisation of coronary chronic total occlusions
Di Mario C et al
free
208.35

State-of-the-Art Review

10.4244/EIJ-D-21-01034 Jun 3, 2022
Management of in-stent restenosis
Alfonso F et al
free
168.7

Translational research

10.4244/EIJ-D-21-00824 May 15, 2022
Bench test and in vivo evaluation of longitudinal stent deformation during proximal optimisation
Toth GG et al
free
167.05

Expert review

10.4244/EIJ-D-21-00690 May 15, 2022
Crush techniques for percutaneous coronary intervention of bifurcation lesions
Moroni F et al
free
151.03

State-of-the-Art

10.4244/EIJ-D-22-00776 Apr 3, 2023
Computed tomographic angiography in coronary artery disease
Serruys PW et al
free
118

Translational research

10.4244/EIJ-D-22-00718 Jun 5, 2023
Preclinical evaluation of the degradation kinetics of third-generation resorbable magnesium scaffolds
Seguchi M et al
110.35

Viewpoint

10.4244/EIJ-E-22-00007 May 15, 2022
TAVI at 20: how a crazy idea led to a clinical revolution
Eltchaninoff H et al
free
X

The Official Journal of EuroPCR and the European Association of Percutaneous Cardiovascular Interventions (EAPCI)

EuroPCR EAPCI
PCR ESC
Impact factor: 6.2
2022 Journal Citation Reports®
Science Edition (Clarivate Analytics, 2023)
Online ISSN 1969-6213 - Print ISSN 1774-024X
© 2005-2024 Europa Group - All rights reserved