DOI: 10.4244/EIJV14I7A126

Absence of proof or proof of absence? The risk of underpowered studies in cardiovascular medicine

Mario Gaudino1*, MD; Umberto Benedetto2, PhD; David P. Taggart3, PhD

In this issue of EuroIntervention Kjøller-Hansen and colleagues report the results of a post hoc analysis of the SORT OUT II trial comparing the 10-year rate of a composite outcome of death, myocardial infarction and repeat revascularisation between patients receiving a single drug-eluting stent in the proximal left anterior descending (LAD) vs. non-proximal LAD1. The authors report no difference between the two groups (HR 0.82, 95% CI: 0.65-1.03).

The analysis has some limitations. The definition used by the authors is somewhat arbitrary and difficult to understand: why not compare LAD vs. non-LAD lesions? Why group the distal LAD with the circumflex or right coronary artery? Lesions of the proximal LAD are traditionally considered to have significantly higher prognostic significance than any other coronary lesions2, so the biologic rationale for the comparison is also questionable.

Most importantly however, with only 365 patients and 90 events in the proximal LAD group, the study is largely underpowered to detect even moderate differences between groups.

It is interesting to note how the authors quote in the text two surgical series comparing percutaneous intervention with minimally invasive surgical revascularisation for treatment of proximal LAD disease3,4 that, with 189 and 130 patients respectively, share both the sample size limitations and the negative conclusions of their paper.

Power is a crucial factor of every analysis. Studies with a small sample size have a high risk of type I and type II errors (Figure 1). When negative (as in this case), underpowered studies have substantial chances of missing true treatment effects. When positive, they are very likely to provide wrong estimates of the treatment effect. The limitations of underpowered studies and the risk associated with their interpretation in different fields of medical research have been described repeatedly5.

Figure 1. Correlation between sample size and p-value for a 20% assumed relative risk reduction between proximal LAD and non-proximal LAD groups.

It is worth noting that recently two very important clinical questions in the cardiovascular field have been answered using a meta-analytic approach. Head et al, combining the patient-level data of 11 randomised trials comparing coronary surgery with percutaneous interventions in the treatment of patients with multivessel disease, were able to show for the first time a significant difference in mortality in favour of the surgical arm6. Our group, by combining individual data from six trials comparing the use of the radial artery with the saphenous vein as the second conduit in coronary surgery provided the first demonstration of a clinical benefit associated with the arterial conduit based on randomised data7.

Unfortunately, the merging of individual data sets requires a substantial amount of resources, time and persistence. Despite the recommendations of scientific and professional societies and scientific journals, sharing of data is still a complex and often painful process. However, the uncertainty and risk inherent in small studies should not be underestimated, and every effort should be made to provide the scientific community and our patients with data from adequately powered studies.

Conflict of interest statement

The authors have no conflicts of interest to declare.


References

Volume 14 Number 7
Sep 20, 2018
Volume 14 Number 7
View full issue


Key metrics

Suggested by Cory

10.4244/EIJV15I11A176 Dec 6, 2019
Are all DES equal at 10-year follow-up?
Bär S et al
free
Trending articles
152.9

Clinical research

10.4244/EIJ-D-20-01125 Oct 20, 2021
An upfront combined strategy for endovascular haemostasis in transfemoral transcatheter aortic valve implantation
Costa G et al
free
47.8

NEW INNOVATION

10.4244/EIJ-D-15-00467 Feb 20, 2018
Design and principle of operation of the HeartMate PHP (percutaneous heart pump)
Van Mieghem NM et al
free
39.1

Clinical research

10.4244/EIJ-D-22-00558 Feb 6, 2023
Permanent pacemaker implantation and left bundle branch block with self-expanding valves – a SCOPE 2 subanalysis
Pellegrini C et al
free
38.95

State-of-the-Art

10.4244/EIJ-D-23-00912 Oct 7, 2024
Optical coherence tomography to guide percutaneous coronary intervention
Almajid F et al
free
X

The Official Journal of EuroPCR and the European Association of Percutaneous Cardiovascular Interventions (EAPCI)

EuroPCR EAPCI
PCR ESC
Impact factor: 7.6
2023 Journal Citation Reports®
Science Edition (Clarivate Analytics, 2024)
Online ISSN 1969-6213 - Print ISSN 1774-024X
© 2005-2024 Europa Group - All rights reserved