DOI: 10.4244/EIJV17I1A2

Automated analysis of coronary angiograms using artificial intelligence: a window into the cath lab of the future

James Howard1, MRCP, PhD; Johan H.C. Reiber1, PhD

Cardiology has entered the information age, and modern medical practice now provides us with increasingly vast quantities of complex data which include electronic health records, blood tests, and imaging.

For over 30 years there have been efforts to automate the analysis of these data, including coronary angiograms. The earliest methods used manually programmed algorithms employing traditional methods such as edge detection1. However, recently there has been an explosion in medical computer vision, with significantly more complex analyses becoming possible.

“Deep learning” is the driving force behind this revolution. It represents a paradigm shift in the way we use computers to solve complex problems. Instead of using a traditional algorithmic approach, where a computer programmer instructs a computer to perform an explicit series of steps to solve a problem, we instead allow the machine to learn how to solve the task for itself. An “artificial neural network”, in some ways similar to the mammalian optic cortex, is modelled inside the computer. We show this neural network many thousands of examples of data, such as angiograms, along with the “correct” answer (such as the presence of a coronary stenosis or not). The computer continuously adjusts the strengths of the neural network’s synapses so that it can better perform its task and, hopefully, with time, a successful “digital brain” evolves. This artificial intelligence (AI) approach is often so successful that it can exceed the performance of the humans who train it2.

It often seems difficult now to read a medical journal and not see AI being mentioned at least once. However, despite AI’s successes, bold claims should be met with healthy scepticism. A recent review lamented how common it is for studies not to present results using externally validated data3. This is particularly important, as the greatest risk with any solution using deep learning is the risk of “overfitting”. Overfitting refers to the phenomenon where a neural network will tend to perform very well when shown an angiogram it has encountered during the training process. In simplistic terms, the neural network may learn to “memorise” certain angiograms, rather than learn generalisable principles which will help its decision making on new data. A failure to assess the network properly on completely separate data inevitably results in disappointing real-world accuracy.

In this issue of EuroIntervention, Du et al report the performance of a novel AI solution that uses a neural network to analyse coronary angiograms4.

This system is able to segment out the coronary tree, make measurements of any stenoses, identify the presence of pathologies including thrombus and dissections, and automate SYNTAX score calculations. Whilst its performance is impressive, it is arguably the quality of its data that is most worthy of praise. Over 20,000 angiograms, across seven different angiographic views, from 10,000 patients were used in the study, with the performance being assessed on a set of 1,000 angiograms from separate patients. Two different functional deep neural networks were trained, one for the recognition of the coronary segments, the other for the lesion morphology. Per patient, a total of 20 coronary segments were annotated. For the lesion morphology, expert cardiologists annotated multiple parameters, including calcification, thrombosis and dissection, aside from the standard lesion parameters. Actually, all the work was carried out by 10 certified cardiologists at Fuwai Hospital over a period of 11 months! The average recognition accuracy of coronary segments was found to be 87.6%, while the F1 scores for the various lesion characteristics were above 0.80. Despite these very interesting results, it must be noted that this remains a single-centre study and, as yet, no system has been able to harness the rich temporal data that can be gleaned from angiographic videos (instead, angiograms are interpreted as still images).

Will we see this system, DeepDiscern, in clinical use? There are significant regulatory hurdles that need to be overcome before such a system could be used by cardiologists in the catheterisation laboratory5; the leap from “bench to bedside” is often frustratingly difficult6. The catheterisation laboratories in 2025 may not have DeepDiscern at cardiologists’ fingertips, but most catheterisation laboratories in 2035 will almost certainly integrate similar AI solutions. Whilst Du et al are tackling the automated analysis of coronary angiograms, others are working on similar systems for aortic waveforms and coronary physiology7,8. Given these exciting advances, it may be that in 20 years we will not be asking about AI’s role in the cath lab, but rather the cardiologist’s.

Conflict of interest statement

The authors have no conflicts of interest to declare.

Supplementary data

To read the full content of this article, please download the PDF.


References

Volume 17 Number 1
May 16, 2021
Volume 17 Number 1
View full issue


Key metrics

Suggested by Cory

Clinical research

10.4244/EIJ-D-20-00570 May 16, 2021
Training and validation of a deep learning architecture for the automatic analysis of coronary angiography
Du T et al
free

State-of-the-Art Review

10.4244/EIJ-D-21-00145 Sep 20, 2021
Robotics, imaging, and artificial intelligence in the catheterisation laboratory
Beyar R et al
free

EXPERT REVIEW

10.4244/EIJ-D-17-00465 Aug 25, 2017
State of the art: coronary angiography
Collet C et al
free

State-of-the-Art

10.4244/EIJ-D-22-00776 Apr 3, 2023
Computed tomographic angiography in coronary artery disease
Serruys PW et al
free

Insight

10.4244/EIJ-D-19-00543A May 20, 2020
The SYNTAX score on its way out or … towards artificial intelligence: part I
Serruys PW et al
free

Editorial

10.4244/EIJ-E-24-00016 Apr 15, 2024
Can artificial intelligence help Heart Teams make decisions?
Koch V
free
Trending articles
151.43

State-of-the-Art

10.4244/EIJ-D-22-00776 Apr 3, 2023
Computed tomographic angiography in coronary artery disease
Serruys PW et al
free
55.9

Clinical research

10.4244/EIJ-D-22-00621 Feb 20, 2023
Long-term changes in coronary physiology after aortic valve replacement
Sabbah M et al
free
54.9

Expert review

10.4244/EIJ-D-21-01010 Jun 24, 2022
Device-related thrombus following left atrial appendage occlusion
Simard T et al
free
43.75

Clinical Research

10.4244/EIJ-D-21-01091 Aug 5, 2022
Lifetime management of patients with symptomatic severe aortic stenosis: a computed tomography simulation study
Medranda G et al
free
39.95

Clinical research

10.4244/EIJ-D-22-00558 Feb 6, 2023
Permanent pacemaker implantation and left bundle branch block with self-expanding valves – a SCOPE 2 subanalysis
Pellegrini C et al
free
X

The Official Journal of EuroPCR and the European Association of Percutaneous Cardiovascular Interventions (EAPCI)

EuroPCR EAPCI
PCR ESC
Impact factor: 7.6
2023 Journal Citation Reports®
Science Edition (Clarivate Analytics, 2024)
Online ISSN 1969-6213 - Print ISSN 1774-024X
© 2005-2024 Europa Group - All rights reserved