Artificial intelligence in clinical decision support and outcome prediction – applications in stroke
Corresponding Author
Melissa Yeo
School of Medicine, University of Melbourne, Melbourne, Victoria, Australia
Correspondence
Dr Melissa Yeo, Ground Floor, Medical Building, Cnr Grattan Street & Royal Parade, University of Melbourne, Vic 3010, Australia.
Email: [email protected]
Search for more papers by this authorHong Kuan Kok
Interventional Radiology Service, Department of Radiology, Northern Health, Melbourne, Victoria, Australia
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Search for more papers by this authorNuman Kutaiba
Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorJulian Maingard
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
Search for more papers by this authorVincent Thijs
Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
Department of Neurology, Austin Health, Melbourne, Victoria, Australia
Search for more papers by this authorBahman Tahayori
Department of Biomedical Engineering, The University of Melbourne, Melbourne, Victoria, Australia
IBM Research Australia, Melbourne, Victoria, Australia
Search for more papers by this authorJeremy Russell
Department of Neurosurgery, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorAshu Jhamb
Department of Radiology, St Vincent’s Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorRonil V. Chandra
Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
Search for more papers by this authorMark Brooks
School of Medicine, University of Melbourne, Melbourne, Victoria, Australia
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
Interventional Neuroradiology Service, Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorChristen D. Barras
South Australian Institute of Health and Medical Research, Adelaide, South Australia, Australia
School of Medicine, The University of Adelaide, Adelaide, South Australia, Australia
Search for more papers by this authorHamed Asadi
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
Department of Radiology, St Vincent’s Hospital, Melbourne, Victoria, Australia
Interventional Neuroradiology Service, Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorCorresponding Author
Melissa Yeo
School of Medicine, University of Melbourne, Melbourne, Victoria, Australia
Correspondence
Dr Melissa Yeo, Ground Floor, Medical Building, Cnr Grattan Street & Royal Parade, University of Melbourne, Vic 3010, Australia.
Email: [email protected]
Search for more papers by this authorHong Kuan Kok
Interventional Radiology Service, Department of Radiology, Northern Health, Melbourne, Victoria, Australia
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Search for more papers by this authorNuman Kutaiba
Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorJulian Maingard
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
Search for more papers by this authorVincent Thijs
Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
Department of Neurology, Austin Health, Melbourne, Victoria, Australia
Search for more papers by this authorBahman Tahayori
Department of Biomedical Engineering, The University of Melbourne, Melbourne, Victoria, Australia
IBM Research Australia, Melbourne, Victoria, Australia
Search for more papers by this authorJeremy Russell
Department of Neurosurgery, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorAshu Jhamb
Department of Radiology, St Vincent’s Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorRonil V. Chandra
Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
Search for more papers by this authorMark Brooks
School of Medicine, University of Melbourne, Melbourne, Victoria, Australia
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
Interventional Neuroradiology Service, Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorChristen D. Barras
South Australian Institute of Health and Medical Research, Adelaide, South Australia, Australia
School of Medicine, The University of Adelaide, Adelaide, South Australia, Australia
Search for more papers by this authorHamed Asadi
School of Medicine, Faculty of Health, Deakin University, Burwood, Victoria, Australia
Interventional Neuroradiology Unit, Monash Health, Clayton, Victoria, Australia
Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia
Stroke Theme, Florey Institute of Neuroscience and Mental Health, Melbourne, Victoria, Australia
Department of Radiology, St Vincent’s Hospital, Melbourne, Victoria, Australia
Interventional Neuroradiology Service, Department of Radiology, Austin Hospital, Melbourne, Victoria, Australia
Search for more papers by this authorSummary
Artificial intelligence (AI) is making a profound impact in healthcare, with the number of AI applications in medicine increasing substantially over the past five years. In acute stroke, it is playing an increasingly important role in clinical decision-making. Contemporary advances have increased the amount of information – both clinical and radiological – which clinicians must consider when managing patients. In the time-critical setting of acute stroke, AI offers the tools to rapidly evaluate and consolidate available information, extracting specific predictions from rich, noisy data. It has been applied to the automatic detection of stroke lesions on imaging and can guide treatment decisions through the prediction of tissue outcomes and long-term functional outcomes. This review examines the current state of AI applications in stroke, exploring their potential to reform stroke care through clinical decision support, as well as the challenges and limitations which must be addressed to facilitate their acceptance and adoption for clinical use.
References
- 1McCarthy J, Minsky M, Rochester N et al. A proposal for the dartmouth summer research project on artificial intelligence, August 31, 1955. AI Mag 2006; 27: 12–4.
- 2McCulloch WS, Pitts W. A logical calculus of the ideas immanent in nervous activity. Bull Mathemat Biophys 1943; 5: 115–33.
10.1007/BF02478259 Google Scholar
- 3Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 1958; 65: 386–408.
- 4Russakovsky O, Deng J, Su H et al. ImageNet Large Scale Visual Recognition Challenge. Int J Comput Vision 2015; 115: 211–52.
- 5Kelly CJ, Karthikesalingam A, Suleyman M et al. Key challenges for delivering clinical impact with artificial intelligence. BMC med 2019; 17: 195.
- 6Handelman GS, Kok HK, Chandra RV et al. eDoctor: machine learning and the future of medicine. J Intern Med 2018; 284: 603–19.
- 7Bzdok D, Altman N, Krzywinski M. Statistics versus machine learning. Nat Methods 2018; 15: 233–4.
- 8Bzdok D, Krzywinski M, Altman N. Points of Significance: Machine learning: a primer. Nat Methods 2017; 14: 1119–20.
- 9Esteva A, Kuprel B, Novoa RA et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017; 542: 115–8.
- 10Kim H-E, Kim HH, Han B-K et al. Changes in cancer detection and false-positive recall in mammography using artificial intelligence: a retrospective, multireader study. The Lancet Digital Health 2020; 2: e138–e148.
- 11Goldstein BA, Navar AM, Carter RE. Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges. Eur Heart J 2017; 38: 1805–14.
- 12Asadi H, Kok HK, Looby S et al. Outcomes and complications after endovascular treatment of brain arteriovenous malformations: a prognostication attempt using artificial intelligence. World Neurosurg 2016; 96: 562–569.
- 13Zhavoronkov A. Artificial intelligence for drug discovery, biomarker development, and generation of novel chemistry. Mol Pharm 2018; 15: 4311–3.
- 14Ramanujam E, Padmavathi S. A vision-based posture monitoring system for the elderly using intelligent fall detection technique. In: Z Mahmood (ed). Guide to Ambient Intelligence in the IoT Environment: Principles, Technologies and Applications. Springer International Publishing, Cham, 2019; 249–69.
10.1007/978-3-030-04173-1_11 Google Scholar
- 15Nagaratnam K, Harston G, Flossmann E et al. Innovative use of artificial intelligence and digital communication in acute stroke pathway in response to COVID-19. Future Healthc J 2020; 7: 169–73.
- 16Feigin VL, Norrving B, Mensah GA. Global burden of stroke. Circ Res 2017; 120: 439–48.
- 17Emberson J, Lees KR, Lyden P et al. Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischaemic stroke: a meta-analysis of individual patient data from randomised trials. The Lancet 2014; 384: 1929–35.
- 18Warach SJ, Luby M, Albers GW et al. Acute stroke imaging research roadmap III imaging selection and outcomes in acute stroke reperfusion clinical trials: consensus recommendations and further research priorities. Stroke 2016; 47: 1389–98.
- 19Mitchell TM. Machine Learning: McGraw-Hill 1997.
- 20LeCun Y, Bengio Y, Hinton G. Deep learning. Nature 2015; 521: 436–44.
- 21Handelman GS, Kok HK, Chandra RV et al. Peering Into the Black Box of Artificial Intelligence: Evaluation Metrics of Machine Learning Methods. AJR Am J Roentgenol 2019; 212: 38–43.
- 22Mullins ME, Schaefer PW, Sorensen AG et al. CT and conventional and diffusion-weighted MR imaging in acute stroke: study in 691 patients at presentation to the emergency department. Radiology 2002; 224: 353–60.
- 23Titano JJ, Badgeley M, Schefflein J et al. Automated deep-neural-network surveillance of cranial images for acute neurologic events. Nat Med 2018; 24: 1337–41.
- 24McDonald RJ, Schwartz KM, Eckel LJ et al. The effects of changes in utilization and technological advancements of cross-sectional imaging on radiologist workload. Acad Radiol 2015; 22: 1191–8.
- 25Arbabshirani MR, Fornwalt BK, Mongelluzzo GJ et al. Advanced machine learning in action: identification of intracranial hemorrhage on computed tomography scans of the head with clinical workflow integration. NPJ Digit Med 2018; 1: 9.
- 26Tomsick T, Brott T, Barsan W et al. Prognostic value of the hyperdense middle cerebral artery sign and stroke scale score before ultraearly thrombolytic therapy. AJNR Am J Neuroradiol 1996; 17: 79–85.
- 27Takahashi N, Lee Y, Tsai D-Y et al. An automated detection method for the MCA dot sign of acute stroke in unenhanced CT. Radiol Phys Technol 2014; 7: 79–88.
- 28Lisowska A, Beveridge E, Muir K et al. Thrombus detection in CT brain scans using a convolutional neural network. Proceedings of the 10th International Joint Conference on Biomedical Engineering Systems and Technologies, 2017: 24–33.
- 29Mair G, Boyd EV, Chappell FM et al. Sensitivity and specificity of the hyperdense artery sign for arterial obstruction in acute ischemic stroke. Stroke 2015; 46: 102–7.
- 30Hand PJ, Kwan J, Lindley RI et al. Distinguishing between stroke and mimic at the bedside: the brain attack study. Stroke 2006; 37: 769–75.
- 31Goyal N, Male S, Al Wafai A et al. Cost burden of stroke mimics and transient ischemic attack after intravenous tissue plasminogen activator treatment. J Stroke Cerebrovasc Dis 2015; 24: 828–33.
- 32Tu TM, Tan GZ, Saffari SE et al. External validation of stroke mimic prediction scales in the emergency department. BMC Neurol 2020; 20: 269.
- 33Abedi V, Goyal N, Tsivgoulis G et al. Novel Screening Tool for Stroke Using Artificial Neural Network. Stroke 2017; 48: 1678–81.
- 34Rowley H., Vagal A. Stroke and stroke mimics: diagnosis and treatment. In: J. Hodler, R. A. Kubik-Huch, G. K. von Schulthess (eds). Diseases of the Brain, Head and Neck, Spine 2020–2023. Springer International Publishing, Cham, 2020; 25–36.
10.1007/978-3-030-38490-6_3 Google Scholar
- 35Barber PA, Demchuk AM, Zhang J et al. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group. Alberta Stroke Programme Early CT Score. Lancet 2000; 355: 1670–4.
- 36Yoo AJ, Zaidat OO, Chaudhry ZA et al. Impact of pretreatment noncontrast CT Alberta Stroke Program Early CT Score on clinical outcome after intra-arterial stroke therapy. Stroke 2014; 45: 746–51.
- 37Goyal M, Demchuk AM, Menon BK et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 2015; 372: 1019–30.
- 38Powers WJ, Rabinstein AA, Ackerson T et al. 2018 guidelines for the early management of patients with acute ischemic stroke: a guideline for healthcare professionals from the american heart association/american stroke association. Stroke 2018; 49: e46–e110.
- 39Finlayson O, John V, Yeung R et al. Interobserver agreement of ASPECT score distribution for noncontrast CT, CT angiography, and CT perfusion in acute stroke. Stroke 2013; 44: 234–6.
- 40Mak HK, Yau KK, Khong PL et al. Hypodensity of >1/3 middle cerebral artery territory versus Alberta Stroke Programme Early CT Score (ASPECTS): comparison of two methods of quantitative evaluation of early CT changes in hyperacute ischemic stroke in the community setting. Stroke 2003; 34: 1194–6.
- 41Herweh C, Ringleb PA, Rauch G et al. Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 2016; 11: 438–45.
- 42Sundaram VK, Goldstein J, Wheelwright D et al. Automated ASPECTS in acute ischemic stroke: a comparative analysis with CT perfusion. AJNR Am J Neuroradiol 2019; 40: 2033–8.
- 43Nagel S, Sinha D, Day D et al. e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 2017; 12: 615–22.
- 44Goebel J, Stenzel E, Guberina N et al. Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software. Neuroradiology 2018; 60: 1267–72.
- 45Austein F, Wodarg F, Jürgensen N et al. Automated versus manual imaging assessment of early ischemic changes in acute stroke: comparison of two software packages and expert consensus. Eur Radiol 2019; 29: 6285–92.
- 46Hoelter P, Muehlen I, Goelitz P et al. Automated ASPECT scoring in acute ischemic stroke: comparison of three software tools. Neuroradiology 2020; 62: 1231–8.
- 47Maegerlein C, Fischer J, Mönch S et al. Automated Calculation of the Alberta Stroke Program Early CT Score: Feasibility and Reliability. Radiology 2019; 291: 141–8.
- 48Kuang H, Najm M, Chakraborty D et al. Automated ASPECTS on Noncontrast CT Scans in Patients with Acute Ischemic Stroke Using Machine Learning. AJNR Am J Neuroradiol 2019; 40: 33–8.
- 49Seker F, Pfaff J, Nagel S et al. CT Reconstruction Levels Affect Automated and Reader-Based ASPECTS Ratings in Acute Ischemic Stroke. J Neuroimaging 2019; 29: 62–4.
- 50Schröder J, Thomalla G. A critical review of Alberta stroke program early CT score for evaluation of acute stroke imaging. Frontiers in neurology 2017; 7: 245–45.
- 51Sweid A, Hammoud B, Ramesh S et al. Acute ischaemic stroke interventions: large vessel occlusion and beyond. Stroke Vasc Neurol 2020; 5: 80–5.
- 52Rai AT, Seldon AE, Boo SoHyun et al. A population-based incidence of acute large vessel occlusions and thrombectomy eligible patients indicates significant potential for growth of endovascular stroke therapy in the USA. J Neurointerv Surg 2017; 9: 722–6.
- 53Smith EE, Kent DM, Bulsara KR et al. Accuracy of prediction instruments for diagnosing large vessel occlusion in individuals with suspected stroke: a systematic review for the 2018 guidelines for the early management of patients with acute ischemic stroke. Stroke 2018; 49: e111–e122.
- 54You J, Tsang ACO, Yu PLH et al. Automated hierarchy evaluation system of large vessel occlusion in acute ischemia stroke. Front Neuroinform 2020; 14: 13.
- 55Murray NM, Unberath M, Hager GD et al. Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic review. J Neurointerv Surg 2020; 12: 156–64.
- 56Bluemke DA. Radiology in 2018: are you working with ai or being replaced by AI? Radiology 2018; 287: 365–6.
- 57Qiu WU, Kuang H, Teleg E et al. Machine Learning for Detecting Early Infarction in Acute Stroke with Non-Contrast-enhanced CT. Radiology 2020; 294: 638–44.
- 58Austein F, Riedel C, Kerby T et al. Comparison of perfusion CT software to predict the final infarct volume after thrombectomy. Stroke 2016; 47: 2311–7.
- 59Koopman MS, Berkhemer OA, Geuskens RREG et al. Comparison of three commonly used CT perfusion software packages in patients with acute ischemic stroke. J Neurointerv Surg 2019; 11: 1249.
- 60An H, Ford AL, Vo K et al. Signal evolution and infarction risk for apparent diffusion coefficient lesions in acute ischemic stroke are both time- and perfusion-dependent. Stroke 2011; 42: 1276–81.
- 61Rekik I, Allassonnière S, Carpenter TK et al. Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: Segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal. Neuroimage Clin 2012; 1: 164–78.
- 62McKinley R, Häni L, Gralla J et al. Fully automated stroke tissue estimation using random forest classifiers (FASTER). J Cereb Blood Flow Metab 2017; 37: 2728–41.
- 63Livne M, Boldsen JK, Mikkelsen IK et al. Boosted tree model reforms multimodal magnetic resonance imaging infarct prediction in acute stroke. Stroke 2018; 49: 912–8.
- 64Kim Y-C, Kim HJ, Chung J-W et al. Novel estimation of penumbra zone based on infarct growth using machine learning techniques in acute ischemic stroke. J Clin Med 2020; 9: 1977.
- 65Grosser M, Gellißen S, Borchert P et al. Improved multi-parametric prediction of tissue outcome in acute ischemic stroke patients using spatial features. PLoS ONE 2020; 15: e0228113.
- 66Kuang H, Menon BK, Qiu W. Semi-automated infarct segmentation from follow-up noncontrast CT scans in patients with acute ischemic stroke. Med Phys 2019; 46: 4037–45.
- 67Kim Y-C, Lee J-E, Yu I et al. Evaluation of diffusion lesion volume measurements in acute ischemic stroke using encoder-decoder convolutional network. Stroke 2019; 50: 1444–51.
- 68Strbian D, Engelter S, Michel P et al. Symptomatic intracranial hemorrhage after stroke thrombolysis: the SEDAN score. Ann Neurol 2012; 71: 634–41.
- 69Lou M, Safdar A, Mehdiratta M et al. The HAT Score: a simple grading scale for predicting hemorrhage after thrombolysis. Neurology 2008; 71: 1417–23.
- 70Asuzu D, Nystrom K, Amin H et al. Comparison of 8 scores for predicting symptomatic intracerebral hemorrhage after IV thrombolysis. Neurocrit Care 2015; 22: 229–33.
- 71Bentley P, Ganesalingam J, Carlton Jones AL et al. Prediction of stroke thrombolysis outcome using CT brain machine learning. Neuroimage Clin 2014; 4: 635–40.
- 72Wang F, Huang Y, Xia Y et al. Personalized risk prediction of symptomatic intracerebral hemorrhage after stroke thrombolysis using a machine-learning model. Therap Adv Neurol Dis 2020; 13: 1–10.
- 73De Haan R, Horn J, Limburg M et al. A comparison of five stroke scales with measures of disability, handicap, and quality of life. Stroke 1993; 24: 1178–81.
- 74Asadi H, Dowling R, Yan B et al. Machine learning for outcome prediction of acute ischemic stroke post intra-arterial therapy. PLoS ONE 2014; 9: e88225.
- 75van Os HJA, Ramos LA, Hilbert A et al. Predicting outcome of endovascular treatment for acute ischemic stroke: potential value of machine learning algorithms. Front Neurol 2018; 9: 784.
- 76Bacchi S, Zerner T, Oakden-Rayner L et al. Deep learning in the prediction of ischaemic stroke thrombolysis functional outcomes. Acad Radiol 2020; 27: e19–e23.
- 77Xie Y, Jiang B, Gong E et al. JOURNAL CLUB: use of gradient boosting machine learning to predict patient outcome in acute ischemic stroke on the basis of imaging, demographic, and clinical information. Am J Roentgenol 2019; 212: 44–51.
- 78Hilbert A, Ramos LA, van Os H et al. Data-efficient deep learning of radiological image data for outcome prediction after endovascular treatment of patients with acute ischemic stroke. Comput Biol Med 2019; 115: 103516.
- 79Jang S-K, Chang JY, Lee JS et al. Reliability and clinical utility of machine learning to predict stroke prognosis: comparison with logistic regression. J Stroke 2020; 22: 403–6.
- 80Chan KL, Leng X, Zhang W et al. Early identification of high-risk TIA or minor stroke using artificial neural network. Front Neurol 2019; 10: 171.
- 81Heo JoonNyung, Yoon JG, Park H et al. Machine learning-based model for prediction of outcomes in acute stroke. Stroke 2019; 50: 1263–5.
- 82Nichols TE, Das S, Eickhoff SB et al. Best practices in data analysis and sharing in neuroimaging using MRI. Nat Neurosci 2017; 20: 299–303.
- 83Poldrack RA, Gorgolewski KJ. Making big data open: data sharing in neuroimaging. Nat Neurosci 2014; 17: 1510–7.
- 84Maier O, Menze BH, von der Gablentz J et al. ISLES 2015 - A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI. Med Image Anal 2017; 35: 250–69.
- 85Liew S-L, Anglin JM, Banks NW et al. A large, open source dataset of stroke anatomical brain images and manual lesion segmentations. Sci Data 2018; 5: 180011.
- 86Sandercock PA, Niewada M, Czlonkowska A et al. The International Stroke Trial database. Trials 2011; 12: 101.
- 87Cereda CW, Christensen S, Campbell BCV et al. A benchmarking tool to evaluate computer tomography perfusion infarct core predictions against a DWI standard. J Cereb Blood Flow Metab 2016; 36: 1780–9.
- 88Winzeck S, Hakim A, McKinley R et al. ISLES 2016 and 2017-benchmarking ischemic stroke lesion outcome prediction based on multispectral MRI. Front Neurol 2018; 9: 679.
- 89 ISLES 2018. SICAS Medical Image Repository [Internet]. Sicas Medical Image Repository; Available from: https://www.smir.ch/ISLES/Start2018. Accessed 15 Dec 2020.
- 90Wang W, Kiik M, Peek N et al. A systematic review of machine learning models for predicting outcomes of stroke with structured data. PLoS ONE 2020; 15: e0234722.
- 91Christodoulou E, Ma J, Collins GS et al. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol 2019; 110: 12–22.
- 92Subudhi A, Dash M, Sabut S. Automated segmentation and classification of brain stroke using expectation-maximization and random forest classifier. Biocybernetics Biomed Eng 2020; 40: 277–89.
- 93Kral J, Cabal M, Kasickova L et al. Machine learning volumetry of ischemic brain lesions on CT after thrombectomy-prospective diagnostic accuracy study in ischemic stroke patients. Neuroradiology 2020; 62: 1239–45.
- 94Dolz J, Ben Ayed I, Desrosiers C. Dense multi-path u-net for ischemic stroke lesion segmentation in multiple image modalities. Brainlesion 2019; 271–82.
- 95Mikhail P, Le MGD, Mair G. Computational Image Analysis of Nonenhanced Computed Tomography for Acute Ischaemic Stroke: A Systematic Review. J Stroke Cerebrovasc Dis 2020; 29: 104715.
- 96Collins GS, Moons KGM. Reporting of artificial intelligence prediction models. Lancet 2019; 393: 1577–9.
- 97Rivera SC, Liu X, Chan A-W et al. Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI Extension. BMJ 2020; 370: m3210.
- 98Liu X, Cruz Rivera S, Moher D et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat Med 2020; 26: 1364–74.
- 99Lee H, Yune S, Mansouri M et al. An explainable deep-learning algorithm for the detection of acute intracranial haemorrhage from small datasets. Nat Biomed Eng 2019; 3: 173–82.
- 100Pereira S, Meier R, McKinley R et al. Enhancing interpretability of automatically extracted machine learning features: application to a RBM-Random Forest system on brain lesion segmentation. Med Image Anal 2018; 44: 228–44.
- 101 FDA. Proposed Regulatory Framework for Modifications to Artificial Intelligence/Machine Learning (AI/ ML)-Based Software as a Medical Device (SaMD): Discussion Paper and Request for Feedback. 2019. (accessed 24 Sep 2020) https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-software-medical-device
- 102Liew C. The future of radiology augmented with Artificial Intelligence: A strategy for success. Eur J Radiol 2018; 102: 152–6.