Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Imaging-based indices combining disease severity and time from disease onset to predict COVID-19 mortality: A cohort study

  • Giulia Besutti ,

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing

    giulia.besutti@ausl.re.it

    Affiliation Radiology Department, AUSL—IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Olivera Djuric,

    Roles Conceptualization, Data curation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Epidemiology Unit, AUSL–IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Marta Ottone,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Epidemiology Unit, AUSL–IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Filippo Monelli,

    Roles Data curation, Investigation, Software, Validation, Writing – review & editing

    Affiliations Radiology Department, AUSL—IRCCS di Reggio Emilia, Reggio Emilia, Italy, Clinical and Experimental Medicine University of Modena and Reggio Emilia, Modena, Italy

  • Patrizia Lazzari,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation Department of Radiology, AOU Policlinico di Modena, University of Modena and Reggio Emilia, Modena, Italy

  • Francesco Ascari,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation Department of Radiology, AOU Policlinico di Modena, University of Modena and Reggio Emilia, Modena, Italy

  • Guido Ligabue,

    Roles Conceptualization, Data curation, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Radiology, AOU Policlinico di Modena, University of Modena and Reggio Emilia, Modena, Italy

  • Giovanni Guaraldi,

    Roles Conceptualization, Investigation, Supervision, Writing – review & editing

    Affiliation Department of Infectious Diseases, AOU Policlinico di Modena, University of Modena and Reggio Emilia, Modena, Italy

  • Giuseppe Pezzuto,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation Emergency Department, AOU Policlinico di Modena, Modena, Italy

  • Petra Bechtold,

    Roles Data curation, Investigation, Methodology

    Affiliation Epidemiology and Risk Communication Unit, Department of Public Health, Local Health Unit, Modena, Italy

  • Marco Massari,

    Roles Conceptualization, Data curation, Supervision, Writing – review & editing

    Affiliation Infectious Disease Unit, Arcispedale Santa Maria Nuova, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Ivana Lattuada,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation Emergency Department, AUSL-IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Francesco Luppi,

    Roles Conceptualization, Data curation, Methodology, Writing – review & editing

    Affiliation Emergency Department, AUSL-IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Maria Giulia Galli,

    Roles Conceptualization, Data curation, Investigation, Writing – review & editing

    Affiliation Emergency Department, AUSL-IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • Pierpaolo Pattacini,

    Roles Conceptualization, Investigation, Methodology, Supervision, Writing – review & editing

    Affiliation Radiology Department, AUSL—IRCCS di Reggio Emilia, Reggio Emilia, Italy

  •  [ ... ],
  • Paolo Giorgi Rossi

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation Epidemiology Unit, AUSL–IRCCS di Reggio Emilia, Reggio Emilia, Italy

  • [ view all ]
  • [ view less ]

Abstract

Background

COVID-19 prognostic factors include age, sex, comorbidities, laboratory and imaging findings, and time from symptom onset to seeking care.

Purpose

The study aim was to evaluate indices combining disease severity measures and time from disease onset to predict mortality of COVID-19 patients admitted to the emergency department (ED).

Materials and methods

All consecutive COVID-19 patients who underwent both computed tomography (CT) and chest X-ray (CXR) at ED presentation between 27/02/2020 and 13/03/2020 were included. CT visual score of disease extension and CXR Radiographic Assessment of Lung Edema (RALE) score were collected. The CT- and CXR-based scores, C-reactive protein (CRP), and oxygen saturation levels (sO2) were separately combined with time from symptom onset to ED presentation to obtain severity/time indices. Multivariable regression age- and sex-adjusted models without and with severity/time indices were compared. For CXR-RALE, the models were tested in a validation cohort.

Results

Of the 308 included patients, 55 (17.9%) died. In multivariable logistic age- and sex-adjusted models for death at 30 days, severity/time indices showed good discrimination ability, higher for imaging than for laboratory measures (AUCCT = 0.92, AUCCXR = 0.90, AUCCRP = 0.88, AUCsO2 = 0.88). AUCCXR was lower in the validation cohort (0.79). The models including severity/time indices performed slightly better than models including measures of disease severity not combined with time and those including the Charlson Comorbidity Index, except for CRP-based models.

Conclusion

Time from symptom onset to ED admission is a strong prognostic factor and provides added value to the interpretation of imaging and laboratory findings at ED presentation.

Introduction

After more than two years since the first case of COVID-19 was detected in December 2019 in China, more than 450 million cases and 6 million deaths have been reported globally up to March 2022 [1]. Although the critical care bed occupancy crisis is expected to subside as immunisation accelerates, because COVID-19 detection and related hospital admissions periodically increase, the pandemic continues to be a challenge.

Much effort has been put into identifying the factors associated with the need for critical care and death, starting from a set of information available at emergency department (ED) admission, including clinical, laboratory, and radiological findings [2, 3].

Among the clinical factors, the most used to predict COVID-19 severity and mortality are older age, pre-existing comorbidities, hypoxia, and laboratory tests indicative of increased inflammatory response, COVID-19-related coagulopathy, and end-organ dysfunction [37].

Thoracic imaging with chest radiography (CXR) and computed tomography (CT) is a key tool in the evaluation of the degree of lung involvement. CT is highly sensitive in the diagnosis of COVID-19 pneumonia [8, 9], and CT percentage of lung involvement and the quantitative burden of consolidation are among the most important prognostic factors for short-term prognosis in COVID-19 patients [1016].

Although CXR is less sensitive than CT in diagnosing COVID-19 pneumonia, the prognostic role of CXR, i.e., its utility in predicting outcomes in patients already diagnosed with COVID-19 pneumonia, is only beginning to be explored. In fact, CXR assessment using either the Brixia score or the Radiographic Assessment of Lung Edema (RALE) score appears to be reliable in predicting the various outcomes of COVID-19 in patients admitted to ED [1723].

Patients with a rapid worsening of symptoms and a short time between symptom onset and seeking care are more likely to have the worst outcomes [2426]. However, the combined effect of baseline clinical-laboratory findings and time from symptom onset on COVID-19 patients’ outcomes has never been explored. Similarly, CT or CXR-based scoring systems are mostly based on the combined effects of the extent of pulmonary involvement and respective attenuation patterns (i.e., normal, ground-glass opacities—GGO, and consolidation), but they do not consider the time from symptom onset as an important adjunctive factor in outcome prediction.

The aim of this study was to evaluate the role of indices that combine radiological data at admission and time from disease onset, in predicting mortality of COVID-19 patients admitted to the ED.

Materials and methods

Setting

The province of Reggio Emilia, located in Northern Italy, has a population of 531,751 inhabitants. There are six hospitals in this province, with an emergency department (ED) in the main hospital in the city of Reggio Emilia as well as in four of the five smaller health district hospitals. There is no private ED service. The first case of SARS-COV-2 in the province was diagnosed on 27 February 2020. The cumulative incidence in the first wave of the pandemic reached 0.9% (March–April 2020). During the first pandemic wave in Reggio Emilia, patients presenting to the ED with fever and SpO2>95% were discharged home in case of negative chest X-rays and/or CT or in case of positive chest X-rays and/or CT scan but who were >70 years of age and had no relevant past medical history. Patients >70 years of age and/or with relevant past medical history could be hospitalized even without respiratory failure, while others were admitted to hospital in case of radiological findings of pneumonia combined with respiratory failure. In the case of radiological findings of complicated pneumonia with or without acute respiratory distress syndrome (ARDS), patients started non-invasive ventilation in the ED and were admitted to subintensive/intensive care unit [27].

Study design and selection of participants

This retrospective cohort study included all consecutive patients meeting the following inclusion criteria: patients > 18 years of age; presenting to any one of the provincial EDs between 27 February and 13 March 2020; and with a positive RT-PCR within 10 days from ED admission. Patients who did not undergo both CT scan and CXR at ED presentation were excluded. During the COVID-19 outbreak, the diagnostic protocol for suspected COVID-19 patients presenting to EDs included RT-PCR, blood tests, chest X-rays, and CT in every case of suggestive X-rays or negative X-rays but with highly suggestive clinical features.

Even if the researchers assessed inclusion criteria and conditions at admission retrospectively, all the information registered at the time of ED presentation (e.g., laboratory data or CT disease extension) was not modifiable later, therefore exposures could not be influenced by the occurrence of the outcome.

The main outcome was death occurring in the 30 days following ED visit.

Data of the included patients were partially used in previous studies to assess CT diagnostic accuracy and added prognostic value [8, 16].

Ethical approval

The study was approved by the Ethics Committee Area Vasta Emilia Nord (n.2020/0045199). Given the retrospective nature of the study, the Ethics Committee authorized the use of a patient’s data without his/ her informed consent if all reasonable efforts had been made to contact that patient.

Clinical data

Date of symptom onset, diagnosis, hospitalization, and death were retrieved from the COVID-19 Surveillance Registry, implemented in each Local Health Authority. The surveillance is fed by several sources: the Department of Public Health’s epidemiological investigations, contact tracing, and symptom surveillance for people in self-isolation, laboratory reports, electronic ED and hospital records, and death certificates for hospitalized patients. Data from the COVID-19 Surveillance Registry were linked with the provincial Radiology Information System to search for CT scans performed at the moment of or after the onset of COVID symptoms.

Clinical covariates included patient characteristics (age, sex) and the presence of comorbidities, calculated separately, as well as the Charlson Comorbidity Index (CCI), which provides an overall measure of an individual patient’s complexity [28]. We categorized the Index in four classes: 0 (absence of relevant comorbidities), 1, 2, and ≥ 3 comorbidities. Information on comorbidities was collected from hospital discharge databases of all hospital admissions occurring in the previous 10 years, before the start of the SARS-CoV-2 pandemic in Italy. Diabetes and cancer diagnoses in people residing in the province of Reggio Emilia were ascertained through linkage with the local Diabetes Registry and the Cancer Registry.

C-reactive protein (CRP) and lactate dehydrogenase (LDH) levels and white blood cell, lymphocyte, neutrophil, and platelet counts, as well as arterial blood gas analysis data, all measured at ER presentation, were collected from the provincial Local Health Authority’s Laboratory Information System database. All the tests were carried out in the Reggio Emilia Hospital Clinical Laboratories with routine automated methods.

In order to have a reference for the added value of radiological imaging, we computed the severity/time indices also for two basic laboratory data usually available at ED presentation, i.e., oxygen saturation level (sO2) as a measure of lung damage, and CRP as a measure of the inflammatory process characterizing COVID-19 pneumonia.

Radiological data

CT scans were performed using one of three scanners (128-slice Somatom Definition Edge, Siemens Healthineers; 64-slice Ingenuity, Philips Healthcare; 16-slice GE Brightspeed, GE Healthcare) without contrast media injection. Scanning parameters were tube voltage 120 KV, automatic tube current modulation, collimation width 0.625 or 1.25 mm, acquisition slice thickness 2.5 mm, and interval 1.25 mm. Images were reconstructed with a high-resolution algorithm at slice thickness 1.0/1.25 mm. The extension of pulmonary lesions estimated by using a visual scoring system, resulting in a percentage of total lung parenchyma which had any pathological changes likely due to COVID-19, was extracted from the verbal and structured CT reports [8].

CXRs were retrospectively reviewed by a single radiologist to collect RALE score [29, 30]. Every CXR was divided into quadrants defined vertically by the vertebral column and horizontally by the first branch of the left main bronchus. An extension score from 0 to 4 (0: none, 1: <25%, 2: 25/50%, 3: 50/75%, 4 >75%) and a density score from 1 to 3 (1: Hazy, 2: Moderate, 3: Dense) were assigned to each quadrant. The RALE score was calculated as the sum of the products of the two scores obtained for each quadrant.

To validate the ability of the CXR-based RALE score to predict death, a validation set from a different province (Modena, Northern Italy) was used: all the consecutive cases presenting at the Policlinico di Modena Hospital ED for suspected pneumonia and with confirmed COVID-19 (i.e., positive for SARS-CoV-2 on RT-PCR) between 24 February and 13 April 2020 for whom a CXR was available. For this set of patients, only age, sex, and time from symptom onset were known.

Severity/Time indices

In order to obtain indices that could incorporate information on disease severity at ED admission and time from disease onset, we combined the CT visual score, the CXR RALE score, CRP levels, and sO2 levels separately with the time elapsed from symptom onset and the measurement of these parameters. The easiest way to do this was to divide the severity measure by the time needed to reach that level of severity. This strategy was used for CRP levels and for CT- and CXR-based extension of parenchymal involvement, while sO2 severity/time index was calculated as the difference in sO2 value to 100 (100-sO2) divided by the time from symptom onset to sO2 measurement.

We set a five-day lag time representing the average amount of time during which the disease had progressed before symptom onset, based on the reported time period between SARS-CoV-2 infection and COVID-19 symptom onset [31].

CXR RALE-based severity/time index was also calculated for the Modena validation cohort.

Statistical analyses

Continuous variables are reported as median and interquartile range, and categorical variables as proportions. Poisson regression models were used to estimate incidence rate ratios (IRR) with 95% confidence intervals (95% CI) for death, unadjusted and adjusted for age and sex.

A multivariable regression model adjusted for age and sex was used to compare models without and with severity/time indices. The comparison of model performances was done by Log likelihood, Akaike’s information criteria (AIC), and P value for Z-test for severity/time index. Area under the ROC curve (AUC) was used to estimate predictive value of different severity/time indices. We used Stata 13.0 SE (Stata Corporation, Texas, TX) software package.

Validation was conducted applying the model parameters estimated in the Reggio Emilia cohort for CXR RALE score and respective severity/time index to a cohort of cases collected in the ED of the Policlinico di Modena hospital. AUC is reported to measure the predictivity of the model in a different setting.

Results

Characteristics of study subjects

After excluding RT-PCR negative patients or those who did not have a complete radiological assessment within 10 days from ED presentation, 308 patients were included (Fig 1).

Of these 308 COVID-19 patients, 55 (17.9%) died (Table 1); the patients who died were older, generally male, and had a higher prevalence of comorbidities, including cancer, ischemic cardiopathy, hypertension, heart failure, and arrhythmias, with an accordingly higher CCI. Median values of CRP were higher, while sO2 was lower in this group. CT- and CXR-RALE-based extension of pulmonary involvement was higher in those who died. Time from symptom onset to chest imaging was shorter in patients who died. CT visual score and CXR RALE score were strongly associated with Spearman’s rho of 0.73 (P < .001) (Fig 2).

thumbnail
Fig 2. Example of RALE scores and respective CT.

Examples of Radiographic Assessment of Lung Edema (RALE) on chest X-rays (CXR) which were divided into quadrants (A, B, C) and correlation with coronal reconstruction of chest computed tomography (CT) performed within 24 hours (D, E, F). Patient 1 (male, 37 y/o) was attributed a RALE score of 7 because of the presence of moderate alveolar opacities in 50/75% of the right inferior quadrant and hazy alveolar opacities in < 25% of the left inferior quadrant (A); chest CT demonstrated the presence of GGO in the right lower lobe and a small area of GGO in the left lower lobe (visual score 10%) (D). Patient 2 (male, 53 y/o) had a RALE score of 19 due to dense alveolar opacities in > 75% of the right lower quadrant, moderate alveolar opacities in 50/75% of the left lower quadrant, and hazy alveolar opacities in < 25% of the left upper quadrant (B); chest CT demonstrated the presence of extensive parenchymal consolidation of the left lower lobe and small areas of GGO in the right lung (visual score 30%) (E). Patient 3 (male, 45 y/o) was attributed a RALE score of 36 because of the involvement of > 75% of every quadrant, with dense opacities in the left lower quadrant and moderate opacities in the remaining three quadrants (C); chest CT demonstrated bilateral consolidations (visual score 60%) (F).

https://doi.org/10.1371/journal.pone.0270111.g002

thumbnail
Table 1. Patients’ pre-existing condition, and clinical, laboratory, and CT findings at admission.

https://doi.org/10.1371/journal.pone.0270111.t001

Variables associated with death

Age- and sex-adjusted analyses (Table 2) showed that the variables associated with death were various comorbidities, the strongest associations being for heart failure (IRR 2.68; 95% CI, 1.41–5.10), higher CRP levels (IRR for one mg/dl increase 1.04; 95% CI, 1.01–1.08), lower sO2 levels (IRR for one unit increase 0.97; 95% CI, 0.94–1.00), shorter time from symptom onset to CT or CXR assessment (IRR for one day increase 0.91; 95% CI, 0.83–1.00, and 0.915; 95%CI, 0.84–1.00, respectively), and higher extension of lung involvement assessed both by CT visual score (IRR for one unit increase 1.03; 95% CI, 1.02–1.04) and CXR RALE score (IRR for one unit increase 1.06; 95% CI, 1.03–1.10).

thumbnail
Table 2. Associations of pre-existing conditions and laboratory and radiological findings with death, crude and after adjustment for age and sex.

https://doi.org/10.1371/journal.pone.0270111.t002

Indices combining severity and time

Severity/time indices were associated with death after adjusting for age and sex, with IRRs varying from 1.22 to 1.42 (Table 2). As depicted in ROC curves (Fig 3), in multivariable logistic models for death at 30 days adjusted for age and sex, severity/time indices showed good discrimination ability, which was higher for radiological than for laboratory measures [AUCCT = 0.92 (95%CI 0.89–0.95), AUCCXR = 0.90 (95%CI 0.86–0.94), AUCCRP = 0.88 (95%CI 0.83–0.93), and AUCsO2 = 0.88 (95%CI 0.84–0.92)].

thumbnail
Fig 3. ROC curves.

Receiver operating characteristic (ROC) curves of each measure of disease severity (red line) and respective severity/time index (blue line) in multivariable logistic models for death at 30 days, adjusted for age and sex. Considered measures of disease severity are computed tomography (CT) visual score of disease extension (panel A), chest X-rays (CXR) Radiographic Assessment of Lung Edema (RALE) score (panel B), CRP levels (panel C), and sO2 levels (panel D). Horizontal axis: 1—Specificity from 0 to 1.00; vertical axis: Sensitivity from 0 to 1.00.

https://doi.org/10.1371/journal.pone.0270111.g003

Noticeably, the performance of models including severity/time indices based on the ratio between measures of disease severity and time from symptom onset was slightly better than that of models including the same measures of disease severity not combined with time (Fig 3). For instance, the AUC of the model including CT score only was 0.90 (95% CI 0.87–0.94), increasing to 0.92 (95%CI 0.89–0.95) when substituting CT score with CT-based severity/time index (S1 Table). Moreover, the models including severity/time indices resulted in a minimal information loss when compared to models including the same measures plus time from symptom onset considered separately (S1 Table). Finally, the models including severity/time indices showed a slightly better performance when compared to models including the same measure of disease severity plus the CCI, with the exception of CRP-based models (S1 Table).

Validation cohort

Age- and sex- adjusted models for death at 30 days including CXR-RALE score alone or combined in a severity/time index with a five-day lag were also evaluated in a cohort of 215 consecutive COVID-19 patients who presented to the ED of an adjacent province (Modena). Of these, 48 (22.3%) died (S2 Table). In this cohort, days from symptom onset were similarly associated with death (IRR for one day increase 0.93; 95% CI, .86–1.00), while the association was weaker for RALE score (IRR for one unit increase 1.03; 95% CI, 1.00–1.06) (Table 3). The respective severity/time index in this cohort also showed a higher association (IRR for one unit increase 1.33; 95% CI, 1.01–1.76), and the model including the severity/time index performed slightly better than the model with RALE score (AUCCXR from 0.77 for RALE alone to 0.79 for RALE combined in a severity/time index) (S1 Fig.). However, both these AUC values were noticeably lower than in the Reggio Emilia cohort.

thumbnail
Table 3. Crude and sex- and age-adjusted associations with death in the validation cohort.

https://doi.org/10.1371/journal.pone.0270111.t003

Discussion

We used a cohort of consecutive COVID-19 patients who presented to the ED and underwent imaging assessment of COVID-19 pneumonia to test various composite indices combining measures of disease severity with the time from symptom onset. The use of these indices made it possible to better predict mortality than did the same severity measures without incorporating information about the time to reaching a certain level of disease severity. The severity/time indices based on imaging scoring of pneumonia extension were stronger predictors than those based on laboratory tests. The indices describing lung damage (based on chest imaging and sO2) provided more informative value than the presence of comorbidities, which is generally considered one of the main factors driving COVID-19 mortality, along with age [27].

The uncovering of factors which may help to identify COVID-19 patients who will face more severe outcomes has been one of the main research goals since the beginning of the pandemic, especially for factors potentially available at ED admission. Among these factors, the most widely used are age, comorbidities, clinical and laboratory signs of lung damage, inflammation, and coagulation disorders [37]. The role of chest imaging has been widely evaluated, and even if the majority of available studies focus on CT scan [1016], CXR-based scores have also been shown to be reliable in predicting COVID-19 outcomes [1723]. This is particularly important since CT is not routinely recommended by the main international guidelines unless warranted by features of respiratory worsening, especially in resource-constrained environments, where CXR is more readily available [32].

Apart from pre-existing conditions such as age, sex, and comorbidities, other predictive factors are severity measures, which provide a static picture of the disease at ED presentation. By combining these factors with the time from disease onset (time from symptom onset plus lag time), we tried to incorporate information on the evolution of the disease that led the patient to the moment of ED presentation. In order to use these indices as indicators of the velocity of disease progression, we should start from the assumption that the tested severity measures were within normal ranges at disease onset, which is not necessarily true. This limitation acknowledged, the use of these indices combining severity and time remains the only (although imperfect) way to add information on disease progression velocity before ED admission.

The importance of the velocity of disease progression is highlighted both by the worse outcomes of patients whose symptoms become more severe more quickly and thus present to the ED sooner after symptom onset [2426] and by evidence that, in hospitalized patients with serial assessments, rapidly rising CT disease extension or CRP levels may predict poor outcomes [3335]. Nonetheless, few attempts have been made to assess the velocity of disease progression before ED presentation. Information regarding the time from symptom onset to seeking medical attention was easy to collect both from the ED and in the home-care setting. This information has a strong association with all negative outcomes, such as death, hospitalization, and ED readmission [2426]. Also, lung damage evaluated by imaging showed to be strongly associated with negative outcomes; because it is well known that signs of lung damage on imaging last even after the most severe respiratory symptoms have resolved [36], it is intuitive that placing imaging-based severity in the context of the phase of the disease progression is necessary.

In this study, including indices incorporating severity and time in the prediction model for death resulted in a better performance than the model including the measure of disease severity only. Of note, the models with the severity/time indices also slightly outperformed those including the CCI, underlining the important role of the velocity of disease progression, which is at least comparable to the much more acknowledged role of comorbidities. This was not true for CRP, however, probably because, unlike lung damage, CRP level does not increase steadily. Thus, a single measure obtained at ED admission does not permit building a reliable severity/time index.

This study has some limitations. The study collected cases retrospectively, including only those that had both CT and CXR. This condition was necessary to fulfil the study aim, but obviously introduced a selection bias since some milder cases who were not referred to CT were not included in the cohort. It is worth noting that during the study period, as the diagnostic workup for suspected COVID-19 pneumonia included CT, the vast majority of patients presenting at the ED with symptoms highly suggestive of COVID-19 underwent it [30]. In the validation cohort, all patients who underwent CXR were included, resulting in a higher prevalence of milder cases, which may explain the lower predictive value of the models in this cohort. Furthermore, as other relevant severity biomarkers, in particular D-dimer levels, were not routinely assessed at the ED during the study period, it was not possible to build another severity/time index based on the third important pathway of disease progression (i.e., coagulopathy, along with lung damage and inflammation). Finally, the impact of severity/time indices on intermediate outcomes such as hospitalization and mechanical ventilation has not been evaluated. However, while the association of indices with intermediate outcomes is plausible, it would have only led to a further increase in indices association with death.

Conclusion

In conclusion, our study confirms that one of the most powerful prognostic factors for COVID-19 is the time from symptom onset to seeking medical assistance. This information is readily available and gives added value to the interpretation of other imaging and laboratory findings at ED presentation. Thus, our findings should encourage clinicians who evaluate a COVID-19 patient at admission to critically interpret the patient’s current disease severity also in light of the time from symptom onset: the shorter the time the worse the prognosis.

Supporting information

S1 Table. Models for death comparing CT-, CXR-, CRP-, and sO2- based measures of disease severity and severity/time indices.

https://doi.org/10.1371/journal.pone.0270111.s001

(DOCX)

S2 Table. Characteristics associated with death in the validation cohort.

https://doi.org/10.1371/journal.pone.0270111.s002

(DOCX)

S1 Fig. Validation cohort ROC curves.

Receiver Operating Characteristic (ROC) curves of CXR RALE score (red line) and respective severity/time index (blue line) in multivariable logistic models for death at 30 days adjusted for age and sex. AUC values were: AUCCXR-RALE = 0.77 (95% CI, 0.71–0.84) and AUCCXR-RALE severity/time index = 0.79 (95% CI, 0.73–0.85).

https://doi.org/10.1371/journal.pone.0270111.s003

(DOCX)

Acknowledgments

We thank Jacqueline Costa for the English language editing.

References

  1. 1. WHO. WHO Coronavirus (COVID-19) dashboard. Available at: https://covid19.who.int/
  2. 2. Petrilli CM, Jones SA, Yang J, Rajagopalan H, O’Donnell L, Chernyak Y, et al. Factors associated with hospital admission and critical illness among 5279 people with coronavirus disease 2019 in New York City: prospective cohort study. BMJ. 2020;369:m1966. pmid:32444366
  3. 3. Liang W, Liang H, Ou L, Chen B, Chen A, Li C, et al. Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19. JAMA Int Med. 2020;180(8):1081–9. pmid:32396163
  4. 4. Gallo Marin B, Aghagoli G, Lavine K, Yang L, Siff EJ, Chiang SS, et al. Predictors of COVID-19 severity: A literature review. Rev Med Virol. 2021 Jan;31(1):1–10. pmid:32845042
  5. 5. Wynants L, Van Calster B, Collins GS, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020 Apr 7;369:m1328. Erratum in: BMJ. 2020 Jun 3;369:m2204. pmid:32265220
  6. 6. Chen R, Liang W, Jiang M, et al; Medical Treatment Expert Group for COVID-19. Risk Factors of Fatal Outcome in Hospitalized Subjects With Coronavirus Disease 2019 From a Nationwide Analysis in China. Chest. 2020 Jul;158(1):97–105.
  7. 7. Ji D, Zhang D, Xu J, et al. Prediction for Progression Risk in Patients with COVID-19 Pneumonia: the CALL Score. Clin Infect Dis. 2020 Apr 9:ciaa414. pmid:32271369
  8. 8. Besutti G, Giorgi Rossi P, Iotti V, Spaggiari L, Bonacini R, Nitrosi A, et al. Accuracy of CT in a cohort of symptomatic patients with suspected COVID-19 pneumonia during the outbreak peak in Italy. Eur Radiol. 2020 Dec;30(12):6818–6827. pmid:32666316
  9. 9. Ai T, Yang Z, Hou H, et al. Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology. 2020 Feb 26:200642. pmid:32101510
  10. 10. Fang Y, Zhang H, Xie J, et al. Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR. Radiology. 2020 Feb 19:200432. pmid:32073353
  11. 11. Feng Z, Yu Q, Yao S, Luo L, Zhou W, Mao X, et al. Early prediction of disease progression in COVID-19 pneumonia patients with chest CT and clinical characteristics. Nat Commun. 2020;11(1):4968. pmid:33009413
  12. 12. Francone M, Iafrate F. Chest CT score in COVID-19 patients: correlation with disease severity and short-term prognosis. Eur Radiol. 2020;30(12):6808–17. pmid:32623505
  13. 13. Colombi D, Bodini FC. Well-aerated Lung on Admitting Chest CT to Predict Adverse Outcome in COVID-19 Pneumonia. Radiology. 2020;296(2):E86–e96. pmid:32301647
  14. 14. Grodecki K, Lin A, Cadet S, McElhinney PA, Razipour A, Chan C. Quantitative Burden of COVID-19 Pneumonia at Chest CT Predicts Adverse Outcomes: A Post Hoc Analysis of a Prospective International Registry. Radiol Cardiothorac Imaging. 2020;2(5):e200389. pmid:33778629
  15. 15. Lei Q, Li G, Ma X, Tian J, Wu YF, Chen H, et al. Correlation between CT findings and outcomes in 46 patients with coronavirus disease 2019. Sci Rep. 2021;11(1):1103. pmid:33441572
  16. 16. Besutti G, Ottone M, Fasano T, Pattacini P, Iotti V, Spaggiari L, et al. The value of computed tomography in assessing the risk of death in COVID-19 patients presenting to the emergency room. Eur Radiol. 2021 May 12:1–12. pmid:33978822
  17. 17. Brogna B, Bignardi E, Brogna C, Volpe M, Lombardi G, Rosa A, et al. A Pictorial Review of the Role of Imaging in the Detection, Management, Histopathological Correlations, and Complications of COVID-19 Pneumonia. Diagnostics (Basel). 2021;11(3):437.
  18. 18. Balbi M, Caroli A, Corsi A, Milanese G, Surace A, Di Marco F, et al. Chest X-ray for predicting mortality and the need for ventilatory support in COVID-19 patients presenting to the emergency department. Eur Radiol. 2021;31(4):1999–2012. pmid:33033861
  19. 19. Borghesi A, Zigliani A, Golemi S, Carapella N, Maculotti P, Farina D, et al. Chest X-ray severity index as a predictor of in-hospital mortality in coronavirus disease 2019: A study of 302 patients from Italy. Int J Infect Dis. 2020;96:291–293. pmid:32437939
  20. 20. Toussie D, Voutsinas N, Finkelstein M, Cedillo MA, Manna S, Maron SZ, et al. Clinical and Chest Radiography Features Determine Patient Outcomes in Young and Middle-aged Adults with COVID-19. Radiology. 2020;297(1):E197–E206. pmid:32407255
  21. 21. Sensusiati AD, Amin M, Nasronudin N, Rosyid AN, Ramadhan NA, Lathifah R, et al. Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: a retrospective study. F1000Res. 2020;9:1286. pmid:33537125
  22. 22. Moroni C, Cozzi D, Albanesi M, Cavigli E, Bindi A, Luvarà S, et al. Chest X-ray in the emergency department during COVID-19 pandemic descending phase in Italy: correlation with patients’ outcome. Radiol Med. 2021;126(5):661–668. pmid:33394364
  23. 23. Kerpel A, Apter S, Nissan N, Houri-Levi E, Klug M, Amit , et al. Diagnostic and Prognostic Value of Chest Radiographs for COVID-19 at Presentation. West J Emerg Med. 2020;21(5):1067–1075. pmid:32970556
  24. 24. Giorgi Rossi P, Marino M, Formisano D, Venturelli F, Vicentini M, Grilli R; Reggio Emilia COVID-19 Working Group. Characteristics and outcomes of a cohort of COVID-19 patients in the Province of Reggio Emilia, Italy. PLoS One. 2020 Aug 27;15(8):e0238281. pmid:32853230
  25. 25. EUROPEAN SOCIETY OF CLINICAL MICROBIOLOGY AND INFECTIOUS DISEASES. Shorter time from symptom onset to hospitalization is associated with worse outcome in patients with COVID-19 September 25 2020. Available from: https://eurekalert.org/pub_releases/2020-09/esoc-stf092520.php.
  26. 26. Rodríguez-Molinero A, Gálvez-Barrón C, Miñarro A, Macho O, López GF, Robles MT, et al. Association between COVID-19 prognosis and disease presentation, comorbidities and chronic treatment of hospitalized patients. PloS one. 2020;15(10):e0239571. pmid:33057443
  27. 27. Galli MG, Djuric O, Besutti G, Ottone M, Amidei L, Bitton L, et al. Clinical and imaging characteristics of patients with COVID-19 predicting hospital readmission after emergency department discharge: a single-centre cohort study in Italy. BMJ Open. 2022 Apr 6;12(4):e052665. pmid:35387808
  28. 28. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83. pmid:3558716
  29. 29. Wong HYF, Lam HYS, Fong AH, Leung ST, Chin TW, Lo CSY, et al. Frequency and Distribution of Chest Radiographic Findings in Patients Positive for COVID-19. Radiology. 2020 Aug;296(2):E72–E78. pmid:32216717
  30. 30. Warren MA, Zhao Z, Koyama T, Bastarache JA, Shaver CM, Semler MW, et al. Severity scoring of lung oedema on the chest radiograph is associated with clinical outcomes in ARDS. Thorax. 2018 Sep;73(9):840–846. pmid:29903755
  31. 31. Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, et al. The Incubation Period of Coronavirus Disease 2019 (COVID-19) From Publicly Reported Confirmed Cases: Estimation and Application. Ann Intern Med. 2020 May 5;172(9):577–582. pmid:32150748
  32. 32. Rubin GD, Ryerson CJ, Haramati LB, et al. The Role of Chest Imaging in Patient Management During the COVID-19 Pandemic: A Multinational Consensus Statement From the Fleischner Society. Chest. 2020 Jul;158(1):106–116. pmid:32275978
  33. 33. Manson JJ, Crooks C, Naja M, Ledlie A, Goulden B, Liddle T, et al. COVID-19-associated hyperinflammation and escalation of patient care: a retrospective longitudinal cohort study. Lancet Rheumatol. 2020 Oct;2(10):e594–e602. pmid:32864628
  34. 34. Mueller AA, Tamura T, Crowley CP, DeGrado JR, Haider H, Jezmir JL, et al. Inflammatory Biomarker Trends Predict Respiratory Decline in COVID-19 Patients. Cell Rep Med. 2020 Nov 17;1(8):100144. pmid:33163981
  35. 35. Dai M, Liu X, Zhu X, Liu T, Xu C, Ye F, et al. Temporal changes of CT findings between non-severe and severe cases of COVID-19 pneumonia: a multi-center, retrospective, longitudinal Study. Int J Med Sci. 2020;17(17):2653–2662. pmid:33162793
  36. 36. Han X, Fan Y, Alwalid O, Li N, Jia X, Yuan M, et al. Six-month Follow-up Chest CT Findings after Severe COVID-19 Pneumonia. Radiology. 2021 Apr;299(1):E177–E186. pmid:33497317