Peer Review History

Original SubmissionDecember 3, 2020
Decision Letter - Ahmed Negida, Editor

PONE-D-20-38124

Chinese herbal medicine in adults with mild to moderate coronavirus disease 2019(COVID-19): A systematic review and meta-analysis

PLOS ONE

Dear Dr. Shi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 28 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Ahmed Negida, MD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables should remain uploaded as separate "supporting information" files.

3.  We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

Reviewer #4: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: No

Reviewer #4: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: kindly, find the primary review and comments in the attached Pdf file, in addition, please pay attention to the following points:

-The main claim of the paper is clear and significant, specially in such unprecedent situation.

-The analysis o data supports the claim of the paper, however; it would be better to connect this study with more previous published data and literatures in a way that reduce duplication and support the findings of this paper.

-a more detailed protocol of the statistical analysis is needed especially, most of the data used in the analysis has been retrieved from papers in Chinese language.

-Type of samples in treatment and control groups doesn't exclude the possibility of synergistic/ combination effect between CHM and western medicine. have you had any studies that used CHM only on separate groups as a treatment? Was there any control group that didn't receive any treatment? is there any information about hospitalization or receiving any other special care(ex. ventilator) beside the treatment?

i.e: we can't conclude for sure the CHM as a separate, effective, and safe treatment for mild to moderate COVID-19.

Reviewer #2: Valuable data was provided in this manuscript, which are not easily assessible for international readers outside China. Hence, I have to stress that this manuscript presents precious and valuable data that will benefit the literature and improve understanding of the role of TCM in COVID-19. However, in general, I find that there is lack of clarity in definition of many things including outcome measures and treatment groups. Importantly, the discussion was superficial. There needs to be correlation between ROB, quality of study, heterogeneity and interpretation of results. Please find my suggestion as below and as specify in the attachment:

1. Strongly suggest for professional language/ scientific proof-reading to correct grammar, sentence structuring, and selection of words that are preferred to represent precise scientific writing for the entire manuscript. Kindly check for the use of oxford comma and appropriate/excessive use of connective words throughout. The authors in particular like to start sentences with the word "And". Spacing between words and symbols needs to be checked and made consistent.

2. The eligibility criteria can be rewritten as inclusion and exclusion criteria clearly; or rearrange with clearer subtopics differentiation. The different levels of the subtopics in the methods needs to be clear. For example (here I am using numbers to explain an example of how the different levels needs to be clarified. It is to the authors discretion on presenting this without the numbers)

2.0 Methods

2.1 Eligibility criteria

2.1.1 Type of studies

2.1.2 Participant characteristics

2.2 Literature search

2.2.1 Search strategy

2.2.2 Study selection and data extraction

2.3 Data analysis

2.3.1Methodological quality assessment

2.3.2 Meta-analyses

3. Specific to the methods

a. Kindly check against the PRISMA checklist- Present full electronic search strategy for at least one database (please present the combination of keywords used); Describe method of data extraction from reports (e.g., piloted forms, independently, in duplicate) and any processes for obtaining and confirming data from investigators (kindly mention if attempts were made to seek for additional data)

b. Clarify inclusion criteria- oral Chinese herbal medicine only

c. Outcome measures need to be well defined e.g. what is clinical cure rate, what is effective rate of lung CT

4. Results

a. arrange the level of subheadings accordingly as suggested for methods

b. definition of CHM and CWM needs to be clear- the naming of the groups. Although it is mentioned that CHM group received both herbal and western medicine in methods, CHM is still abbreviated as chinese herbal medicine. The results are mostly written as 'the outcomes are better with treatment by CHM', which can be confusing to interpret, and easily misunderstood as if CHM solely (without western medicine) is beneficial. Suggest to clearly describe what each group means with distinct abbreviations for groups. Perhaps it is also because of the choice of word 'by' which when read, is interpreted this way, hence consider rewriting the results section with more precise selection of words.

5. Discussion

Although an interesting topic with very valuable data (I cannot emphasize this enough, this is very valuable data), the discussion is superficial and lacked depth. few suggestion of topics to discuss include

- heterogeneity of the studies and the impact on the findings.

- impact of different formulations used and how did the authors came to collectively interpreting them in the same meta-analyses (also consider that different herbs would have acted differently, and certainly herb-herb interaction should be discussed)

- risk of bias and how that affects results interpretation

- discuss on adverse events, reporting bias?

- quality of herbal intervention used

- suggest to consider consort checklist for tcm to evaluate quality of reporting which can further strengthen discussion

- how does this new information applies to the global scenario and what are the challenges of applying TCM in this scenario

- difference between TCM approach (Which is based on individualised assessment, and can be even affected by factors such as diet, body type, environment, geographical location, weather) and western medicine approach

- it is also important to point out that the concept of selecting treatment based on TCM philosophy is vastly different. My own personal experience consulting TCM experts from China , which I quote him, the treatment in China (Wuhan experiencing winter that time) may not suit for countries with different climate and weather (e.g. a Southeast Asian country with hot and humid climate, with different diet practices)

- also consider that herbs, in raw form, extracted, or in different extraction medium in phytochemistry context would yield different phytocompounds, and one of the main gap here is a lack of consistency/ documentation/ quantitation/ interpretation of what is the mechanisms and bioactive compound involved

- regulatory challenges

- contribution of confounding factors such as co-morbidities, differences in western medicine used

6. Conclusion

The conclusion partly answers the objective. However, critical appraisal (as mentioned in the discussion section) would help interpret the results better and make it more relevant to the global scenario. The limitations are not only to conducting high quality studies (to which quality of studies were not actually evaluated and discussed in the discussion section), but application to the world, and consideration of knowledge gap.

7. Is the western medicine arm treatment really identical? There is no data available on what is given as western medicine and difficult to decide if they are identical, similar, or if they actually can be a confounding factor.

8. It would be good to at least describe what are the different composition of the common TCM formulations used.

But overall, I am very appreciative that this data will be made available and I look forward to the amended version. Again, I cannot emphasize enough how valuable these data are.

Reviewer #3: Reviewer’s Comments

Chinese herbal medicine in adults with mild to moderate coronavirus disease 2019(COVID-19): A systematic review and meta-analysis with MS ID PONE-D-20-38124.

Major Comments

1. Meta-analytical studies have been carried out majorly on the basis of ref 10-20 and all of them are published in Chinese journals except ref 14 only, which indicates towards the biasness of choice of content used for carrying out the study. Authors are recommended to refer the content from other sources as well to further validate the findings.

2. COVID-19 data provided in introduction section is contradictory with WHO data. Authors are suggested to cross-check the COVID-19 count provided on WHO website.

3. Conclusion of study is not in accordance with results therefore needs to be modified accordingly.

4. Manuscript mandatorily needs to be handled by language experts as there exists several ambiguities in its current form.

Minor Comments

1. Abbreviations are missing throughout the manuscript.

2. Cross-check the format of references to maintain homogeneity.

Reviewer #4: This is a very important review to publish at this time. These findings are very relevant and contribute to the essential knowledge about a globally crippling disease. The review was performed with rigorous standards and therefore the results can contribute significantly to the prevention and treatment of COVID-19. Thank you for your work.

Full review comments uploaded as attachment.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Muhammad G. Khodary Omar

Reviewer #2: Yes: Xin Yi, Lim

Reviewer #3: Yes: Dr. Vedpriya Arya

Reviewer #4: Yes: Daniela R. A. Rambaldini

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachments
Attachment
Submitted filename: PONE-D-20-38124_reviewer(COVID-19 popular chineese medicine) reviewed.pdf
Attachment
Submitted filename: PONE-D-20-38124_reviewer.pdf
Attachment
Submitted filename: Reviewers Comments (1).docx
Attachment
Submitted filename: PONE-D-20-38124_ Reviewers Comments - Copy.pdf
Attachment
Submitted filename: PONE-D-20-38124_reviewer REVIEWED.pdf
Revision 1

Reviewer #1: kindly, find the primary review and comments in the attached Pdf file, in addition, please pay attention to the following points:

-The main claim of the paper is clear and significant, specially in such unprecedent situation.

-The analysis of data supports the claim of the paper, however; it would be better to connect this study with more previous published data and literatures in a way that reduce duplication and support the findings of this paper.

Response: in the discussion section, this review has linked this study with more previously published data and literature for analysis.

-a more detailed protocol of the statistical analysis is needed especially, most of the data used in the analysis has been retrieved from papers in Chinese language.

Response: in our review, a detailed protocol of the statistical analysis was developed. Trials on Chinese herbal medicine for mild to moderate COVID-19 were conducted in mainland China. Most of the trials were published online in Chinese. Therefore, most of the data used in the analysis has been retrieved from papers in Chinese language.

-Type of samples in treatment and control groups doesn't exclude the possibility of synergistic/ combination effect between CHM and western medicine. have you had any studies that used CHM only on separate groups as a treatment? Was there any control group that didn't receive any treatment? is there any information about hospitalization or receiving any other special care(ex. ventilator) beside the treatment?

Response: trials of Chinese herbal medicine in the treatment of mild to moderate COVID-19 were included in this review. The treatment group was treated with Chinese herbal medicine combined with conventional therapy. No trials that used CHM only on separate groups as a treatment. There was no control group that did not receive any treatment. Since the participants were diagnosed as mild to moderate COVID-19, patients did not receive ventilator treatment. The specific treatment information is listed in Table 1.

i.e: we can't conclude for sure the CHM as a separate, effective, and safe treatment for mild to moderate COVID-19.

Response: the conclusion of this review is that Chinese herbal medicine combined with conventional therapy could be effective and safe in the treatment of adults with mild to moderate COVID-19.

Reviewer #2: Valuable data was provided in this manuscript, which are not easily assessible for international readers outside China. Hence, I have to stress that this manuscript presents precious and valuable data that will benefit the literature and improve understanding of the role of TCM in COVID-19. However, in general, I find that there is lack of clarity in definition of many things including outcome measures and treatment groups. Importantly, the discussion was superficial. There needs to be correlation between ROB, quality of study, heterogeneity and interpretation of results. Please find my suggestion as below and as specify in the attachment:

1. Strongly suggest for professional language/ scientific proof-reading to correct grammar, sentence structuring, and selection of words that are preferred to represent precise scientific writing for the entire manuscript. Kindly check for the use of oxford comma and appropriate/excessive use of connective words throughout. The authors in particular like to start sentences with the word "And". Spacing between words and symbols needs to be checked and made consistent.

Response: grammar, sentence structure, comma, and connective words have been corrected.

2. The eligibility criteria can be rewritten as inclusion and exclusion criteria clearly; or rearrange with clearer subtopics differentiation. The different levels of the subtopics in the methods needs to be clear. For example (here I am using numbers to explain an example of how the different levels needs to be clarified. It is to the authors discretion on presenting this without the numbers)

Response: the eligibility criteria have been rewritten as inclusion and exclusion criteria.

3. Specific to the methods

a. Kindly check against the PRISMA checklist- Present full electronic search strategy for at least one database (please present the combination of keywords used); Describe method of data extraction from reports (e.g., piloted forms, independently, in duplicate) and any processes for obtaining and confirming data from investigators (kindly mention if attempts were made to seek for additional data)

Response: the PubMed search strategy is listed. The method of data extraction from reports, and any processes for obtaining and confirming data from investigators were described in this review.

b. Clarify inclusion criteria- oral Chinese herbal medicine only

Response: inclusion criteria have been clarified - oral Chinese herbal medicine only.

c. Outcome measures need to be well defined e.g. what is clinical cure rate, what is effective rate of lung CT

Response: Outcome measures (e.g. clinical cure rate, lung CT) have been well defined.

4. Results

a. arrange the level of subheadings accordingly as suggested for methods

Response: the level of subheadings has been arranged accordingly as suggested for methods.

b. definition of CHM and CWM needs to be clear- the naming of the groups. Although it is mentioned that CHM group received both herbal and western medicine in methods, CHM is still abbreviated as chinese herbal medicine. The results are mostly written as 'the outcomes are better with treatment by CHM', which can be confusing to interpret, and easily misunderstood as if CHM solely (without western medicine) is beneficial. Suggest to clearly describe what each group means with distinct abbreviations for groups. Perhaps it is also because of the choice of word 'by' which when read, is interpreted this way, hence consider rewriting the results section with more precise selection of words.

Response: the naming of the groups has been rewritten.

5. Discussion

Although an interesting topic with very valuable data (I cannot emphasize this enough, this is very valuable data), the discussion is superficial and lacked depth. few suggestion of topics to discuss include

- heterogeneity of the studies and the impact on the findings.

- impact of different formulations used and how did the authors came to collectively interpreting them in the same meta-analyses (also consider that different herbs would have acted differently, and certainly herb-herb interaction should be discussed)

- risk of bias and how that affects results interpretation

- discuss on adverse events, reporting bias?

- quality of herbal intervention used

- suggest to consider consort checklist for tcm to evaluate quality of reporting which can further strengthen discussion

- how does this new information applies to the global scenario and what are the challenges of applying TCM in this scenario

- difference between TCM approach (Which is based on individualised assessment, and can be even affected by factors such as diet, body type, environment, geographical location, weather) and western medicine approach

- it is also important to point out that the concept of selecting treatment based on TCM philosophy is vastly different. My own personal experience consulting TCM experts from China , which I quote him, the treatment in China (Wuhan experiencing winter that time) may not suit for countries with different climate and weather (e.g. a Southeast Asian country with hot and humid climate, with different diet practices)

- also consider that herbs, in raw form, extracted, or in different extraction medium in phytochemistry context would yield different phytocompounds, and one of the main gap here is a lack of consistency/ documentation/ quantitation/ interpretation of what is the mechanisms and bioactive compound involved

- regulatory challenges

- contribution of confounding factors such as co-morbidities, differences in western medicine used

Response: in our review, the suggestions on the above topics have been incorporated into the discussion.

6. Conclusion

The conclusion partly answers the objective. However, critical appraisal (as mentioned in the discussion section) would help interpret the results better and make it more relevant to the global scenario. The limitations are not only to conducting high quality studies (to which quality of studies were not actually evaluated and discussed in the discussion section), but application to the world, and consideration of knowledge gap.

Response: critical appraisal has been made.

7. Is the western medicine arm treatment really identical? There is no data available on what is given as western medicine and difficult to decide if they are identical, similar, or if they actually can be a confounding factor.

Response: the western medicine arm treatment really is not identical in different trials. Specific treatment information is listed in Table 1.

8. It would be good to at least describe what are the different composition of the common TCM formulations used.

Response: the different components of TCM were described in this review.

But overall, I am very appreciative that this data will be made available and I look forward to the amended version. Again, I cannot emphasize enough how valuable these data are.

Reviewer #3: Reviewer’s Comments

Chinese herbal medicine in adults with mild to moderate coronavirus disease 2019(COVID-19): A systematic review and meta-analysis with MS ID PONE-D-20-38124.

Major Comments

1. Meta-analytical studies have been carried out majorly on the basis of ref 10-20 and all of them are published in Chinese journals except ref 14 only, which indicates towards the biasness of choice of content used for carrying out the study. Authors are recommended to refer the content from other sources as well to further validate the findings.

Response: trials of Chinese herbal medicine in the treatment of mild to moderate COVID-19 were comprehensively searched in eight electronic databases. Potentially eligible data was obtained by manually searching the reference list of previously published reviews. If possible, the conference abstracts were reviewed to find unpublished trials, and the data was obtained by contacting the author.

2. COVID-19 data provided in introduction section is contradictory with WHO data. Authors are suggested to cross-check the COVID-19 count provided on WHO website.

Response: COVID-19 data was cross-checked according to WHO website.

3. Conclusion of study is not in accordance with results therefore needs to be modified accordingly.

Response: conclusion of our study was modified in accordance with results.

4. Manuscript mandatorily needs to be handled by language experts as there exists several ambiguities in its current form.

Response: our manuscript was handled by language experts.

Minor Comments

1. Abbreviations are missing throughout the manuscript.

Response: abbreviations full names were listed in the manuscript.

2. Cross-check the format of references to maintain homogeneity.

Response: the format of references was cross-checked.

Reviewer #4: This is a very important review to publish at this time. These findings are very relevant and contribute to the essential knowledge about a globally crippling disease. The review was performed with rigorous standards and therefore the results can contribute significantly to the prevention and treatment of COVID-19. Thank you for your work.

Attachments
Attachment
Submitted filename: Response to Reviewers.pdf
Decision Letter - Ahmed Negida, Editor

PONE-D-20-38124R1

Chinese herbal medicine in adults with mild to moderate COVID-19: A systematic review and meta-analysis

PLOS ONE

Dear Dr. Shi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 08 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ahmed Negida, MD

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

Reviewer #4: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: No

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: Thank you for revising your very valuable manuscript. It was really interesting and my honour to have read such valuable data. It is really precious. However, major revisions especially in data interpretation, critical analysis and discussion writing, as well as definition of outcomes still needs to be amended.

1) Introduction - need to better justify the need for this systematic review (i.e research gap leading to the objective). It is too brief. In fact the introduction in abstract better justified the purpose of the review than the introduction in the manuscript. Suggest to amend. Also, very importantly, there is an overstatement on the findings when citing two studies on benefits of CHM in the introduction, please review again as commented in the manuscript).

2) Methods and results: Please define in depth for outcomes : lung CT- what is the definition of improved/good lung CT etc, please elaborate. and how does that relate to outcome assessment. The same applies to definition of clinical cure rate and viral nucleic acid testing. The definition of effective, improved, ineffective also needs to be clarified

3) Results- table 2 is truncated and I could not view the entire table. The resolution of the forest plots were low and many are not readable. I suggest to rename the axis to favour therapy alone and favour CHM + conventional therapy instead of favour control/favour experimental to make it easier to read at first glance.

4) The benefits on inflammatory markers- this is very important to be clarified. Is higher levels better or lower levels better? This would depend on the course of the disease. For example, at initial stages, we probably need higher levels of immunity to produce antiviral effects. However, if inflammation is overt and prolonged at later stages, this may push the patient into a cytokine storm and hence detrimental i.e. timing is important. This component is not discussed and should be discussed, considering that inflammatory markers is one of the outcomes assessed and duration of administration varies .

5) I would appreciate more discussion on CHM+ conventional therapy discussion in view that this plays a major role in your findings too

6) English has improved but still needs to be improved further. In particular in selection of accurate and politically appropriate words, and an entire highlighted paragraph in discussion. Minor formatting changes of the tables are also recommended.

7) Data availability statements should be clarify- its contradicting with what is already provided.

Reviewer #4: Authors seem to have addressed all recommendations and points including clarification of methods, improvements in the statistical analysis and tests used, updates to the results, revisions to the discussion, and overall edits to grammar and sentence structure. Addition of Tables 1 & 2 are very helpful.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #4: Yes: Daniela R. A. Rambaldini

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachments
Attachment
Submitted filename: PONE-D-20-38124_R1_reviewer - Copy - Copy.pdf
Revision 2

Reviewer #2: Thank you for revising your very valuable manuscript. It was really interesting and my honour to have read such valuable data. It is really precious. However, major revisions especially in data interpretation, critical analysis and discussion writing, as well as definition of outcomes still needs to be amended.

1) Introduction - need to better justify the need for this systematic review (i.e research gap leading to the objective). It is too brief. In fact the introduction in abstract better justified the purpose of the review than the introduction in the manuscript. Suggest to amend. Also, very importantly, there is an overstatement on the findings when citing two studies on benefits of CHM in the introduction, please review again as commented in the manuscript).

Response: the need for this systematic review has been further illustrated. In the introduction, the authors have stated the specific benefits of CHM combined with conventional therapy in the treatment of mild to moderate COVID-19.

2) Methods and results: Please define in depth for outcomes: lung CT- what is the definition of improved/good lung CT etc, please elaborate. and how does that relate to outcome assessment. The same applies to definition of clinical cure rate and viral nucleic acid testing. The definition of effective, improved, ineffective also needs to be clarified

Response: the authors have defined in depth for outcomes of lung CT, clinical cure rate, and viral nucleic acid testing.

3) Results- table 2 is truncated and I could not view the entire table. The resolution of the forest plots were low and many are not readable. I suggest to rename the axis to favour therapy alone and favour CHM + conventional therapy instead of favour control/favour experimental to make it easier to read at first glance.

Response: the authors have modified table 2 and the resolution of the forest plots. The authors have renamed the axis to favour conventional therapy and favour combination therapy instead of favour control/favour experimental to make it easier to read at first glance.

4) The benefits on inflammatory markers- this is very important to be clarified. Is higher levels better or lower levels better? This would depend on the course of the disease. For example, at initial stages, we probably need higher levels of immunity to produce antiviral effects. However, if inflammation is overt and prolonged at later stages, this may push the patient into a cytokine storm and hence detrimental i.e. timing is important. This component is not discussed and should be discussed, considering that inflammatory markers is one of the outcomes assessed and duration of administration varies.

Response: the benefits on inflammatory markers have been clarified. Subgroup analyses of outcomes of inflammatory markers were carried out according to treatment duration.

5) I would appreciate more discussion on CHM+ conventional therapy discussion in view that this plays a major role in your findings too

Response: this review has discussed combination therapy of CHM and conventional therapy.

6) English has improved but still needs to be improved further. In particular in selection of accurate and politically appropriate words, and an entire highlighted paragraph in discussion. Minor formatting changes of the tables are also recommended.

Response: the authors have received linguistic assistance provided by AJE (https://secure.aje.com/cn/researcher/) during the preparation of this manuscript. The format of the tables has been modified.

7) Data availability statements should be clarify- its contradicting with what is already provided.

Response: the authors have clarified the data availability statements.

Attachments
Attachment
Submitted filename: Response to Reviewers.pdf
Decision Letter - Ahmed Negida, Editor

Add-on effect of Chinese herbal medicine in the treatment of mild to moderate COVID-19: A systematic review and meta-analysis

PONE-D-20-38124R2

Dear Dr. Shi,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ahmed Negida, MD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Formally Accepted
Acceptance Letter - Ahmed Negida, Editor

PONE-D-20-38124R2

Add-on effect of Chinese herbal medicine in the treatment of mild to moderate COVID-19: A systematic review and meta-analysis

Dear Dr. Shi:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Ahmed Negida

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .