RESEARCH ARTICLE
Pandemic publishing: Medical journals
strongly speed up their publication
process for COVID-19
Serge P. J. M. Horbach1,2
1Radboud University Nijmegen, Faculty of Science, Institute for Science in Society,
P.O. Kasten 9010, 6500 GL Nijmegen, Die Niederlande
2Centre for Science and Technology Studies (CWTS), Faculty of Social Sciences, Leiden University,
Wassenaarseweg 62A, 2333 AL Leiden, Die Niederlande
Schlüsselwörter: COVID-19, peer review, publication delay, publication process, publication time,
scientific publishing
ABSTRAKT
In times of public crises, including the current COVID-19 pandemic, rapid dissemination of
relevant scientific knowledge is of paramount importance. The duration of scholarly journals’
publication process is one of the main factors that may hinder quick delivery of new information.
Following initiatives of medical journals to accelerate their publication process, this study assesses
whether medical journals have managed to speed up their publication process for coronavirus-
related articles. It studies the duration of 14 medical journals’ publication processes both during and
prior to the current pandemic. Assessing 669 articles, the study concludes that medical journals
have indeed strongly accelerated their publication process for coronavirus-related articles since the
outbreak of the pandemic: The time between submission and publication has decreased on average
von 49%. The largest decrease in number of days between submission and publication of articles
was due to a decrease in time required for peer review. For articles not related to COVID-19, NEIN
acceleration of the publication process is found. While the acceleration of the publication process
is laudable from the perspective of quick information dissemination, it also may raise concerns
relating to the quality of the peer review process and of the resulting publications.
1. BACKGROUND
The world is facing an unprecedented health crisis affecting nearly all parts of society. In these
mal, access to the most state-of-the-art scientific knowledge is paramount to tackling the crisis.
Academic journals and scholarly publishers are hence called upon to make new knowledge
openly available and deliver new insights quickly.
In the current COVID-19 era, it is clear that new knowledge is direly needed. Scientists all
over the world have stepped in to do experiments, observational studies and new analyses to
obtain relevant information. However fast we would like to have access to this information, Die
scientific method used to obtain it requires time. Drug trials and vaccine creations do not happen
overnight (Thorp, 2020). Jedoch, once such information has been gathered, it needs to be dis-
seminated to all those potentially in a position to use it, as quick as possible. Traditionell, scholarly
journals have been one of the main outlets to facilitate this (Horbach & Halffman, 2018).
One of the factors possibly hindering quick delivery of new information through scholarly
journals is the duration of their publication process. Through editorial assessment and peer
Keine offenen Zugänge
Tagebuch
Zitat: Horbach, S. P. J. M. (2020).
Pandemic publishing: Medical journals
strongly speed up their publication
process for COVID-19. Quantitative
Science Studies, 1(3), 1056–1067.
https://doi.org/10.1162/qss_a_00076
DOI:
https://doi.org/10.1162/qss_a_00076
zusätzliche Informationen:
https://doi.org/10.1162/qss_a_00076
Erhalten: 19 April 2020
Akzeptiert: 2 Juni 2020
Korrespondierender Autor:
Serge P. J. M. Horbach
s.horbach@science.ru.nl
Handling-Editor:
Vincent Larivière
Urheberrechte ©: © 2020 Serge P. J. M.
Horbach. Published under a Creative
Commons Attribution 4.0 International
(CC BY 4.0) Lizenz.
Die MIT-Presse
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
/
.
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
Rezension, journals select which articles deserve to be published on their pages, ideally filtering out
invalid, erroneous, or otherwise problematic research. Though celebrated as being one of the hall-
marks of science, the peer review process is also regularly criticized. Commentators blame it for
being inconsistent (Peters & Ceci, 1982), essentially flawed (Schmied, 2006), biased (Teplitskiy,
Acuna, et al., 2018), and—particularly relevant in these times of crisis—slow (Nguyen,
Haddaway, et al., 2015).
Several studies have previously aimed to assess the typical duration of journals’ publication
Verfahren (Lin, Hou, & Wu, 2016; Tosi, 2009). In their analyses, researchers commonly distinguish
two stages of this process: the review stage (the stage between article submission and formal
acceptance) and the production stage (the stage between acceptance and final publication, entweder
online or in print). In a meta-analysis including over 2,700 journal articles, Björk and Solomon
(2013) find considerable differences in turnaround times (the period between submission and
publication of a journal article, sometimes also called publication delays) between research
disciplines. For biomedical journals, they find an average duration of the review stage of just over
4 months, while the production stage takes on average about 5 months. The latter stage can
be shortened for some journals by implementing “online-first” initiatives. Clearly, such lengthy
turnaround times are highly undesirable from the perspective of quick delivery of novel knowl-
edge in light of the current health crisis.
Two major responses to circumvent long turnaround times can currently be witnessed. Aus
an author perspective, commentators are reporting a sharp increase in the use of preprint
servers. On these online platforms, authors upload their manuscript, making it publicly acces-
sible immediately upon finalization of the text (Gunnarsdottir, 2005). Because no review,
editorial assessment, or copyediting takes place, manuscripts can be made accessible without
publication delay. Jedoch, as manuscripts are only reviewed once they are available for any-
body to read and use, scholars warn of potentially incorrect results spreading without editorial
assessment filtering them. Tatsächlich, several cases of invalid research regarding COVID-19 being
published as preprints have already been reported (Heimstädt, 2020; Marcus & Oransky, 2020).
Preprint servers are now trying to mitigate this by explicitly posting (Gesundheit) warnings on their
articles. It should be noted, obwohl, that this is not specific to preprints, as journal articles can
require postpublication corrections and retractions as well (Horbach & Halffman, 2019).
Several articles related to COVID-19 have already gone through this process (Gautret, Lagier,
et al., 2020).
From the publishers’ side, many journals and publishers are currently modifying their editorial
procedures and policies to warrant fast dissemination of relevant information (Redhead, 2020).
Zum Beispiel, eLife announced it would curtail requests for additional experiments during revi-
sionen, suspend its deadline for submitting revisions, and make the posting of preprints to
bioRxiv or medRxiv the default for all eLife submissions. It would also specifically mobilize early-
career researchers to become reviewing editors and reviewers to extend the journal’s reviewer
pool (Eisen, Akhmanova, et al., 2020). Ähnlich, Nature put out an open invitation to researchers
with relevant expertise to review coronavirus-related papers over short time (Natur, 2020).
Somit, journals and publishers are aiming to attract reviewers who can assist in the rapid pub-
lication of new findings that are relevant to tackle the health crisis. The Medical Journal of
Australia (MJA) has drafted policies related to both preprints and rapid peer review, setting up “fast
lanes” for coronavirus-related research:
The MJA has stepped up to play its part in meeting this crisis, including ultrarapid review of
SARS-CoV-2 manuscripts and preprint publication of unedited papers, to ensure that the
newest data and viewpoints are available as soon as possible. (Talley, 2020)
Quantitative Science Studies
1057
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
.
/
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
The Royal Society Open Publishing announced the establishing of a similar fast lane for their
registered reports on coronavirus-related content. They have even gathered a group of 700 reviewers
who have committed to review a paper in 24 Zu 48 hours when called up on (Brock, 2020). Der
journal also acknowledges a widely voiced concern related to these fast dissemination models:
“The ultra-rapid review and publication model entails a risk of error, but sharing important informa-
tion too slowly is a much greater hazard” (Talley, 2020).
In diesem Artikel, we assess whether the scholarly publishing community has succeeded in speeding
up the dissemination of coronavirus-related content. To do so, we mainly focus on the duration
of journals’ publication processes both prior to and during the present pandemic. Zusätzlich, Wir
briefly assess the use of preprint servers and the uptake of preprint articles in academic journals.
2. METHODEN
Für unsere Analyse, we use a repository of coronavirus-related research articles established by the
Centre for Science and Technology Studies (CWTS). The repository is based on databases of
CORD-19, Dimensions, and the World Health Organization ( WHO), and includes articles on
COVID-19, SARS-CoV-2, and related (corona) viruses and infectious diseases. Insbesondere, Das
means that the database contains journal articles and preprints that predate the current COVID-19
pandemic, as it also includes, zum Beispiel, articles on the 2002 SARS virus and disease. Für
brevity’s sake, all such articles will in the remainder of this article by described as “coronavirus-
related” articles. A full description of the database as well as access to all relevant data is available
(CWTS, 2020). Colavizza, Costas, et al. (2020) provide a description and analysis of parts of this
database. All results in this article are based on the April 4, 2020 release of the database. We note
that the majority of articles in the data set originate from the CORD-19 database. Some doubt has
been raised about the relevance of some of this database’s articles to the current pandemic
(Colavizza et al., 2020), but for our purposes, the scope of the database seems reasonable.
Based on this data set, several analyses were performed.
2.1. Duration of Journals’ Publication Process
We analyzed the duration of the publication process, in number of days, for a sample of 529 journal
articles. Of these, 259 articles were published during the present pandemic (d.h., from January 1,
2020) Und 270 were published prior to the pandemic (d.h., before October 1, 2019). The dates
Januar 1 und Oktober 1 were chosen based on the first cases of COVID-19 appearing in China
in November 2019. Somit, Oktober 1 ensures that articles in the control group were published
before the pandemic emerged, und Januar 1 allows for work to be done and submitted after the
first cases appeared. The articles were published in 14 different journals. Journals were selected
based on their number of articles both prior to and during the current pandemic as well as the avail-
ability of data on when articles were submitted, accepted, and published. We selected the 10 jour-
nals publishing most coronavirus-related articles in general, supplemented by the five journals
publishing most coronavirus-related content since the start of the pandemic that make publication
Daten (Vorlage, acceptance, and publishing) verfügbar. One journal, Viruses, matches both criteria.
The list of journals used in this analysis, including their number of articles, as well as the journals
discarded because no data on submission, acceptance, or publication dates were available, Ist
added as supplementary material A. From those journals, we sampled all articles published since
the start of the pandemic and matched those to an equal number of articles published in the same
journal prior to the pandemic to form a control group. If the control group had fewer articles, Wir
used this number of articles and only selected the most recent articles after the pandemic began. Wenn
fewer than 10 articles were published after the start of the pandemic, we nonetheless sampled
Quantitative Science Studies
1058
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
/
.
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Tisch 1. Duration of the publication process for coronavirus-related papers, distributed over Review stage (between submission and acceptance) and Production stage
(between acceptance and publication). Data distinguishes between the period before and during the COVID-19 pandemic. All durations are given in days
Number of articles
Number of days for
publication—During pandemic
Number of days for
publication—Before pandemic
Vor
pandemic Total
19
10
Rezension
stage
127.1
Production
stage
70.1
Entire
Veröffentlichung
Verfahren
197.2
95% CI Entire
Veröffentlichung
Verfahren
162.0 232.4
Rezension
stage
122.6
Production
stage
37.9
Entire
Veröffentlichung
Verfahren
160.5
95% CI Entire
Veröffentlichung
Verfahren
107.0 214.0
Journal title
Archives of Virology
Eurosurveillance
International Journal
of Infectious
Diseases
Journal of Hospital
Infection
Journal of Medical
Virology
Journal of Virology
PLOS ONE
Wissenschaftliche Berichte
Travel Medicine
and Infectious
Krankheit
Vaccine
Veterinary
Microbiology
Virology
Virus Research
Viruses
Total
Während
pandemic
9
30
32
24
13
4
14
14
45
9
9
8
10
38
259
30
32
24
13
10
14
14
45
10
10
10
10
38
60
64
8.3
23.7
48
10.0
26
10.3
14
28
28
90
19
19
18
20
76
37.0
183.3
147.9
12.6
148.2
89.6
90.0
124.2
32.5
51.0
1.7
5.3
5.6
4.9
41.5
25.9
18.4
2.7
22.7
4.3
3.3
2.4
4.2
9.3
10.0
28.9
7.1
12.9
105.9
14.8
43.1
77.0
62.4
8.5
168.3
113.2 223.5
85.5
64.7 106.3
15.6
1.8
29.5
59.5
15.8
75.3
55.9
94.7
15.2
11.8
18.7
107.3
64.4
117.3
56.0 178.7
78.5
19.6 137.4
61.5
209.2
153.9 264.5
230.9
166.4
133.0 199.7
216.7
15.3
8.8
21.9
91.5
170.9
114.0 227.7
154.3
93.9
70.5 117.3
69.2
93.3
63.9 122.6
63.3
126.6
89.7 163.5
119.4
28.6
44.8
33.3
36.7
60.3
77.9
25.9
57.9
5.1
14.5
2.4
5.6
9.2
3.7
139.4
119.5 159.3
256.7
164.2 349.2
274.6
197.2 352.1
96.6
71.9 121.4
168.8
96.3 241.3
71.6
59.2
84.0
68.9
51.3
86.5
128.6
37.4 219.8
37.0
30.1
43.9
270
529
50.9
69.8
95.9
23.6
117.4
103.9 130.9
P
A
N
D
e
M
ich
C
P
u
B
l
ich
S
H
ich
N
G
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
.
/
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Q
u
A
N
T
ich
T
A
ich
T
ich
v
e
S
C
e
N
C
e
S
u
D
e
S
T
ich
1
0
5
9
Pandemic publishing
10 articles for the control group. For the control group, we sampled articles starting with publi-
cations in 2019 (but before October 1) and moving backwards, in order to make sure editorial
policies most closely resemble those in the pandemic. Tisch 1 presents the list of journals used,
including the number of articles sampled per journal. Information on the dates of submission,
acceptance, and publication was manually retrieved from the journal’s website. Some journals
distinguished between publication online and appearance in the print issue of the journal; für
these journals we always selected the date of online publication. Other journals, zum Beispiel
online-only journals, do not distinguish between these dates, and date of publication automat-
ically refers to online publication.
To control for potential effects specific to coronavirus-related papers, we selected, for all
journals in our sample, Die 10 most recently published articles (as of April 16, 2020) um
noncoronavirus-related content. Insbesondere, these were articles not present in our previous data
set and articles not mentioning COVID-19, coronavirus, SARS-CoV-2, or Cov-19 in their title, key-
Wörter, and abstract. All the 140 articles in this control group were published during the current
pandemic, mit 64% published in April 2020, 32% in March, 1% im Februar, Und 3% in January.
2.2. Posting of Preprints
We assessed the usage of preprint servers as a fast way of disseminating academic knowledge
by counting the number of preprints on coronavirus-related content both during and before the
current pandemic. For this we used all preprints in the database, and did not use a more nar-
row sampling strategy. Somit, we include all coronavirus-related preprints. Zusätzlich, Wir
analyzed the number of preprints that were also published as journal articles and the average
number of days between posting of the preprint and the publication of the corresponding jour-
nal article. The analysis is based on the linkage of preprints and journal articles in the
Dimensions Database (https://docs.dimensions.ai/dsl/index.html).
3. ERGEBNISSE
Figur 1 presents an overview of the number of journal articles and preprints per year in our
data set. Unsurprisingly, it shows a sharp increase for both publication types since the out-
break of the current pandemic. Jedoch, earlier pandemics, such as the SARS outbreak in
2002, are clearly visible as well.
Figur 1. The number of journal articles and preprints related to COVID-19 per year in our database.
Quantitative Science Studies
1060
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
.
/
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
Figur 2. Average duration of the publication process for coronavirus-related papers in our sample
of journals, as well as the total average over all journals (Total). Durations are given in number of days
and distinguish between the period before and during the COVID-19 pandemic. Error bars represent
Die 95% confidence interval.
Figur 2 compares the overall duration of journals’ publication processes prior to and during
the present pandemic. It demonstrates that, on average, journals have strongly increased the
speed of their processes for COVID-19 publications: The average turnaround time in our journal
sample has decreased from 117 days to 60 Tage. Comparing the 95% confidence intervals of both
statistics shows the decrease to be highly substantial and significant.
Tisch 1 presents descriptive statistics on the average duration of the publication process for
coronavirus-related articles in journals in our sample. It distinguishes between the periods before
and during the pandemic and it splits the entire publication process into the Review stage
(between submission and acceptance) and Production stage (between acceptance and publication).
Figur 3 presents a graphical overview of the average decrease in turnaround time in the
period during the crisis compared to the period prior to the pandemic. It again distinguishes
between the Review and Production stages of the publication process. Note that negative numbers
in this case indicate an increase in turnaround time. The figure indicates that the Review stage
shortens for 10 of the 14 journals in our sample, while nine journals managed to shorten their
Production stage. Average acceleration is around 50% for both stages, but it goes up to nearly
100% in some journals.
To check whether the acceleration of publication processes is specific to coronavirus-related
Papiere, we analyzed the turnaround times for noncoronavirus-related articles published since the
start of the pandemic. For all journals in our sample, we selected the 10 most recently published
articles (as of April 16, 2020) about noncoronavirus-related content. Insbesondere, these were
articles not present in our previous data set and articles not mentioning COVID-19, coronavirus,
SARS-CoV-2, or Cov-19 in their title, keywords, and abstract. For these articles we also analyzed
the turnaround times of their publication process. The results are presented in Figure 4. The figure
indicates that for most journals, articles not related to COVID-19 have very similar turnaround
times to articles published before the pandemic. Unpacking the publication process in the
Review and Production stage, we conclude that, wieder, noncoronavirus-related articles follow
a very similar pattern to articles published before the pandemic.
Quantitative Science Studies
1061
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
.
/
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
Figur 3. Relative average decrease in time spend per journal on the Review stage, Production
stage and Entire publication process in the journals of our sample, as well as for the total set of
journals (Total). Decrease is measured as the shortening of duration in the pandemic era compared
to the prepandemic era (d.h., negative values indicate an increase in duration during the pandemic
compared to the period before the pandemic).
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
.
/
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Figur 4. Average duration of the publication process for papers in our sample of journals, sowie
as the total average over all journals (Total). Durations are given for articles published before the
pandemic and articles published during the pandemic, both those related to coronaviruses and
those not related to coronaviruses. Durations are given in number of days. Error bars represent
Die 95% confidence interval.
Quantitative Science Studies
1062
Pandemic publishing
Tisch 2. Average duration of the publication process for articles that previously appeared as preprints.
Durations are given in number of days. The duration of the publication process is distributed over the
Review stage (between submission and acceptance) and Production stage (between acceptance and
Veröffentlichung). On top of the publication process, the table also indicates the average number of days
between publication of the preprint and submission of the journal article
Journal title
Journal of Virology
PLOS ONE
Wissenschaftliche Berichte
Rezension
stage
55.6
126.6
105.3
Production
stage
70.7
21.9
16.3
Entire
Veröffentlichung
Process
126.4
Time from preprint
publication to
journal submission
25.4
148.5
121.6
8.6
56.1
As a brief addition to the above analysis, we now turn our analysis towards the posting of
preprints. As was shown in Figure 1, the number of preprints on coronavirus-related content
has seen a sharp increase since the outbreak of the pandemic. At the day of sampling, 2,102
preprints were posted on seven preprint servers: SSRN Electronic Journal, bioRxiv, ChemRxiv,
JMIR Preprints, Research Square, and medRxiv. We note that even though arXiv publications
are included in the Dimensions database, they are not included in the April 4 release of the data
set we used, due to technical issues. Out of the 2,102 preprints in our data set, 129 have currently
also appeared as journal articles. Due to the small number of preprints being published as journal
articles, no statistically relevant conclusions can be drawn about the uptake of preprints in
journals. Jedoch, analyzing the average duration between the posting of the preprint and the
publication of the corresponding journal article we see a steady increase, ranging from, An
average, 137 days in 2017 to just over 200 days in 2020. Currently, we do not see any indication
of acceleration of the uptake of preprints in journals since the outbreak of the current pandemic.
Jedoch, the sample is small and these statements should be treated with caution.
Der 129 preprints were published in 68 different academic journals with only five journals
publishing at least five preprints. The three journals publishing most preprints were Journal of
Virology, PLOS ONE, and Scientific Reports, all of which are in our sample of journals used for
the previous analyses. Somit, for the preprints in these journals, we can analyze the turnaround
times of their publication process. The results are presented in Table 2.
All but one of these preprint-journal article pairs were published prior to the current pandemic.
Jedoch, on comparing the results in Tables 1 Und 2 it becomes clear that turnaround times for
articles that previously appeared as preprints are much shorter than the average turnaround times
in these journals. Tatsächlich, for these prepandemic articles, turnaround times are even shorter than
their average postpandemic counterparts.
4. DISKUSSION
To tackle the current health crisis, many have urged publishers to disseminate relevant academic
knowledge as fast as possible. Acknowledging that common publication delays in medical
journals are unacceptable in the current era, journals are expected to decrease the turnaround
times of their publication process. The results of our study indicate that some journals have indeed
managed to do so.
Our results on the average turnaround times of journal articles prior to the current pandemic
correspond well with earlier findings of studies on publication delays in medical journals (Björk &
Solomon, 2013). Jedoch, since the outbreak of the COVID-19 pandemic, medical journals
Quantitative Science Studies
1063
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
/
.
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
have managed to greatly accelerate their publication processes to make them nearly twice as fast
for coronavirus-related articles. Im Gegensatz, articles not related to coronaviruses that were pub-
lished since the beginning of the pandemic do not show any acceleration. Their turnaround times
are similar to articles published before the pandemic.
While it seems reasonable that journals might encounter difficulties in attracting reviewers
with relevant expertise—as those are probably active scientists working on novel research
themselves—the opposite seems to be the case. From our results, it seems that journals are finding
enough reviewers willing to review coronavirus-related papers at very short notice. Jedoch, Das
conclusion should be treated with caution, as no data is available on who reviewed the papers.
Maybe the same few experts reviewed a lot more than usual; maybe “relevant expertise” was
taken as a relative criterion, with journals using reviewers that usually would not have been
considered experts. The fact that noncoronavirus-related papers are published at similar speeds
during and before the pandemic seems to indicate that journals are also not facing more issues
with attracting reviewers for those papers.
As preprint articles are not being included in medical journals more quickly, it seems that either
authors are not submitting preprint articles to journals more quickly, or journals are prioritizing
content that has not appeared as preprints. Qualitative follow-up research interviewing authors
and editors on their submission and review practices regarding preprint articles could shed further
light on this.
Some of the most prominent, high-impact medical journals are not part of our sample because
they do not share all relevant data on submission, acceptance, and publication dates. Comparing
the total number of published articles in high-impact journals such as the British Medical Journal,
The Lancet, the Journal of the American Medical Association and the New England Journal of
Medicine does not give a clear indication of faster publication: These four journals published
864, 421, 351, Und 307 articles respectively in 2020, according to a Web of Science search.
Over the same period in 2019 they published 874, 497, 335, Und 334 articles respectively.
Somit, most show a small decrease in the total number of published articles. Folglich, Wenn
they managed to speed up their publication process for coronavirus-related articles, this might
have been at the expense of other content being published less, or less quickly. Jedoch, andere
factors might be at play as well, including a change in the volume of submissions during the
Covid-19 Pandemie (which could have impacted these journals in particular, as their authors
may be practitioners at the sharp end of patient care) and page budget constraints.
Even though the acceleration of journals’ publication processes is laudable from the perspective
of quick information dissemination, it also raises several questions and concerns.
Erste, one may wonder whether faster is always better. Even though the two do not necessarily
exclude each other, it seems reasonable that there is a balance, or perhaps even a trade-off, zwischen
speed and quality in peer review. At the review stage, especially, legitimate concerns can be raised
about whether speeding up the review process might harm the process’s ability to filter incorrect or
invalid findings. Such research slipping through peer review might require corrections or retractions
in the future. Given the potentially rapid uptake of medical knowledge in policy and clinical
contexts, such corrections might come too late, as potential harm might already have been done.
Commentators have raised this concern regarding the use of information in preprints, but it similarly
applies to journal articles. Tatsächlich, false information spreading through journal articles is arguably
more damaging, as it has the appearance of being “peer reviewed” and hence properly verified.
Scholars have repeatedly warned that a substantial share of articles (hastily) published during this
crisis will require future corrections (Marcus & Oransky, 2020). Formal expressions of concern about
papers used to make policy decisions have already been issued (Voss, 2020).
Quantitative Science Studies
1064
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
/
.
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
As assessing the quality of the published record or the review process was beyond the scope of
this study, the concern that faster publication processes decrease publication quality is yet to be
verified. Future research should therefore analyze whether shorter review processes during the
COVID-19 pandemic have affected the quality of the publication process and, zum Beispiel, have
led to an increase in corrections or retractions of published articles.
While acceleration of the review stage might evoke quality issues, this arguably applies less to
the production stage of the publication process. Journals’ achievements in shortening this stage of
the publication process for coronavirus-related content is entirely laudable. Jedoch, this might
raise questions about why publication delays at this stage are usually higher and whether journals
will aim and be able to maintain such standards in a postcrisis era. One potential explanation for
the shortened production stage is that publishers or journal editors now prioritize coronavirus-
related research articles at the expense of other articles. Jedoch, our data on noncoronavirus
related articles published during the pandemic seem to contradict this. It seems as though journals
are managing to speed up editorial work for coronavirus-related content while maintaining stan-
dards for other articles.
Several journals show a substantial lengthening of the production stage. This might be caused
by an increase in the number of manuscripts submitted to the respective journals. For journals
showing an increase in total turnaround time, this seems to be concentrated in the production
stage, after manuscript acceptance. As editors themselves might be practicing scientists, the over-
load of newly submitted manuscripts might be a cause of this additional delay.
This study suffers from various limitations in its analysis. Erste, it could only analyze those
journal articles that have been published. This particularly implies that it was unable to assess
the review process’s duration for rejected articles. Neither could it analyze articles that are
currently still under review.
Zweite, the analysis does not include article type as a feature of analysis. Some article types,
including letters to the editor, perspectives, or commentaries, might undergo a different kind of
peer review—they might, zum Beispiel, only be reviewed by the editor, rather than by external
reviewers. A potential difference in distribution of pre- and postcrisis articles over the various
article types might explain some of the variation in the publication process’s duration.
Dritte, our analyses focus on journals publishing relatively many coronavirus-related articles.
Due to a lack of sufficient articles in other, potentially smaller, journals, we were not able to
analyze those journals. As larger journals may more easily attract reviewers and have more
resources, and hence more capacity to shift resources to execute the production stage of publi-
cation, the resulting decrease in publication time might be less strong in smaller journals. At a later
stage, when more coronavirus-related papers appear in other journals, future research could
verify this potential difference.
Last, it should be noted that some of the journal articles assigned to our control group concern
papers related to previous health crises or pandemics, such as the MERS, Ebola or Zika crises.
Despite similar incentives to publish those articles quickly, content related to COVID-19 makes
its way through the publication process much more quickly. Future research could include a
more elaborate comparison not only between pre- and post-COVID-19 eras, but also between
publishing in the COVID-19 and other health-related crises.
In these times of crisis, the rapid dissemination of relevant academic knowledge is of para-
mount importance. Several stakeholders have already warned of a “fake news pandemic” spread-
ing disinformation and conspiracy theories through social media channels in the absence of
established scientific knowledge (Khatri, Singh, et al., 2020; UNESCO, 2020). To assist
Quantitative Science Studies
1065
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
/
.
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
policymakers and clinical experts, as well as to counter the spread of such disinformation,
researchers and academic journals have a responsibility to share available knowledge quickly.
The fact that medical journals have managed to considerably speed up their publication process
for coronavirus-related content during the current pandemic is therefore laudable. Jedoch, manche
concerns remain about whether faster dissemination might come at the expense of research
Qualität.
5. CONCLUSION
Our analysis indicates that the scholarly publishing enterprise has managed to greatly speed up
the dissemination of coronavirus-related research material since the outbreak of the pandemic. In
besondere, academic journals managed to decrease the duration of their publication process by
49%, oder 57 Tage im Durchschnitt, which is a statistically relevant difference. Some journals even show
a decrease in publication time of over 80% compared to the prepandemic era. This acceleration
concerns both the stage of review (between submission and acceptance) and the editing stage
(between acceptance and publication). The journals in our sample shortened both stages by 47%
(45 Tage) Und 61% (14 Tage) jeweils. Hence the majority of the decrease in total publication
time is due to speeding up the review process.
We also conclude that the acceleration of the publication process is specific to coronavirus-
related articles. Articles not related to COVID-19 published during the pandemic show very similar
turnaround times as articles published before the pandemic.
In addition to the fast spread of information through journal articles, the number of papers
posted on preprint servers has sharply increased. With only limited data available, such preprints
do not seem to be taken up as journal publications any quicker than they were before the
Covid-19 Pandemie. Trotzdem, articles first appearing as preprints do seem to go through
shorter publication processes than articles not appearing as preprints.
ACKNOWLEDGMENTS
The author would like to thank the Centre for Science and Technology Studies at Leiden
University for establishing the database used for this study and Digital Science for providing
access to the data. The author also thanks Ludo Waltman, Nees Jan van Eck, Marc Luwel,
Thed van Leeuwen, and the members of the Institute for Science in Society’s Research Quality
Team for valuable feedback on earlier drafts of this manuscript.
COMPETING INTERESTS
The author has no competing interests.
FUNDING INFORMATION
No funding has been received for this research.
DATA AVAILABILITY
The data analyzed for this research are available via https://github.com/CWTSLeiden/
cwts_covid.
Quantitative Science Studies
1066
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
/
.
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
Pandemic publishing
VERWEISE
Björk, B.-C., & Solomon, D. (2013). The publishing delay in scholarly
peer-reviewed journals. Journal of Informetrics, 7(4), 914–923.
https://doi.org/10.1016/j.joi.2013.09.001
Brock, J. (2020). Rapid Registered Reports initiative aims to stop coro-
navirus researchers following false leads. Nature Index. https://www.
natureindex.com/news-blog/rapid-registered-report-coronavirus-
aims-to-stop-researchers-following-false-research-leads
Colavizza, G., Costas, R., Traag, V. A., van Eck, N. J., Van Leeuwen,
T., & Waltman, L. (2020). A scientometric overview of CORD-19.
bioRxiv. https://doi.org/10.1101/2020.04.20.046144
CWTS. (2020). CWTS_Covid Database. Retrieved from: https://
github.com/CWTSLeiden/cwts_covid
Eisen, M. B., Akhmanova, A., Behrens, T. E., & Weigel, D. (2020).
Publishing in the time of COVID-19. eLife, 9, e57162. https://doi.
org/10.7554/eLife.57162
Gautret, P., Lagier, J.-C., Parola, P., Hoang, V. T., Meddeb, L., Mailhe,
M., … Raoult, D. (2020). Hydroxychloroquine and azithromycin as
a treatment of COVID-19: Results of an open-label non-randomized
clinical trial. International Journal of Antimicrobial Agents, 105949.
https://doi.org/10.1016/j.ijantimicag.2020.105949
Gunnarsdottir, K. (2005). Scientific journal publications: Auf der
role of electronic preprint exchange in the distribution of scientific
Literatur. Social Studies of Science, 35(4), 549–579.
Heimstädt, M. (2020). Between fast science and fake news:
Preprint servers are political. Retrieved from https://blogs.lse.
ac.uk/impactofsocialsciences/2020/04/03/between-fast-science-
and-fake-news-preprint-servers-are-political/
Horbach, S. P. J. M., & Halffman, W. (2018). The changing forms
and expectations of peer review. Research Integrity and Peer
Rezension, 3(1), 8. https://doi.org/10.1186/s41073-018-0051-5
Horbach, S. P. J. M., & Halffman, W. (2019). The ability of different
peer review procedures to flag problematic publications.
Scientometrics, 118(1), 339–373. https://doi.org/10.1007/s11192-
018-2969-2
Khatri, P., Singh, S. R., Belani, N. K., Yeong, Y. L., Lohan, R., …
Teo, W. Z. Y. (2020). YouTube as source of information on
2019 novel coronavirus outbreak: A cross sectional study of
English and Mandarin content. Travel Medicine and Infectious
Krankheit, 101636. https://doi.org/10.1016/j.tmaid.2020.101636
Lin, Z., Hou, S., & Wu, J. (2016). The correlation between editorial
delay and the ratio of highly cited papers in Nature, Science and
Physical Review Letters. Scientometrics, 107(3), 1457–1464. https://
doi.org/10.1007/s11192-016-1936-z
Marcus, A., & Oransky, ICH. (2020). The science of this pandemic is
moving at dangerous speeds. Wired. https://www.wired.com/story/
the-science-of-this-pandemic-is-moving-at-dangerous-speeds/
Natur. (2020). Coronavirus pandemic: Nature’s pledge to you. Natur,
579, 471–472. https://doi.org/10.1038/d41586-020-00882-z
Nguyen, V. M., Haddaway, N. R., Gutowsky, L. F. G., Wilson, A.
D. M., Gallagher, A. J., Donaldson, M. R., … Cooke, S. J. (2015).
How long is too long in contemporary peer review? Perspectives
from authors publishing in conservation biology journals. PLOS
ONE, 10(8), 20. https://doi.org/10.1371/journal.pone.0132557
Peters, D. P., & Ceci, S. J. (1982). Peer-review practices of psycho-
logical journals: The fate of published articles, submitted again.
Behavioral and Brain Sciences, 5(2), 187–195. https://doi.org/
10.1017/S0140525X00011183
Redhead, C. (2020). Scholarly publishers are working together to
maximize efficiency during COVID-19 pandemic. Retrieved from
https://oaspa.org/scholarly-publishers-working-together-during-
covid-19-pandemic/
Schmied, R. (2006). Peer review: A flawed process at the heart of sci-
ence and journals. Journal of the Royal Society of Medicine, 99(4),
178–182.
Talley, N. J. (2020). SARS-CoV-2, the medical profession, ventilator
beds, and mortality predictions: Personal reflections of an
Australian clinician. Medical Journal of Australia, 212(7), 302–303.
https://doi.org/10.5694/mja2.50579
Teplitskiy, M., Acuna, D., Elamrani-Raoult, A., Körding, K., & Evans, J.
(2018). The sociology of scientific validity: How professional
networks shape judgement in peer review. Research Policy, 47(9),
1825–1841. https://doi.org/10.1016/j.respol.2018.06.014
Thorp, H. H. (2020). Underpromise, overdeliver. Wissenschaft, 367(6485),
1405. https://doi.org/10.1126/science.abb8492
Tosi, H. (2009). It’s About Time!!!!: What to do about long delays in the
review process. Journal of Management Inquiry, 18(2), 175–178.
https://doi.org/10.1177/1056492608330468
UNESCO. (2020). During this coronavirus pandemic, ‘fake news’ is
putting lives at risk: UNESCO. Retrieved from https://news.un.
org/en/story/2020/04/1061592
Voss, A. (2020). Statement on IJAA paper. Retrieved from https://
www.isac.world/news-and-publications/official-isac-statement
Quantitative Science Studies
1067
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
/
e
D
u
Q
S
S
/
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
1
3
1
0
5
6
1
8
7
0
1
0
0
Q
S
S
_
A
_
0
0
0
7
6
P
D
.
/
F
B
j
G
u
e
S
T
T
Ö
N
0
7
S
e
P
e
M
B
e
R
2
0
2
3
