The emergence of preprints: comparing publishing behaviour in the Global South and the Global North

Kristin Biesenbender (Department of Web Science, ZBW – Leibniz Information Centre for Economics, Kiel, Germany)
Nina Smirnova (Department of Knowledge Technologies for the Social Sciences, GESIS – Leibniz Institute for the Social Sciences, Cologne, Germany)
Philipp Mayr (Department of Knowledge Technologies for the Social Sciences, GESIS – Leibniz Institute for the Social Sciences, Cologne, Germany)
Isabella Peters (Department of Web Science, ZBW – Leibniz Information Centre for Economics, Kiel, Germany) (Department of Computer Science, Faculty of Engineering, University of Kiel, Kiel, Germany)

Online Information Review

ISSN: 1468-4527

Article publication date: 15 January 2024

756

Abstract

Purpose

The recent proliferation of preprints could be a way for researchers worldwide to increase the availability and visibility of their research findings. Against the background of rising publication costs caused by the increasing prevalence of article processing fees, the search for other ways to publish research results besides traditional journal publication may increase. This could be especially true for lower-income countries.

Design/methodology/approach

Therefore, the authors are interested in the experiences and attitudes towards posting and using preprints in the Global South as opposed to the Global North. To explore whether motivations and concerns about posting preprints differ, the authors adopted a mixed-methods approach, combining a quantitative survey of researchers with focus group interviews.

Findings

The authors found that respondents from the Global South were more likely to agree to adhere to policies and to emphasise that mandates could change publishing behaviour towards open access. They were also more likely to agree posting preprints has a positive impact. Respondents from the Global South and the Global North emphasised the importance of peer-reviewed research for career advancement.

Originality/value

The study has identified a wide range of experiences with and attitudes towards posting preprints among researchers in the Global South and the Global North. To the authors' knowledge, this has hardly been studied before, which is also because preprints only have emerged lately in many disciplines and countries.

Peer review

The peer review history for this article is available at: https://publons.com/publon/10.1108/OIR-04-2023-0181

Keywords

Citation

Biesenbender, K., Smirnova, N., Mayr, P. and Peters, I. (2024), "The emergence of preprints: comparing publishing behaviour in the Global South and the Global North", Online Information Review, Vol. ahead-of-print No. ahead-of-print. https://doi.org/10.1108/OIR-04-2023-0181

Publisher

:

Emerald Publishing Limited

Copyright © 2023, Kristin Biesenbender, Nina Smirnova, Philipp Mayr and Isabella Peters

License

Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


Introduction

Although “open access (OA)” and “open science (OS)” are currently “hot topics” among science policy makers and research funders (UNESCO, 2021) progress towards OA/OS varies in many countries. Publishing their research results and making them visible and accessible to the scientific community still is a major challenge for many researchers. They face problems in funding their research and article processing charges (APCs) and/or feel pressured to publish in certain journals to gain recognition and advance their careers. Not being able to publish OA hinders researchers to benefit from important advantages associated with OA publications, such as increased citation counts, enhanced visibility and accessibility (Fraser et al., 2020; Gargouri et al., 2010; Piwowar et al., 2018; Solomon et al., 2013).

OA-publishing is a broad concept, though. It comprises publishing in OA journals and via OA-repositories, which is an emerging and in terms of business models even opaque market. In some countries, for example, there are different transformative agreements with publishers or different ways of covering possible APCs for OA (Klebel and Ross-Hellauer, 2023; Schönfelder, 2018). There are APC waivers and discounts for low- and middle-income countries, but it is questionable who can benefit from this in different parts of the world (Abdul Baki and Alhaj Hussein, 2021; Momeni et al., 2023; Nabyonga-Orem et al., 2020; Smith et al., 2021). This may result in research findings not being published in different parts of the world due to lack of funding or to researchers publishing behind paywalls (Ross-Hellauer et al., 2022). The recent increase in the number of APC-based journals and the fees themselves raises the question of whether this is causing researchers to move to other publication channels that do not incur costs, such as posting preprints.

Concept of the study

Lately, preprint servers have become popular and their number has risen since 2013 (Chiarelli et al., 2019). Preprints are research papers that are often posted before submission to a journal and before peer-review to allow early availability and visibility (Penfold and Polka, 2020), often resulting in citation advantages for journal articles with preprints (Brierley et al., 2022; Fraser et al., 2020; Larivière et al., 2014). Preprint-posting is highly discipline-specific, e.g. there is a disciplinary culture of posting preprints in Physics or Economics, which Humanities lacks (Chiarelli et al., 2019). OA-publication behaviour in general is also affected by drivers internal and external to science, such as the pressure to post preprints during the Covid19-pandemic, especially in the Life Sciences (Fraser et al., 2021). There are further barriers that impede wide adoption of OA-publishing, such as researchers' concerns about lack of quality assurance or the “Ingelfinger rule”, which states that a manuscript will be considered for publication only if its contents have not yet been published elsewhere, which prevents pre-publication in a different outlet, e.g. a preprint server (Chiarelli et al., 2019; Severin et al., 2020).

Not much is known about whether the decision to post preprints varies in different regions of the world. To fill this gap, we analysed researchers' publishing strategies and conflicts with regard to posting preprints. We explored whether attitudes towards posting and citing of preprints differ between the Global South (GS) and the Global North (GN) [1]. We are aware that this classification is fraught with inaccuracies, but it allows us to compare two groups whose members are more similar within a group than between groups: Researchers from the GS and the GN. We hypothesise that both groups are distinctive in the opportunities and barriers they face in scientific publishing and the motivations and benefits for posting and referencing preprints.

Against this background, we conducted a mixed-methods-study in which we combined a quantitative online survey with in-depth focus group interviews to study international researchers' attitudes towards posting and citing preprints and to describe their overall experiences with publishing OA. We explored whether preprints as additional or alternative publishing outlets can help researchers in the GS to gain more visibility for their research and/or to achieve more impact. In this regard, motivations and concerns about posting preprints may differ between GS and GN researchers, as the need for alternative publication outlets, including free dissemination, may be particularly beneficial to GS researchers who face more barriers, as others have shown (Ross-Hellauer et al., 2022). In this paper, we will present descriptive statistics from the online survey and the results of the qualitative analysis of the focus group interviews. The following questions guided our research and will structure the presentation of results:

  1. Do researchers from the GS have different motivations and concerns for posting preprints than researchers from the GN?

  2. Do structural effects, such as research funding or author-specific characteristics, e.g. the career status of a researcher, play a role in decisions regarding preprint publication?

  3. Are there any discipline-specific differences that are shared by the GS and the GN?

Methods and data

The methodological approaches for the online survey and the focus group interviews as well as the data collection and processing are presented in detail in the next paragraphs.

Online survey

Survey participants

Our corpus of potential survey participants comprised authors of articles indexed in Scopus. The selection of research articles was restricted to the three scientific domains in which we are interested because of the institutional background and personal contacts of the authors: Oceanography, Economics, and Social Sciences. Disciplines were selected according to Scopus Subject Areas and All Science Journal Classification Codes (ASJC) [2]. We only invited corresponding authors who had publications of the document type article, published in the year 2019 and in the mentioned scientific domains. Email invitations were sent on 3rd December 2020, a follow-up was sent on 17th December 2020. Responses were collected until 18th January 2021. For all analyses, we only considered data from participants who fully completed the survey [3]. Table 1 summarises the response behaviour of survey participants.

Survey design and development

The survey design was adopted from Fraser et al. (2022) and revised for this research. Due to the length of the previous survey, we merged sections of the original survey and asked participants to consider their recent (past 5 years) publication record in scientific journals as an author, regardless of the author's degree of contribution to the paper. Additionally, free-text answer-options were included.

Data storage and processing

Collection, preprocessing, coding of survey data and statistical analysis were conducted using Python [4] versions 3.8.3 and 3.9.7. Data visualisation were produced with R [5] version 4.2.3. Free-text responses and contact email addresses were removed from the final archived dataset for securing participants' anonymity. Coding of free-text answers was carried out by the project team analogously to Fraser et al. (2022). The category “country of residence” was used to identify respondents from the GS and GN and to analyse their responses accordingly.

Focus group interviews

Design of the focus group interviews

To achieve our research goal of deepening our understanding of why and when researchers decide to post preprints, we have chosen a qualitative approach. By opting for focus group interviews, we aim to learn about researchers' publishing behaviour through the exchange of reported practices. In doing so, both the experiences with OA publication and preprints and the decision-making process as well as the reactions and assessment of the other researchers were subject to analysis. The focus group interviews took place during a two-day online workshop [6] in December 2020. International researchers from various fields attended the free workshop. On the first day, we invited talks and presentations on the impact of OA. On the second day, we organised focus group interviews to interrogate researchers about their preprint publication behaviour. We were primarily interested in the researchers' experiences with publishing preprints and OA journal articles. Second, we encouraged a discussion about citing and the dissemination of preprints on social media platforms. We later asked our interviewees about structures or conditions that would be necessary to support posting preprints [7].

Sampling for focus groups interviews

Twelve participants were recruited from a preceding survey (Fraser et al., 2022) and ten participants among the workshop registrations. We used convenience and theoretical sampling to compare the views of researchers with different career status, discipline and country of residence. Among the participants were PhD students (3), postdoctoral researchers (6) and professors (13). Nine participants had a science background and 13 were from the social sciences. They were located in 14 different countries which were allocated to the same GS/GN schema as the country of residence in the online survey. Ten participants were located in the GS including Bahrain, China, India, Iran, and Nigeria. Twelve came from the GN including Croatia, France, Italy, Norway, Portugal, Russia, Slovenia, UK, and the USA. The participants were grouped into three focus groups containing 7 to 8 researchers, half of them from the GS or the GN, respectively. Following a mixed sampling procedure, we formed two groups contrasting career status, field of expertise and country of residence, and one group in which senior researchers were the predominant subjects. Participants received 50€ as compensation for their time.

Data collection

The online-focus group interviews were recorded. The three groups were moderated by researchers from the project team following a structured guideline. The interviews (387 min) were manually transcribed by the project team and analysed via “Grounded Theory” (Strauss and Corbin, 1999; Strübing, 2018). Exploring the data through purposive coding, focussing the analysis on different manifestations of publishing behaviour that recur in the data and that led to general categories, using MAXQDA and interpreting the data against the background of respondents' demographic information led to a deeper understanding of publishing behaviour in relation to preprints and journal articles. These criteria of researchers that promote or hinder the transition from traditional to OA publication were elaborated by one person during the coding process.

Results

Findings from the online survey

Demographics of survey participants

The following describes the responses in the first part of the survey to questions about country of residence, career stage, gender, discipline, and institution type for researchers in Economics, Social Sciences, and Oceanography. Figure 1 shows the top 10 countries by total participants and is divided into sections corresponding with the disciplines and world regions examined in the study. In total, 40 countries were represented for Economics in the GS and 42 from the GN, 39 and 38 for the Social Sciences, and 33 and 34 for Oceanography.

Some general trends were observed among survey participants from all three disciplines. Participants from the GN are mostly located in the USA and European countries, such as Germany, Italy, France and Spain. Most participants from the GS indicated India as their country of residence. Indonesia is the second most frequent country for researchers from Social Sciences and Economics. At the same time, China is the second most frequent country for researchers from Oceanography. Participants from both world regions are primarily male and university is the prevailing institution type for all disciplines in both regions (more than 50% of participants).

There are minor differences among participants regarding the category “career stage”. In countries from the GN postdoctoral researcher is the prevalent career stage for Oceanography, while for Economics and Social Sciences the dominant career stage is professor. In the GS quite the opposite is true: professor is the prevalent career stage for Oceanography and assistant professor is the most frequent career stage for Economics and Social Sciences. Since across disciplines the majority of survey participants stem from countries of the GN.

Publishing behaviour

Participants were asked to report the number of articles published in peer-reviewed scientific journals for the past 5 years and the relative amount (all, some, or none) of those articles deposited as preprints. Figure 2 shows the results for Economics, Social Sciences, and Oceanography in either GN or GS respectively.

Similar publication patterns were found for Economics and Social Sciences both in the GN and the GS - the most frequent category for both scientific domains was 6–10 publications (31% (GN) and 33% (GS) for Economics and 31% (GN) and 32% (GS) for Social Sciences). For Oceanography the most frequent number of publications was 11–20 articles (30%) in the GN and more than 21 articles in the GS (34%). With regard to depositing preprints, a similar pattern can be traced for Social Sciences and Oceanography. More than half of the participants from Oceanography reported that none of the articles was deposited as a preprint (58% of participants from the GS, 62% from the GN). For Social Sciences approximately half of the participants said they deposited some or all of their articles as a preprint (49% of participants from the GS and 47% from the GN), and half of the participants said they deposited none of their articles as a preprint. For Economics a majority of the participants answered that some or all of their articles were also deposited as a preprint (54% of participants from the GS and 56% from the GN).

What motivates researchers to post preprints?

Survey participants who had deposited all or some of their recent journal articles as preprints were offered to answer questions specifically related to preprint posting behaviour. Results show answers to survey questions on a 5-point Likert scale. As in Fraser et al. (2022) questions covered three main focus areas: decision-making (who was responsible for the decision to deposit a preprint) (Figure 3), motivating factors (what internal/external factors made the authors want to deposit a preprint) (Figure 4), “and the benefits received in terms of article citation/online impact” (Figure 5). As Figure 3 demonstrates, participants mostly reported that the decision to deposit their articles as preprints was the free decision of the authors and was not to comply with the funding agency’s open-access policies. For all three disciplines, except for Oceanography in the GS, a higher percentage of participants reported that it was themselves to suggest depositing articles as a preprint. For Oceanography in the GS, approximately an even proportion of participants reported that themselves or their co-authors suggested depositing the article as a preprint. Generally, more participants from the GS agreed that the decision to deposit articles as a preprint was to comply with an institutional and funding agency’s open access policy, while the GN showed an opposite trend.

In the next group of questions, participants were asked about their motivations for posting preprints (see Figure 4). Questions were adopted from Fraser et al. (2022) and comprised five themes: to increase awareness of their work, to claim priority over results, to benefit the scientific enterprise, to increase the amount of feedback received, or to increase rate of dissemination. Generally, across the three disciplines, participants marked all these factors as motivations for depositing preprints. The strongest motivation for researchers from Economics in the GN and in the GS was to increase awareness of the author’s research. The strongest motivator for researchers from Oceanography and Social Sciences (both from the GN and the GS) was to share the author’s findings more quickly.

The last questions of this survey section are concerned with the benefits of depositing preprints (Figure 5). For all disciplines, more participants agreed than disagreed that depositing preprints had positive benefits in terms of citation and online dissemination, and also can support the researcher’s career. However, regional differences can be observed. Thus, for all disciplines, a greater percentage of participants from the GS expressed agreement with the proposed benefits of posting preprints than those from the GN. Generally, benefits in terms of citations and online dissemination were the main reasons for depositing preprints for all disciplines - except for Oceanography, where more participants agreed that posting preprints is beneficial for career development.

Why do some authors not deposit preprints?

This section investigates factors that lead authors to not deposit articles as preprints. Survey participants who reported that some or none of their recent journal articles were deposited as preprints were offered to answer the questions that focused specifically on demotivators for depositing articles as preprints. Results for the survey questions are shown in Figure 6. As in the previous section, results show answers to survey questions on a 5-point Likert scale. In accordance with Fraser et al. (2022) participants mainly disagreed with the reasons proposed in the survey. For all disciplines, except for researchers from Economics in the GN, the main reasons for authors to not deposit articles as preprints was unawareness of the preprint option. Economists from the GN were the largest group of respondents to state that they did not want to deposit these articles as preprints.

Additionally, participants were given the possibility to expand on their answers for this section or add further reasoning in a free-text area. Questions covered three main topics: differences between articles deposited and not deposited as a preprint, additional reasons to deposit an article as a preprint, and not to deposit an article as a preprint. Overall differences in preprint posting behaviour are in line with the predefined survey answers described above. Nevertheless, some new trends were also observed. In some cases, articles were deposited as a preprint when difficulties during the review process arose or when articles were rejected. On the other hand, articles were not deposited as a preprint when the review process was expected to be fast or when an article was expected to change significantly during the review process. Motivations and doubts concerning preprint posting also mostly matched the predefined survey answers, although new issues were also mentioned. Participants indicated extra labour and lack of time as a reason to not deposit an article as a preprint. Another reason against preprint posting was the peer-review process. For example, authors did not publish un-reviewed work, as the peer-review process improves articles significantly and is very quick in some journals.

We conducted a Chi-square test of independence to determine whether there is a statistically significant relationship between the world region (GN or GS) and participants' gender, discipline, career status and preprint posting behaviour. As Table 2 demonstrates, the p-Value for all variable pairs is less than 0.05, which indicates that the relation between these variables is significant.

Findings from focus group interviews

First of all, our analysis revealed that experiences and personal assessments of OA vary strongly among participants. Generally speaking, respondents gave two different types of answers for their experiences with posting preprints and OA publishing: they made either more general comments about how researchers deal with OA publishing and which factors are decisive for their publication decisions or they reported on their personal experiences with OA publishing. It should be noted that all respondents had personal experience with publishing OA in general, while about half of the respondents have personal experience with posting preprints. Among participants from the GS, five out of ten respondents had no experience with preprint publishing, compared to seven out of twelve in the GN. The detailed results are summarised in the following according to the major themes of the interview structure.

Experiences with publishing OA - especially preprints

When asked about their experiences with OA publishing, participants from the GS indicated that they deposit their results to increase the dissemination and visibility of their work and increase the impact in terms of citations. It was stressed that in the past, there were very few OA journals and it was difficult to get results published there, but now there are more options to publish OA. Some participants did not intend to publish their results in outlets where they were unsure if the impact would be high. It was rather emphasised that it is more prestigious to publish articles in journals. To some extent, those could be OA journals, but there was also concern that the impact factor for OA journals is not very high. Other respondents noted that articles in OA journals were very successfully cited as represented on Google Scholar, Web of Science, and Scopus. In terms of visibility, it seemed crucial for participants from the GS that publications in OA journals are indexed in these databases. In addition, it was pointed out that posting preprints had the advantage of accumulating more citations. Participants from the GS saw an advantage in posting preprints because it allows them to get feedback from colleagues or even a wider audience. Accordingly, they said they receive more comments from viewers or other authors and they consider those comments before publishing the final version. Some preprint servers provide a DOI so that it is possible to formally cite the preprints, claim ideas, and secure priority for own research.

[…] prefer to publish the manuscripts in OA journals. Because it is very important for the University to have higher visibility and to be able to get a higher h-index, as you know h-index is fully related to the visibility of the papers or manuscripts. (transcript-01, pos. 26, respondent A7, GS) [8]

I also have similar experience in publishing with OA articles and also preprints. So those papers get more citations, because of their availability. And these papers are more accessible, they get more citations [ …] (transcript-01, pos. 142, respondent A5, GS)

Participants from the GN reported on different experiences with publishing OA journal articles and preprints. For example, leading journals are not fully OA, but there are OA journals with quite good impact factors. It was pointed out that OA publishing offers transparent processes by engaging feedback. Some participants from the GN were interested in openly depositing their research results on preprint servers to make them more readily available. Other respondents expressed reservations. For example, they see no advantages in rapid publication processes, which is why they prefer to wait for a completed publication in an OA journal. In this context, participants from the GN also frequently and incoherently referred to quality issues: some were satisfied with the quality of the peer review process through OA journals, others were very concerned. In this sense, some expressed caution because preprints are not the final form of publishing work, nevertheless they are an early step before official publication. It was stated that funding agencies also accept preprints as valid outputs.

[…] the primary reasons were to be seen. The people knew that I was working on this. Speed. Journals are taking six months to a year to get things in print and send out. (transcript-03, pos. 3, respondent C1, GN)

But to my understanding at least preprint is not the ultimate way of publishing a work, but rather an early step before you have the full publication. So it's not that you publish it as a preprint and that's it, but you publish sort of at an early stage [ …] (transcript-01, pos. 41 respondent A4, GN)

Decision making regarding posting preprints

Regarding the decision whether to post a preprint or publish OA in general, the statements of all participants, regardless of whether they are from the GS or the GN, were more related to concrete situations. Participants from both world regions indicated consistently that their publishing decisions depend on recommendations from colleagues and co-authors, and less frequently on institutional guidelines. The vast majority of the respondents said that they decide together with their co-authors where to publish - often on a case-to-case basis.

In this regard, participants from the GS commented as follows: For some respondents, the decision to post a preprint depends on the time until publication, e.g. waiting two or three months to publish a journal article is fine, but a year is too long. This was supported in the sense that only for this reason, the release of a preprint is accepted. In general, subject-specific preprint servers were preferred as this increases the likelihood of colleagues seeing the papers and providing feedback. Regarding the so-called ‘Ingelfinger rule’, respondents indicated that more and more journals are accepting submissions with earlier preprint versions, although some still prohibit this.

Participants from the GN highlighted different aspects of preprint and OA publishing: Regarding the ‘Ingelfinger rule’, it was noted that journals such as Nature, Science and Society Journals have changed their policies and now accept papers previously published on a preprint server. It was noted that research funds generally have rules for OA journal publications, but not yet for preprint publication. In general, the publication of preprints needs to be cultivated in order to catch on.

So I believe, although it is an argument between all different authors of a manuscript, all of the authors are controlled by, let us say, institutional laws that direct us to a specific type of journals. (transcript-01, pos. 59, respondent A7, GS)

I asked my colleagues what their opinion was and nobody was against publishing a preprint. So we decided together. (transcript-01, pos. 53, respondent A3, GN)

Role of peer pressure and mandates

Asked about the role of peer pressure and mandates when deciding to post preprints or publishing OA in general, for respondents from the GS and the GN policies, funding and career status are considered decisive factors that influence OA publication behaviour. In the case of India, respondents indicated that funding agencies mandate publishing in Indian OA journals, but there is limited funding for APCs in international OA journals. Other interviewees from the GS noted that funding agencies require annual progress reports in terms of the number of publications and the impact factor of journals. In the case of India, there is a list of journals that has been approved by the University Grants Commission. So there is a mandate to publish in certain journals that count for promotion. It was emphasised that posting preprints is therefore an obstacle, especially for young researchers who have yet to build their careers. In contrast, one respondent stressed how important it is for young researchers to publish OA articles in order to make their research results available to a wider audience.

[…] if I am not an established scholar, researchers hardly pay attention to my work that gets published in OA journals or even the preprint. But if I am an accepted researcher, a scholar, it does not matter where I publish. (transcript-02, pos. 56, respondent B7, GS)

Important for young researchers to publish OA to disseminate research to a wider audience. If you find articles open in Google Scholar they are more likely to be cited [ …] (transcript-02, pos. 58, respondent B3, GS)

Some respondents from the GN indicated that researchers are encouraged to publish OA, but that it is mostly articles in closed access journals that are used to evaluate research and individuals. Researchers would need publications in particular journals to achieve tenure, reappointment or promotion, which is very important but also varies greatly from institution to institution. Along the same lines, it was noted that national research organisations require publications in high quality journals. It was also stated that the pressure to publish in high quality journals is particularly high during early career periods. In the case of the EU, respondents from the GN noted that EU funding requires OA, but there is no pressure to post preprints. In contrast, in Mathematics, submission to a preprint server is de facto mandatory as a means to speed up dissemination of results due to the extremely long publication time spans. It was noted that in Education, preprints are not known in the US. In Norway, there is sufficient funding and support for OA via funds and read-and-publish-deals.

Who might want to get a permanent post at some point, it is even more important and not necessarily the open access aspect of that. (transcript-01, pos. 79, respondent A4, GN)

[…] the level of institution that you work for and the type of requirements that they have for publications through tenure, reappointment and promotion, that drives a lot [ …] (transcript-03, pos. 23, respondent C4, GN)

Preprint citing behaviour

Participants from the GS mentioned various criteria for assessing the quality of preprints, e.g. considering the reputation of the author, the quality of the content or the database such as institutional repositories. It was noted that it would help adding metrics to preprints such as the number of likes, reshares or comments, and also sharing research data, that would help to decide whether to cite a preprint or not. It was noted that one should always cite the official journal version of a preprint if available. Cases were mentioned where it makes sense to cite preprints, such as research on politically controversial topics that can only be found in preprints, or when there is a lack of research.

Maybe we should wait and because we all need respect the peer review process and if the paper have been accepted. […] And I would like to cite the official version of a preprint. (transcript-03, pos.69, respondent C3, GS)

Actually we cite mostly working papers and policy briefs, which is not published in journal but in institutional repositories. So those are being cited in our articles, in our reports. (transcript-01, pos. 113, respondent A5, GS)

Some respondents from the GN stated that citing preprints is possible if it is the only accessible version and the quality is good. Some others noted that they check authors' names to assess quality. This argument was reinforced by stating that researchers are able to assess the quality of preprints as experienced reviewers. Same as respondents from the GS, respondents from the GN mentioned exceptional cases where they cite preprints, e.g. when preprints are the only available source. Preprints are also preferred when it comes to current topics and the latest findings on issues that a researcher is dealing with.

But principally, no, I have no problem with working papers and unpublished papers, conference proceedings and so on. If it is of good quality, if the people are good of the institution, a trustworthy repository it is trustworthy. (transcript-03, pos. 75, respondent C2, GN)

I really like citing preprints, especially when it is on hot topics. New information just out a few weeks ago […] find the latest evidence related to the research question I am tackling. (transcript-03, pos. 80, respondent C5, GN)

Open science movement and future development

Respondents from the GS claimed that the publishing system should change, for example with regard to a greater awareness of the possibilities of preprint posting and OA publishing in general, ensuring quality controls for different formats of OA publishing, and no payments for authors to enable OA publishing. One respondent indicated that research evaluation would have an influence on the future of preprints. In this context, it was stressed that the community does not see any benefits in posting preprints yet, as the evaluation of research is only based on journal publications. Therefore, it would be helpful to show evidence and best practices to reach people and share one’s knowledge. One respondent showed full commitment with a new paradigm of open science, pointing out that there is no other way than posting preprints in the future. It was stated that it could be helpful to post preprints on a preprint server to receive feedback and develop the article further before submitting it to a journal.

Primarily to make people aware that preprints are the one of the best ways to reach out to the people, and it is instantaneously available as soon as you submit to it. (transcript-03, pos. 141, respondent C6, GS)

So if they know and if they do, I think many more researchers willing to share their papers, their research, their findings on the preprint databases because they know that preprints could help them to boost their citations, could help them to get some interesting feedbacks before going to print and many things else. (transcript-03, pos. 148, respondent C7, GS)

Respondents from the GN placed importance on the process of quality control. It was noted that there is no better way to ensure quality than through peer review and that a rapid publication process is not helpful. Another participant stated that results are only published on preprint servers when the author considers it ready, and raised the question of whether this is the future of scientific publishing. In addition, it was pointed out that there is a shift from pre-publication to post-publication peer review. When there is only a post-publication review, everybody is aware of the limitations. But not only the scientific community, but also a wider audience needs to be aware of these limits. It was noted that in addition to preprints, further information on the scientific data, content, author and co-authors could be provided to increase the value of a preprint. Another issue related to quality is the pressure to publish. The scientific system is geared towards faster science, where almost every researcher is interested in publishing as many articles as possible in order to have the fastest career. This pressure to publish can lead to more accessible outlets.

[…] I guess you can also put in place some minimum level of quality control for preprints, but I guess then you end up with something which is similar to open access. Or this transparent open access process. (transcript-01, pos. 183, respondent A4, GN)

Because we also kind of are responsible for this system, because we are responsible for a fact that we want to have as many articles as possible, to have the fastest career as possible, we are responsible for pushing our students to publish also, because it is part of the PhD, it is part of everything. (transcript-01, pos. 204, respondent A2, GN)

Summary of the results

Almost every second survey participant has already deposited a preprint before its official publication in a journal. Differences in preprint posting behaviour between GS and GN countries could be observed for researchers from Economics from the GN, where most participants indicated that they have deposited some of their articles as preprints, while most participants from the GS have not deposited any articles as preprints. When comparing the responses to some and all, slight differences could be observed between the disciplines, but not for the two world regions. For Economics, the majority of respondents indicated that they publish some or all articles as preprints. In the Social Sciences, about half of the respondents said that they post preprints of some or all articles. More than half of all responding oceanographers do not post any preprint. In the focus group interviews, about half of the respondents in the GS said they had experience with preprint posting. An overview of the results of the survey and the interviews is summarised in Table 3.

Discussion

Minor interdisciplinary and regional differences were found in the motivations for posting preprints. Overall, the main motivations for depositing an article as a preprint were to increase awareness of the author’s research and to disseminate their findings more quickly, which is in line with Fraser et al. (2022). Most participants agreed that depositing preprints has positive benefits in terms of online dissemination and increase of citation rates which is consistent with findings from previous studies (Brierley et al., 2022; Fraser et al., 2020; Larivière et al., 2014). It could be observed that a greater percentage of participants from the GS expressed agreement with the proposed benefits of posting preprints than those from the GN. The motivations and benefits mentioned above, can be confirmed by the assessments of the focus group participants. In addition, respondents from the GS indicated that the posting of preprints has the advantage of receiving feedback to improve earlier versions of the articles. Respondents from the GN pointed to the long duration of journal publication processes and therefore suggested preprints as the first step before official publication in a journal, which is in line with the findings of Penfold and Polka (2020). Given these overall positive expectations of researchers in the various disciplines, there seems to be an opportunity to establish alternative forms of publication in disciplines such as life sciences (Fraser et al., 2021). However, this requires overcoming concerns and barriers, which seems inconceivable without reforming research evaluation criteria (CoARA, 2022).

All survey participants disagree with the proposed reasons for not posting preprints. The main reason given, except by economists from the GN, was ignorance towards a preprint posting option. Other reasons frequently agreed upon were that journals do not allow the posting of preprints or that a preprint should not be viewed before official publication. In the free-text responses, additional work and lack of time were also mentioned as reasons. Most findings are in line with Fraser et al. (2022). In addition, the free-text responses and the focus groups emphasise that so far it has often been a case-by-case and rather pragmatic decision for posting preprints. Respondents from the GS emphasised that posting preprints does not count for career advancement. Respondents from the GN stressed that peer review is essential for the recognised quality of results. Researchers' concerns about lack of quality assurance or the “Ingelfinger rule” were also observed by Chiarelli et al. (2019) and Severin et al. (2020).

There was a consensus in the surveys that posting preprints is a free decision of the author. Focus group participants confirmed this by further stating that there are also recommendations from colleagues, co-authors or even institutional guidelines that often influence decisions. They also pointed out that co-authors collectively decide where to publish. In the survey, participants from the GS were more likely to agree with the statement that it was necessary to comply with an institution’s or funder’s OA policy, while participants from the GN were more likely to disagree with this statement. Respondents to the focus group interviews from both the GS and the GN pointed out that the “Ingelfinger rule” has become less important, a concern that was further emphasised in the study by Chiarelli et al. (2019). Respondents from the GS also emphasised that they prefer subject-specific preprint servers to receive targeted feedback from colleagues. With regard to OA journal publishing, they pointed to limited funding for international OA journals, journal lists and rankings that dictate where to publish. Inequalities in funding were also observed by various other studies (Ross-Hellauer, 2022; Ross-Hellauer et al., 2022). Respondents from the GN indicated that research organisations also require high impact journals, which remain important for promotion, tenure and funding. Similarly, research funders often mandate OA publications but do not support the publication of preprints in particular.

Conclusions

The main differences between respondents from the GS and the GN could be observed in terms of compliance with institutional OA policies or funder mandates, where GS respondents more likely agreed to comply with policies, and stressed that mandates could change publishing behaviour towards OA. In addition, a greater percentage of participants from the GS expressed agreement with the proposed benefits of posting preprints than those from the GN. The chi-squared test showed that there are statistically significant differences between the Global South and Global North regions for all categories examined. Both GS and GN respondents stressed the importance of peer-reviewed research articles - preferably in high impact journals - for career advancement, while controversially debating the relevance/usefulness of preprints in this regard. Therefore, the participants concluded that the advantages of preprint posting, which are already seen by researchers today, will only slowly change publishing behaviour. For this to happen, the scientific reputation system requires a fundamental reform (CoARA, 2022), despite the system’s well-known inertia. At this point, it must also be mentioned that the existing literature is insufficient in terms of recognising and rewarding the promotion of open science, especially for early career researchers. Joint efforts must be made to address this in the context of research and reform. Preprint posting is still a fairly recent phenomenon in many disciplines and only a certain proportion of researchers are aware of this publishing option. This may change in the future, which is why further research is needed, for example on the opportunities and barriers of preprint posting. Moreover, the studies were conducted at an early stage of the Covid19-pandemic, which is now cited as a possible major cause of the change in preprint posting behaviour (Fraser et al., 2021).

Some other limitations of our study should be mentioned. Our findings are based on a convenience sample, combined with self-selection of participants in both survey and focus groups. As the majority of survey respondents in the three disciplines are from GN countries, our dataset is biased. Therefore, further efforts are needed to involve more GS researchers in these studies to obtain a more valid picture, e.g. by using different databases to extract contact information of authors. Nevertheless, our initial findings suggest that the differences in motivation and presumed benefits of preprint publication are not too different between researchers from the two world regions. Also, the assignment of countries to the Global South and North, e.g. with regard to the development that some countries are undergoing, is fundamentally difficult and must always be reviewed. In addition, only three disciplines with very different scope and methods were included, but it already showed a broad spectrum of views on OA and preprints. Focus group interviews have typical problems such as a limited number of participants and views which poses limits to the generalisability of the results. However, we leveraged the strengths of focus group interviews to receive a breadth of valuable insights. With regard to differences between different regions, it would also be necessary for future studies to consider the self-image of researchers against the background of their institutions. Overall, the emergence of preprints is a relatively new phenomenon in many disciplines and countries which calls for further studies to follow up on how publishing behaviour changes when the relevance of open access publications increases.

Figures

Country of residence of survey participants for top 10 countries

Figure 1

Country of residence of survey participants for top 10 countries

Publishing behaviour of survey participants over the past 5 years

Figure 2

Publishing behaviour of survey participants over the past 5 years

Decision-making for depositing preprints

Figure 3

Decision-making for depositing preprints

Motivations for depositing preprints

Figure 4

Motivations for depositing preprints

Benefits of depositing preprints on article impact

Figure 5

Benefits of depositing preprints on article impact

Reasons that survey participants did not deposit articles as preprints

Figure 6

Reasons that survey participants did not deposit articles as preprints

Overview of response behaviour

DisciplineTotal email invitationsSurvey responses
Incomplete responsesFull responsesTotal responsesDrop-out rateResponse rate
Economics19,6921967109060.220.04
Social sciences17,8002017889890.200.04
Oceanography16,2511213574780.250.02

Chi-square test of independence of region and participants' discipline, gender, career status and preprint posting behaviour

VariablesChi-squarep-valuedegrees of freedom
Region – Discipline460.573<0.001350
Region – Gender27.473<0.0013
Region – Career status78.351<0.00118
Region – Publishing behaviour (Figure 2)22.447<0.00111
Region – Decision-making (Figure 3)106.102<0.00124
Region – Motivations (Figure 4)74.573<0.00124
Region – Benefits (Figure 5)67.285<0.00114
Region – Demotivations (Figure 6)336.552<0.00189

Summary of research findings from survey and focus group interviews grouped by answers from researchers from the Global South and the Global North

Global SouthGlobal North
SurveyFocus group interviewsSurveyFocus group interviews
Preprint posting behaviourEconomics: a majority say they post SOME (35%) or ALL (19%) articles as preprints before publication
Social Sciences: about half say they publish SOME (33%) or ALL (14%) in advance or NONE (53%), respectively
Oceanography: more than half indicate NONE (58%)
Five out of ten respondents have no experience with preprint postingEconomics: a majority say they post SOME (44%) or ALL (21%) articles as preprints before publication
Social Sciences: about half say they publish SOME (39%) or ALL (12%) in advance or NONE (49%), respectively
Oceanography: more than half indicate NONE (62%)
Seven out of twelve respondents have no experience with preprint posting
Motivations/benefitsEconomics: strongest motivation to increase awareness (76%) and second to share findings more quickly (75%)
Social Sciences and Oceanography: the other way round
Economics, Social Sciences, Oceanography: benefits in terms of citations (62%, 58%, 31%) and online dissemination (61%, 62%, 24%)
A greater percentage of participants from the GS expressed agreement with the proposed benefits of posting preprints than those from the GN
Increase the dissemination and visibility of their work
Increase the impact of citation
Feedback as an advantage of posting preprints
Use of social media to increase awareness and promotion for findings
Economics: strongest motivation to increase awareness (83%) and second to share findings more quickly (81%)
Social Sciences and Oceanography: the other way round
Economics and Social Sciences: benefits in terms of citations (51%, 41%) and online dissemination (49%, 45%)
Oceanography: benefits in terms of online dissemination (49%) (majority neutral about benefits in terms of citations)
A smaller percentage of participants from the GN expressed agreement with the proposed benefits of posting preprints than those from the GS
Visibility and transparency
Speed of publication: long duration of journal publication process
Preprints as an early step before official publication
Use of social media to increase awareness and promotion for findings
Concerns/barriersParticipants mainly disagreed with reasons proposed
Main reason: unawareness of the preprint option
Other reasons frequently agreed with: unwillingness to deposit articles as preprints; journals do not allow; preprint should not be seen before publishing
Extra labour and lack of time as reasons (free-text answers)
Posting preprints does not count for career advancement
Always cite official journal version
Participants mainly disagreed with reasons proposed
Main reasons: unawareness of the preprint option and unwillingness to deposit articles as preprints
Other reasons frequently agreed with: journals do not allow; preprint should not be seen before publishing
Extra labour and lack of time as reasons (free-text answers)
Quality issues: peer review is essential
APCs: pay to publish Citing preprints: only available version
Structural and author-specific effectsPreprint posting mostly free decision of the author(s)
More agreement with the statement that it was necessary to comply with an institutional or funders OA policy
Mostly agreed that preprints were deposited to benefit career development
Recommendations from colleagues, co-authors, or institutional guidelines
Deciding together
Ingelfinger rule less important
Preference of subject databases
Limited funding for APCs in international OA journals
Journal lists (impact)
High impact and indexing are important for career development which posting preprints cannot provide
Preprint posting mostly free decision of the author(s)
More disagreement with the statement that it was necessary to comply with an institutional or funders OA policy
More balanced about the suggestion that preprints were deposited to benefit career development
Recommendations from colleagues, co-authors, or institutional guidelines
Deciding together
Ingelfinger rule less important
Rankings lead to high impact journals
Research organisations require high impact journals
Impact is essential for promotion, tenure, funding
Research funds require OA, but do not support preprint posting in particular

Notes

1.

The countries were assigned to the GS and GN regions according to UNCTADstat's grouping of countries. Developing countries essentially include Africa, Latin America and the Caribbean, as well as Asian countries without Japan. Developed economies essentially include North America and Europe, Israel, Japan, Australia and New Zealand. See United Nations Conference on Trade and Development, https://unctadstat.unctad.org/EN/Classifications.html.

3.

The survey data can be found here: https://github.com/kalawinka/OASE.

7.

The guideline for the focus group interviews and further information on the methodological implementation can be found here: https://doi.org/10.26092/elib/2335.

8.

All quotations can be found in the transcripts, including the transcript number and position in the transcript in the Qualiservice dataset: Biesenbender, Kristin; Mayr, Philipp; Peters, Isabella (2023): Open Access, Preprints and Research Impact (OASE): Transcripts from Focus Group Interviews. Qualiservice, PANGAEA, https://doi.org/10.1594/PANGAEA.960919. The transcripts are available via Email to info@qualiservice.org (Subject: OASE Dataset 2023).

In the interest of transparency, data sharing and reproducibility, the author(s) of this article have made the data underlying their research openly available. It can be accessed by following the link here:

References

Abdul Baki, M.-N. and Alhaj Hussein, M. (2021), “The impact of article processing charge waiver on conducting research in low-income countries”, Conflict and Health, Vol. 15 No. 1, 75, doi: 10.1186/s13031-021-00413-1.

Brierley, L., Nanni, F., Polka, J.K., Dey, G., Pálfy, M., Fraser, N. and Coates, J.A. (2022), “Tracking changes between preprint posting and journal publication during a pandemic”, PLOS Biology, Vol. 20 No. 2, e3001285, doi: 10.1371/journal.pbio.3001285.

Chiarelli, A., Johnson, R., Pinfield, S. and Richens, E. (2019), “Preprints and scholarly communication: an Exploratory qualitative study of adoption, practices, drivers and barriers”, F1000Research, Vol. 8, p. 971, doi: 10.12688/f1000research.19619.2.

CoARA (2022), “CoARA - coalition for advancing research assessment”, CoARA, available at: https://coara.eu/ (accessed 21 December 2022).

Fraser, N., Momeni, F., Mayr, P. and Peters, I. (2020), “The relationship between bioRxiv preprints, citations and altmetrics”, Quantitative Science Studies, Vol. 1 No. 2, pp. 618-638, doi: 10.1162/qss_a_00043.

Fraser, N., Brierley, L., Dey, G., Polka, J.K., Pálfy, M., Nanni, F. and Coates, J.A. (2021), “The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape”, PLOS Biology, Vol. 19 No. 4, e3000959, doi: 10.1371/journal.pbio.3000959.

Fraser, N., Mayr, P. and Peters, I. (2022), “Motivations, concerns and selection biases when posting preprints: a survey of bioRxiv authors”, PLoS One, Vol. 17 No. 11, e0274441, doi: 10.1371/journal.pone.0274441.

Gargouri, Y., Hajjem, C., Larivière, V., Gingras, Y., Carr, L., Brody, T. and Harnad, S. (2010), “Self-selected or mandated, open access increases citation impact for higher quality research”, PLoS One, Vol. 5 No. 10, e13636, doi: 10.1371/journal.pone.0013636.

Klebel, T. and Ross-Hellauer, T. (2023), “The APC-Barrier and its effect on stratification in open access publishing”, Quantitative Science Studies, Vol. 4, pp. 1-28, doi: 10.1162/qss_a_00245.

Larivière, V., Sugimoto, C.R., Macaluso, B., Milojević, S., Cronin, B. and Thelwall, M. (2014), “arXiv E-prints and the journal of record: an analysis of roles and relationships”, Journal of the Association for Information Science and Technology, Vol. 65 No. 6, pp. 1157-1169, doi: 10.1002/asi.23044.

Momeni, F., Dietze, S., Mayr, P., Biesenbender, K. and Peters, I. (2023), “Which factors are associated with open access publishing? A springer nature case study”, Quantitative Science Studies, Vol. 4 No. 2, pp. 1-26, doi: 10.1162/qss_a_00253.

Nabyonga-Orem, J., Asamani, J.A., Nyirenda, T. and Abimbola, S. (2020), “Article processing charges are stalling the progress of African researchers: a call for urgent reforms”, BMJ Global Health, BMJ Specialist Journals, Vol. 5 No. 9, e003650, doi: 10.1136/bmjgh-2020-003650.

Penfold, N.C. and Polka, J.K. (2020), “Technical and social issues influencing the adoption of preprints in the life sciences”, PLOS Genetics, Vol. 16, p. 4, doi: 10.1371/journal.pgen.1008565.

Piwowar, H., Priem, J., Larivière, V., Alperin, J.P., Matthias, L., Norlander, B., Farley, A., West, J. and Haustein, S. (2018), “The state of OA: a large-scale analysis of the prevalence and impact of open access articles”, PeerJ, Vol. 6, e4375, doi: 10.7717/peerj.4375.

Ross-Hellauer, T. (2022), “Open science, done wrong, will compound inequities”, Nature, Vol. 603 No. 7901, p. 363, doi: 10.1038/d41586-022-00724-0.

Ross-Hellauer, T., Reichmann, S., Cole, N.L., Fessl, A., Klebel, T. and Pontika, N. (2022), “Dynamics of cumulative advantage and threats to equity in open science: a scoping review”, Royal Society Open Science, Vol. 9 No. 1, 211032, Royal Society, doi: 10.1098/rsos.211032.

Schönfelder, N. (2018), “APCs—mirroring the impact factor or legacy of the subscription-based model?”, working Paper, Bielefeld University.

Severin, A., Egger, M., Eve, M.P. and Hürlimann, D. (2020), “Discipline-specific open access publishing practices and barriers to change: an evidence-based review”, F1000Research, 26 March, doi: 10.12688/f1000research.17328.2.

Smith, A.C., Merz, L., Borden, J.B., Gulick, C.K., Kshirsagar, A.R. and Bruna, E.M. (2021), “Assessing the effect of article processing charges on the geographic diversity of authors using Elsevier's ‘Mirror Journal’ system”, Quantitative Science Studies, Vol. 2 No. 4, pp. 1123-1143, doi: 10.1162/qss_a_00157.

Solomon, D.J., Laakso, M. and Björk, B.-C. (2013), “A longitudinal comparison of citation rates and growth among open access journals”, Journal of Informetrics, Vol. 7 No. 3, pp. 642-650, doi: 10.1016/j.joi.2013.03.008.

Strauss, A.L. and Corbin, J. (1999), Grounded Theory Grundlagen Qualitativer Sozialforschung, Unveränd. Nachdr, der letzten Aufl., 1996, Beltz, Psychologie Verl.-Union, Weinheim.

Strübing, J. (2018), “Grounded Theory: Methodische und methodologische Grundlagen”, in Pentzold, C., Bischof, A. and Heise, N. (Eds), Praxis Grounded Theory: Theoriegenerierendes empirisches Forschen in medienbezogenen Lebenswelten. Ein Lehr- und Arbeitsbuch, Springer Fachmedien, Wiesbaden, pp. 27-52, doi: 10.1007/978-3-658-15999-3_2.

UNESCO (2021), “UNESCO recommendation on open science”, available at: https://unesdoc.unesco.org/ark:/48223/pf0000379949.locale=en (accessed 26 April 2022).

Acknowledgements

This work is funded by the German Federal Ministry of Education and Research (BMBF) project Open Access Effects – The Influence of Structural and Author-specific Factors on the Impact of OA (OASE), grant numbers 16PU17005A and 16PU17005B. Nina Smirnova received funding from DAAD–UGC Project-based Personnel Exchange Programme (PPP 2022), DAAD project number: 57608852 (SEASON project) and Deutsche Forschungsgemeinschaft (DFG) under grant number: MA 3964/7-2 (POLLUX project).

The authors thank all respondents for their helpful insights and Nicholas Fraser for managing the previous online survey among bioRxiv authors and the OASE online conference “Open access, preprints and research impact”.

Corresponding author

Kristin Biesenbender can be contacted at: k.biesenbender@zbw-online.eu

Related articles