Secrets to Changing
Behavior in Scholarly
Communication
A 2025 NISO Training Series
Session One
About Center for Open Science
Non-profit organization, founded in 2013
Mission: Increase the openness, integrity, and reproducibility of
research.
Purpose: Changing the culture of scholarship
Strategy: Take a systems approach to culture change
Systems Approach to Research Culture Change
COS Theory of Change
Make it Required
Make it Normative
Make it Possible
Make it Rewarding
Make it Easy
4
Diffusion of Innovations; Rogers, 1963
2.5% 13.5% 34% 34% 16%
Innovators Early
adopters
Early majority Late majority Laggards
INTERVENTION #1
REGISTERED REPORTS
IMPACT
● Study of published findings found
that they most could not be
replicated.
● Headlines of a crisis
● Indication of bias in publication,
among other gaps
● Call for change in research practices
https://www.nature.com/articles/nature.2015.18248
6
INTERVENTION
● Infrastructure: Make it possible for
authors to submit research for peer
review before collecting data
● User experience: Make it easy by
streamlining it within the article
submission process
● Incentives: Align the incentives of
publication with the values of the
researchers by focusing on the
research question and study design
and not the results
Source: https://www.cos.io/initiatives/registered-reports
7
MARKETING
● Coordinated effort to conduct outreach to
journals to gain early adopters to make it
possible
● Educational campaigns to encourage
adoption
● Align funding with publication through special
issues and funding proposal calls
● Provide resources, training, and webinars
Source: https://osf.io/3wct2/wiki/Journal%20Responses/
8
INTERVENTION #2
PREREGISTRATION
IMPACT
● More replication studies done across
disciplines
● MORE Headlines of a crisis
● Call for change in research practices
● Prevent publication bias, p-hacking,
and lack of trust in science
● Increase rigor, transparency, and
reproducibility of research
https://www.nature.com/articles/nature.2015.18248
10
INTERVENTION
● Infrastructure: Make it possible
● User experience: Make it easy
by
● Incentives: Align the incentives
Source: https://www.cos.io/initiatives/prereg
11
MARKETING
● Building off of the crisis to offer solutions
● Made it competitive with a Preregistration
Challenge to get Idealists to try it
● Awareness campaigns and community
story-telling
● Provide room for feedback and iteration
● Community grassroots and advocacy efforts
● Partnerships to publish (Registered Reports)
and try out as policy (funders)
Source: https://www.cos.io/blog/preregistration-plan-not-prison and https://www.cos.io/blog/prereg-for-research-communities
12
CONCLUSIONS
Are there any SECRETS to changing behavior in Scholarly Communication?
● It has to be possible to do the new practice or behavior
● Must be easy to start doing something new; otherwise won’t do it or sustain it
● Communities are access points for driving change
● People need to know what’s in it for them
● Some will do it kicking and screaming
Interventions are a way to identify one or more of these secrets
and tap into them to catalyze change
Get in Touch!
Want to learn more?
Nici@cos.io
Cos.io
OSF.io
0000-0001-8335-6018

Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NISO Training Series, Session One"

  • 1.
    Secrets to Changing Behaviorin Scholarly Communication A 2025 NISO Training Series Session One
  • 2.
    About Center forOpen Science Non-profit organization, founded in 2013 Mission: Increase the openness, integrity, and reproducibility of research. Purpose: Changing the culture of scholarship Strategy: Take a systems approach to culture change
  • 3.
    Systems Approach toResearch Culture Change COS Theory of Change Make it Required Make it Normative Make it Possible Make it Rewarding Make it Easy
  • 4.
    4 Diffusion of Innovations;Rogers, 1963 2.5% 13.5% 34% 34% 16% Innovators Early adopters Early majority Late majority Laggards
  • 5.
  • 6.
    IMPACT ● Study ofpublished findings found that they most could not be replicated. ● Headlines of a crisis ● Indication of bias in publication, among other gaps ● Call for change in research practices https://www.nature.com/articles/nature.2015.18248 6
  • 7.
    INTERVENTION ● Infrastructure: Makeit possible for authors to submit research for peer review before collecting data ● User experience: Make it easy by streamlining it within the article submission process ● Incentives: Align the incentives of publication with the values of the researchers by focusing on the research question and study design and not the results Source: https://www.cos.io/initiatives/registered-reports 7
  • 8.
    MARKETING ● Coordinated effortto conduct outreach to journals to gain early adopters to make it possible ● Educational campaigns to encourage adoption ● Align funding with publication through special issues and funding proposal calls ● Provide resources, training, and webinars Source: https://osf.io/3wct2/wiki/Journal%20Responses/ 8
  • 9.
  • 10.
    IMPACT ● More replicationstudies done across disciplines ● MORE Headlines of a crisis ● Call for change in research practices ● Prevent publication bias, p-hacking, and lack of trust in science ● Increase rigor, transparency, and reproducibility of research https://www.nature.com/articles/nature.2015.18248 10
  • 11.
    INTERVENTION ● Infrastructure: Makeit possible ● User experience: Make it easy by ● Incentives: Align the incentives Source: https://www.cos.io/initiatives/prereg 11
  • 12.
    MARKETING ● Building offof the crisis to offer solutions ● Made it competitive with a Preregistration Challenge to get Idealists to try it ● Awareness campaigns and community story-telling ● Provide room for feedback and iteration ● Community grassroots and advocacy efforts ● Partnerships to publish (Registered Reports) and try out as policy (funders) Source: https://www.cos.io/blog/preregistration-plan-not-prison and https://www.cos.io/blog/prereg-for-research-communities 12
  • 13.
    CONCLUSIONS Are there anySECRETS to changing behavior in Scholarly Communication? ● It has to be possible to do the new practice or behavior ● Must be easy to start doing something new; otherwise won’t do it or sustain it ● Communities are access points for driving change ● People need to know what’s in it for them ● Some will do it kicking and screaming Interventions are a way to identify one or more of these secrets and tap into them to catalyze change
  • 14.
    Get in Touch! Wantto learn more? [email protected] Cos.io OSF.io 0000-0001-8335-6018