Citizen Science in Open Science
context: measuring & understanding
impacts of deeper public
participation in science
Muki Haklay, Extreme Citizen Science group
Department of Geography, UCL
Twitter: @mhaklay / @ucl_excites
• Overview of citizen science activities today across
Europe – Modes of participation; Relationships
between scientists and the public; Disciplines; and
Cultures
• Positioning citizen science within wider public
engagement – example from DITOs
• Emerging policy responses to citizen science
• Measuring & evaluating
Synopsis
• In the past decade, the awareness to citizen
science has grown rapidly
Citizen Science today
• Levels of education (esp. rise in higher education)
• Technological developments (Web, mobile
phones, broadband)
Underlying trends
>200
million
R Nial Bradshaw
Haklay, Mazumdar & Wardlaw, 2018, Citizen Science for Observing and Understanding the Earth, Earth Observation, Open Science, and Innovation
Citizen Science
Long running
Citizen Science
Ecology &
biodiversity
Meteorology Archaeology
Citizen
Cyberscience
Volunteer
computing
Volunteer
thinking
Passive
Sensing
Community
Science
Participatory
sensing
DIY Science Civic Science
Citizen Science
Long running
Citizen Science
Ecology &
biodiversity
Meteorology Archaeology
Citizen
Cyberscience
Volunteer
computing
Volunteer
thinking
Passive
Sensing
Community
Science
Participatory
sensing
DIY Science Civic Science
Biodiversity
• Innovations in what and
where information can be
capture: Sauvages de ma
rue helps identify the
distribution of wild plants
in dense urban areas.
© Audubon Cal.
Jennifer Jewett / USFWS
© WMO–No. 919
Meteorology
• Volunteers continued to
contribute observations
• Met Office WOW
approaching 15 million
• Volunteers also use
automatic weather
stations
Citizen Science
Long running
Citizen Science
Ecology &
biodiversity
Meteorology Archaeology
Citizen
Cyberscience
Volunteer
computing
Volunteer
thinking
Passive
Sensing
Community
Science
Participatory
sensing
DIY Science Civic Science
Volunteer computing
Volunteer Thinking
• In passive sensing,
participants download a
software, and sometimes
connect a sensor, to allow
for a wide network of
observation.
• Quake-Catcher provide
detailed seismographic
observations
Passive Sensing
Citizen Science
Long running
Citizen Science
Ecology &
biodiversity
Meteorology Archaeology
Citizen
Cyberscience
Volunteer
computing
Volunteer
thinking
Passive
Sensing
Community
Science
Participatory
sensing
DIY Science Civic Science
Mapping for Change
Participatory Sensing
DIY Science
Imane Baiz, CRI Paris
• Need to assemble
large data sets of
classifications
• The classifications can
only partially
automated, and need
human assistant
• Use of cognition and
crowdsourcing
Astrophysics: counting galaxies
SDSS, Galaxy Zoo; Composite: Richard Nowell & Hannah Hutchins
• Participants
discussed the
initiation of the study
• Participants
volunteered to self
experiment, with
control drawn from
other participants.
RCT: PatientsLikeMe Lithium Study
• Biomedicine developed statistical techniques to
merge results from multiple studies (meta-
analysis)
• Cochrane Crowd is a system
for the classification of
journal abstracts to assist
systematic reviews and
meta-analysis
Crowdsourcing RCT results
Geography/Anthropology:
Towards Intelligent Maps
Citizen Science in Open Science context: measuring & understanding impacts of deeper public participation in science
Gbiné, Cameroon
Haklay. 2013. Citizen Science and volunteered geographic information: Overview and typology of participation, Crowdsourcing Geographic Knowledge
POLICY AND PRACTICE
Citizen Science emergent: environment
• Prof. Jacquie McGlade, head of European
Environment Agency, 2008 (Aarhus + 10):
‘Often the best information comes from those who are
closest to it, and it is important we harness this local
knowledge if we are to tackle climate change adequately…
people are encouraged to give their own opinion on the
quality of the beach and water, to supplement the official
information.’
EEA WaterWatch
• (2012)-2014 – Citizen Science
Association
• 2013 – European Citizen Science
Association
• 2014 – Australian Citizen Science
Association
• 2017 – African & Asian Citizen
Science networks
Community of practice - associations
• Across Europe, national networks emerging
Local networks emerging
Policy awareness and impact
MEASURING & EVALUATING
64M UK population
14M view Blue Planet II
520,000 in RSPB Big Garden Birdwatch
6,500 BTO Garden Birdwatch
65 active in BioHacking & DIY Science
74,000 regular Zooniverse participants
UK Engagement Escalator
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 709443
2.1m visitors to Natural History Museum
Everyone
Passive consumption of science
Opportunistic or highly limited participation
Data collection and analysis
High engagement in DIY science
Joining volunteer computing or thinking
7 Levels of Engagement
Active consumption of science
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 709443
• Likely to be unhelpful, and
potentially damaging
interventions in citizen
science evaluation
Citizen
Science
Increasing
awareness to
environmental or
scientific issue
Producing
scientific
outputs
Achieving
temporal and
geographical
coverage
Achieving
inclusiveness
Increasing
scientific
literacy
Accessing
resources
Creating
enjoyable &
engaging
experiences
Evaluating Citizen Science goals
• Each citizen science
project is a balancing
act between the
scientific goals, scale
and depth of
engagement, benefits
to different stakeholders
- NO PROJECT CAN DO
IT ALL
A taxonomy on learning outcomes
in citizen science projects. 3 mains
categories:
1. personal development,
2. generic knowledge & skills,
3. project-specific knowledge
and skills
Source: Laure Kloetzer, University of Geneva
Public
Scientists
Policy
Makers
• Citizen Science require considerations according
to discipline, culture, type of activity, and level of
engagement
• There cannot be a “silver bullet” for evaluation, and
rigid criteria can cause harm - by excluding certain
activities, sending message to newcomers and
innovators that “there is no space for them” etc.
• Mix methods are necessary.
Evaluation: sensitivity required!
• “preregistration” model – identify goals, levels of
participation, scale and register them before a citizen
science project
• “Logic Model/Theory of Change” model – develop
several templates for citizen science projects, adapt
them for a specific project, and use for evaluation
• “Key Performance Indicators” model – project
designers set KPIs out of a set, and need to report on
them
Some possible directions
• Open
access
• 580 pages
• 31 chapters
• 121 authors
Summary
• Citizen science has historical precedents, but new
types of activities and participants. This is the result
of societal and technical trends.
• Citizen science includes a wide range of activities,
and if gaining recognition among the public and
within the area of research
• Not everyone want deep engagement, but there
are methodology for a fully participatory process
• Policy and funding awareness open up new
opportunities
Follow us:
– http://www.ucl.ac.uk/excites
– Twitter: @UCL_ExCiteS
– Blog:
http://uclexcites.wordpress.com
The work of ExCiteS is supported by EPSRC, ERC, EU
FP7, EU H2020, RGS, Esri, Forest People Program,
Forests Monitor, WRI and all the people in communities
that we’ve worked with over the years

More Related Content

PDF
Extreme Citizen Science technologies: attempting to embed values in code
PDF
Citizen science in different project
PDF
The role of learning in citizen science
PDF
Extreme Citizen Science: the socio-political potential of citizen science
PDF
Participatory [Citizen] Science
PDF
Examining the values that are embedded in the processes and technologies of p...
PDF
EEA EPA Network - Frameworks for Citizen Science - 2015
PDF
The Willing Volunteer – Incorporating Voluntary Data into National Databases
Extreme Citizen Science technologies: attempting to embed values in code
Citizen science in different project
The role of learning in citizen science
Extreme Citizen Science: the socio-political potential of citizen science
Participatory [Citizen] Science
Examining the values that are embedded in the processes and technologies of p...
EEA EPA Network - Frameworks for Citizen Science - 2015
The Willing Volunteer – Incorporating Voluntary Data into National Databases

What's hot (20)

PDF
Citizen Science & Geographical Technologies: creativity, learning, and engage...
PDF
Citizen science - theory, practice & policy workshop
PDF
Extreme Citizen Science: Current Development
PDF
Data and the City workshop 2015
PDF
Oxford Martin School talk - May 2014
PDF
Algorithmic governance in environmental information (or how technophilia shap...
PDF
Haw GIScience lost its interdisciplinary mojo?
PDF
citizen science - a brief introduction
PDF
Into the Night - Citizen Science Training day - introduction to citizen science
PDF
Into the Night - Technology for citizen science
PDF
The role of learning in community science and citizen science
PDF
#FuturePub - Citizen Science, Open Science & scientific publications
PDF
Overview of Citizen Science - Zurich November 2015
PDF
AAG 2015 - COST Energic, VGI, Citizen Science and OpenStreetMap
PPTX
Citizen science presentation
PDF
Introduction to Citizen Science and Scientific Crowdsourcing - Data Quality s...
PDF
Citizen Science as a tool to support land management in the Cairngorms Nation...
PDF
Citizen science characteristics webinar
PDF
Eye on Earth Summit - Data Revolution plenary
PPTX
What is Extreme Citizen Science? Volunteerism & Publicly Initiated Scientific...
Citizen Science & Geographical Technologies: creativity, learning, and engage...
Citizen science - theory, practice & policy workshop
Extreme Citizen Science: Current Development
Data and the City workshop 2015
Oxford Martin School talk - May 2014
Algorithmic governance in environmental information (or how technophilia shap...
Haw GIScience lost its interdisciplinary mojo?
citizen science - a brief introduction
Into the Night - Citizen Science Training day - introduction to citizen science
Into the Night - Technology for citizen science
The role of learning in community science and citizen science
#FuturePub - Citizen Science, Open Science & scientific publications
Overview of Citizen Science - Zurich November 2015
AAG 2015 - COST Energic, VGI, Citizen Science and OpenStreetMap
Citizen science presentation
Introduction to Citizen Science and Scientific Crowdsourcing - Data Quality s...
Citizen Science as a tool to support land management in the Cairngorms Nation...
Citizen science characteristics webinar
Eye on Earth Summit - Data Revolution plenary
What is Extreme Citizen Science? Volunteerism & Publicly Initiated Scientific...
Ad

Similar to Citizen Science in Open Science context: measuring & understanding impacts of deeper public participation in science (20)

PDF
Open Science and Citizen Science - researcher, participants, and institutiona...
PDF
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
PPTX
Citizen Science and Science communication
PPTX
Michael Pocock: Citizen Science Project Design
PPT
Citizen-led perspectives: bridging the gap
PPTX
Citizen Science
PDF
Citizen science, The New Enlightenment
PPTX
2015 09-30 Research Seminar
PDF
EEO/AGI-Scotland 2015: Citizen Science and GIScience - background and common ...
PDF
Using Citizen Science Projects in the Classroom
PDF
Practical Applications of Earth Science in Schools
PDF
STEM Education: Preparing Students for Future Careers
PPTX
Citizen science
PPT
Real human being
PPTX
A whirlwind tour of Citizen Science in Astronomy
PPTX
Citizen Science: An applied research designed for amateurs & volunteers - A ...
PDF
Next Generation Citizen Science
PPTX
Activities for citizen science at science centers
PPTX
SCC2013 - Citizen science - Helen Roy
PPT
Citizen science for community development
Open Science and Citizen Science - researcher, participants, and institutiona...
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
Citizen Science and Science communication
Michael Pocock: Citizen Science Project Design
Citizen-led perspectives: bridging the gap
Citizen Science
Citizen science, The New Enlightenment
2015 09-30 Research Seminar
EEO/AGI-Scotland 2015: Citizen Science and GIScience - background and common ...
Using Citizen Science Projects in the Classroom
Practical Applications of Earth Science in Schools
STEM Education: Preparing Students for Future Careers
Citizen science
Real human being
A whirlwind tour of Citizen Science in Astronomy
Citizen Science: An applied research designed for amateurs & volunteers - A ...
Next Generation Citizen Science
Activities for citizen science at science centers
SCC2013 - Citizen science - Helen Roy
Citizen science for community development
Ad

More from Muki Haklay (7)

PDF
Devising a citizen science monitoring programme for tree regeneration the upl...
PDF
The value of citizen science for environmental monitoring in Scotland
PDF
Platforms for Citizen Science - ExCiteS experience
PDF
The persistent environmental digital divide(s) -RGS-IBG 2018
PDF
Digital Geographies Working Group - citizen science - passive and assertive i...
PDF
Pecha Kucha session: multi country science programs Ecsite 2018
PDF
Building centre event "mapping for making"
Devising a citizen science monitoring programme for tree regeneration the upl...
The value of citizen science for environmental monitoring in Scotland
Platforms for Citizen Science - ExCiteS experience
The persistent environmental digital divide(s) -RGS-IBG 2018
Digital Geographies Working Group - citizen science - passive and assertive i...
Pecha Kucha session: multi country science programs Ecsite 2018
Building centre event "mapping for making"

Recently uploaded (20)

PDF
Packaging materials of fruits and vegetables
PPTX
GREEN FIELDS SCHOOL PPT ON HOLIDAY HOMEWORK
PPTX
PMR- PPT.pptx for students and doctors tt
PPTX
SCIENCE 4 Q2W5 PPT.pptx Lesson About Plnts and animals and their habitat
PPTX
Introduction to Immunology (Unit-1).pptx
PPT
Enhancing Laboratory Quality Through ISO 15189 Compliance
PPTX
Presentation1 INTRODUCTION TO ENZYMES.pptx
PDF
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
PPT
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
PPTX
Understanding the Circulatory System……..
PPTX
diabetes and its complications nephropathy neuropathy
PPTX
Toxicity Studies in Drug Development Ensuring Safety, Efficacy, and Global Co...
PPTX
HAEMATOLOGICAL DISEASES lack of red blood cells, which carry oxygen throughou...
PPT
Animal tissues, epithelial, muscle, connective, nervous tissue
PPTX
Introcution to Microbes Burton's Biology for the Health
PPT
LEC Synthetic Biology and its application.ppt
PDF
Science Form five needed shit SCIENEce so
PDF
Metabolic Acidosis. pa,oakw,llwla,wwwwqw
PPTX
Platelet disorders - thrombocytopenia.pptx
PPTX
limit test definition and all limit tests
Packaging materials of fruits and vegetables
GREEN FIELDS SCHOOL PPT ON HOLIDAY HOMEWORK
PMR- PPT.pptx for students and doctors tt
SCIENCE 4 Q2W5 PPT.pptx Lesson About Plnts and animals and their habitat
Introduction to Immunology (Unit-1).pptx
Enhancing Laboratory Quality Through ISO 15189 Compliance
Presentation1 INTRODUCTION TO ENZYMES.pptx
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
Understanding the Circulatory System……..
diabetes and its complications nephropathy neuropathy
Toxicity Studies in Drug Development Ensuring Safety, Efficacy, and Global Co...
HAEMATOLOGICAL DISEASES lack of red blood cells, which carry oxygen throughou...
Animal tissues, epithelial, muscle, connective, nervous tissue
Introcution to Microbes Burton's Biology for the Health
LEC Synthetic Biology and its application.ppt
Science Form five needed shit SCIENEce so
Metabolic Acidosis. pa,oakw,llwla,wwwwqw
Platelet disorders - thrombocytopenia.pptx
limit test definition and all limit tests

Citizen Science in Open Science context: measuring & understanding impacts of deeper public participation in science

  • 1. Citizen Science in Open Science context: measuring & understanding impacts of deeper public participation in science Muki Haklay, Extreme Citizen Science group Department of Geography, UCL Twitter: @mhaklay / @ucl_excites
  • 2. • Overview of citizen science activities today across Europe – Modes of participation; Relationships between scientists and the public; Disciplines; and Cultures • Positioning citizen science within wider public engagement – example from DITOs • Emerging policy responses to citizen science • Measuring & evaluating Synopsis
  • 3. • In the past decade, the awareness to citizen science has grown rapidly Citizen Science today
  • 4. • Levels of education (esp. rise in higher education) • Technological developments (Web, mobile phones, broadband) Underlying trends >200 million R Nial Bradshaw
  • 5. Haklay, Mazumdar & Wardlaw, 2018, Citizen Science for Observing and Understanding the Earth, Earth Observation, Open Science, and Innovation Citizen Science Long running Citizen Science Ecology & biodiversity Meteorology Archaeology Citizen Cyberscience Volunteer computing Volunteer thinking Passive Sensing Community Science Participatory sensing DIY Science Civic Science
  • 6. Citizen Science Long running Citizen Science Ecology & biodiversity Meteorology Archaeology Citizen Cyberscience Volunteer computing Volunteer thinking Passive Sensing Community Science Participatory sensing DIY Science Civic Science
  • 7. Biodiversity • Innovations in what and where information can be capture: Sauvages de ma rue helps identify the distribution of wild plants in dense urban areas.
  • 8. © Audubon Cal. Jennifer Jewett / USFWS © WMO–No. 919 Meteorology • Volunteers continued to contribute observations • Met Office WOW approaching 15 million • Volunteers also use automatic weather stations
  • 9. Citizen Science Long running Citizen Science Ecology & biodiversity Meteorology Archaeology Citizen Cyberscience Volunteer computing Volunteer thinking Passive Sensing Community Science Participatory sensing DIY Science Civic Science
  • 12. • In passive sensing, participants download a software, and sometimes connect a sensor, to allow for a wide network of observation. • Quake-Catcher provide detailed seismographic observations Passive Sensing
  • 13. Citizen Science Long running Citizen Science Ecology & biodiversity Meteorology Archaeology Citizen Cyberscience Volunteer computing Volunteer thinking Passive Sensing Community Science Participatory sensing DIY Science Civic Science
  • 16. • Need to assemble large data sets of classifications • The classifications can only partially automated, and need human assistant • Use of cognition and crowdsourcing Astrophysics: counting galaxies SDSS, Galaxy Zoo; Composite: Richard Nowell & Hannah Hutchins
  • 17. • Participants discussed the initiation of the study • Participants volunteered to self experiment, with control drawn from other participants. RCT: PatientsLikeMe Lithium Study
  • 18. • Biomedicine developed statistical techniques to merge results from multiple studies (meta- analysis) • Cochrane Crowd is a system for the classification of journal abstracts to assist systematic reviews and meta-analysis Crowdsourcing RCT results
  • 22. Haklay. 2013. Citizen Science and volunteered geographic information: Overview and typology of participation, Crowdsourcing Geographic Knowledge
  • 24. Citizen Science emergent: environment • Prof. Jacquie McGlade, head of European Environment Agency, 2008 (Aarhus + 10): ‘Often the best information comes from those who are closest to it, and it is important we harness this local knowledge if we are to tackle climate change adequately… people are encouraged to give their own opinion on the quality of the beach and water, to supplement the official information.’
  • 26. • (2012)-2014 – Citizen Science Association • 2013 – European Citizen Science Association • 2014 – Australian Citizen Science Association • 2017 – African & Asian Citizen Science networks Community of practice - associations
  • 27. • Across Europe, national networks emerging Local networks emerging
  • 30. 64M UK population 14M view Blue Planet II 520,000 in RSPB Big Garden Birdwatch 6,500 BTO Garden Birdwatch 65 active in BioHacking & DIY Science 74,000 regular Zooniverse participants UK Engagement Escalator This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 709443 2.1m visitors to Natural History Museum
  • 31. Everyone Passive consumption of science Opportunistic or highly limited participation Data collection and analysis High engagement in DIY science Joining volunteer computing or thinking 7 Levels of Engagement Active consumption of science This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 709443
  • 32. • Likely to be unhelpful, and potentially damaging interventions in citizen science evaluation
  • 33. Citizen Science Increasing awareness to environmental or scientific issue Producing scientific outputs Achieving temporal and geographical coverage Achieving inclusiveness Increasing scientific literacy Accessing resources Creating enjoyable & engaging experiences Evaluating Citizen Science goals • Each citizen science project is a balancing act between the scientific goals, scale and depth of engagement, benefits to different stakeholders - NO PROJECT CAN DO IT ALL
  • 34. A taxonomy on learning outcomes in citizen science projects. 3 mains categories: 1. personal development, 2. generic knowledge & skills, 3. project-specific knowledge and skills Source: Laure Kloetzer, University of Geneva
  • 36. • Citizen Science require considerations according to discipline, culture, type of activity, and level of engagement • There cannot be a “silver bullet” for evaluation, and rigid criteria can cause harm - by excluding certain activities, sending message to newcomers and innovators that “there is no space for them” etc. • Mix methods are necessary. Evaluation: sensitivity required!
  • 37. • “preregistration” model – identify goals, levels of participation, scale and register them before a citizen science project • “Logic Model/Theory of Change” model – develop several templates for citizen science projects, adapt them for a specific project, and use for evaluation • “Key Performance Indicators” model – project designers set KPIs out of a set, and need to report on them Some possible directions
  • 38. • Open access • 580 pages • 31 chapters • 121 authors
  • 39. Summary • Citizen science has historical precedents, but new types of activities and participants. This is the result of societal and technical trends. • Citizen science includes a wide range of activities, and if gaining recognition among the public and within the area of research • Not everyone want deep engagement, but there are methodology for a fully participatory process • Policy and funding awareness open up new opportunities
  • 40. Follow us: – http://www.ucl.ac.uk/excites – Twitter: @UCL_ExCiteS – Blog: http://uclexcites.wordpress.com The work of ExCiteS is supported by EPSRC, ERC, EU FP7, EU H2020, RGS, Esri, Forest People Program, Forests Monitor, WRI and all the people in communities that we’ve worked with over the years