Analytical guidelines to increase the value of citizen science data: using eBird data to estimate species occurrence
A. Johnston, W. M. Hochachka, M. Strimas-Mackey, V. Ruiz Gutierrez, O. J. Robinson, E. T. Miller, T. Auer, S. T. Kelling, D. Fink
Abstract
Citizen science data are valuable for addressing a wide range of ecological research questions, and there has been a rapid increase in the scope and volume of data available. However, data from large-scale citizen science projects typically present a number of challenges that can inhibit robust ecological inferences. These challenges include: species bias, spatial bias, and variation in effort. To demonstrate addressing key challenges in analysing citizen science data, we use the example of estimating species distributions with data from eBird, a large semi-structured citizen science project. We estimate two widely applied metrics of species distributions: encounter rate and occupancy probability. For each metric, we assess the impact of data processing steps that either degrade or refine the data used in the analyses. We also test whether differences in model performance are maintained at different sample sizes. Model performance improved when data processing and analytical methods addressed the challenges arising from citizen science data. The largest gains in model performance were achieved with: 1) the use of complete checklists (where observers report all the species they detect and identify); and 2) the use of covariates describing variation in effort and detectability for each checklist. Occupancy models were more robust to a lack of complete checklists and effort variables. Improvements in model performance with data refinement were more evident with larger sample sizes. Here, we describe processes to refine semi-structured citizen science data to estimate species distributions. We demonstrate the value of complete checklists, which can inform the design and adaptation of citizen science projects. We also demonstrate the value of information on effort. The methods we have outlined are also likely to improve other forms of inference, and will enable researchers to conduct robust analyses and harness the vast ecological knowledge that exists within citizen science data.
02 /Specification & Classification
Click any tag to browse matching papers- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Finding the signal in the noise of Citizen Science Observations
S. Kelling, A. Johnston, … R. Guralnick·bioRxiv·May 18, 2018
- Duck, duck, goose: Benchmark bird surveys help quantify counting errors and bias in a citizen-science database
W. D. Robinson, T. A. Hallman, R. Hutchinson·bioRxiv·Dec 9, 2020
- Integrating citizen science data with expert surveys increases accuracy and spatial extent of species distribution models
O. J. Robinson, V. Ruiz-Gutierrez, … D. Fink·bioRxiv·Oct 17, 2019
- Testing the accuracy of species distribution models based on community science data
M. Velde, J. C. Cooper, H. Garrod·bioRxiv·Jan 13, 2023
- Rapid assessment of the suitability of multi-species citizen science datasets for occupancy trend analysis
M. J. O. Pocock, M. W. Logie, … T. August·bioRxiv·Oct 22, 2019
- Improving estimation of species distribution from citizen-science records using data-integration models
V. Zulian, D. A. W. Miller, G. Ferraz·bioRxiv·Apr 9, 2021