Improved accuracy for automated counting of a fish in baited underwater videos for stock assessment
R. Connolly, D. Fairclough, E. Jinks, E. Ditria, G. Jackson, S. Lopez-Marcano, A. Olds, K. Jinks
Abstract
The ongoing need to sustainably manage fishery resources necessitates fishery-independent monitoring of the status of fish stocks. Camera systems, particularly baited remote underwater video stations (BRUVS), are a widely-used and repeatable method for monitoring relative abundance, required for building stock assessment models. The potential for BRUVS-based monitoring is restricted, however, by the substantial costs of manual data extraction from videos. Computer vision, in particular deep learning models, are increasingly being used to automatically detect and count fish at low abundances in videos. One of the advantages of BRUVS is that bait attractants help to reliably detect species in relatively short deployments (e.g. 1 hr). The high abundances of fish attracted to BRUVS, however, make computer vision more difficult, because fish often occlude other fish. We build upon existing deep learning methods for identifying and counting a target fisheries species across a wide range of fish abundances. Using BRUVS imagery targeting a recovering fishery species, Australian snapper (Chrysophrys auratus), we tested combinations of three further mathematical steps likely to generate accurate, efficient automation: 1) varying confidence thresholds (CTs), 2) on/off use of sequential non-maximum suppression (Seq-NMS), and 3) statistical correction equations. Output from the deep learning model was accurate at very low abundances of snapper; at higher abundances, however, the model over-predicted counts by as much as 50%. The procedure providing the most accurate counts across all fish abundances, with counts either correct or within 1 to 2 of manual counts (R2 = 93.4%), used Seq-NMS, a 55% confidence threshold, and a cubic polynomial corrective equation. The optimised modelling provides an automated procedure offering an effective and efficient method for accurately identifying and counting snapper in BRUV footage. Further testing is required to ensure that automated counts of snapper remain accurate in the survey region over time, and to determine the applicability to other regions within the distributional range of this species. For monitoring stocks of fishery species more generally, the specific equations will differ but the procedure demonstrated here would help to increase the usefulness of BRUVS, while decreasing costs.
02 /Specification & Classification
Click any tag to browse matching papers- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Automating the analysis of fish abundance using object detection: optimising animal ecology with deep learning
E. Ditria, S. Lopez-Marcano, … R. Connolly·bioRxiv·Oct 16, 2019
- Length estimation of fish detected as non-occluded using a smartphone application and deep learning techniques
Y. Shibata, Y. Iwahara, … S. Kugai·bioRxiv·Mar 12, 2023
- A low-cost, long-term underwater camera trap network coupled with deep residual learning image analysis
S. M. Bilodeau, A. W. H. Schwartz, … M. R. Silman·bioRxiv·Mar 8, 2021
- Automatic detection, identification and counting of anguilliform fish using in situ acoustic camera data: development of a cross-camera morphological analysis approach
A. Le Quinio, E. De Oliveira, … F. Martignac·bioRxiv·Aug 11, 2022
- From video to encounter histories: individual identification and machine vision for salmonid capture-recapture monitoring
Konrad Karlsson·bioRxiv·Sep 4, 2026
- Deep learning for automated analysis of fish abundance: the benefits of training across multiple habitats
E. Ditria, M. Sievers, … S. Lopez-Marcano·bioRxiv·May 19, 2020