Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published December 21, 2022 | public
Report

The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Counting

Abstract

We present the Caltech Fish Counting Dataset (CFC), a large-scale dataset for detecting, tracking, and counting fish in sonar videos. We identify sonar videos as a rich source of data for advancing low signal-to-noise computer vision applications and tackling domain generalization in multiple-object tracking (MOT) and counting. In comparison to existing MOT and counting datasets, which are largely restricted to videos of people and vehicles in cities, CFC is sourced from a natural-world domain where targets are not easily resolvable and appearance features cannot be easily leveraged for target re-identification. With over half a million annotations in over 1,500 videos sourced from seven different sonar cameras, CFC allows researchers to train MOT and counting algorithms and evaluate generalization performance at unseen test locations. We perform extensive baseline experiments and identify key challenges and opportunities for advancing the state of the art in generalization in MOT and counting.

Additional Information

We are grateful to AWS for a gift to Trout Unlimited (TU) that supported data annotations, computational and storage costs, and to the Resnick Sustainability Institute at Caltech for funding to SB and PP. An NSF Fellowship supported SB. JK, SD, and EY volunteered their time. GVH was supported by the Macaulay Library at Cornell University. For collecting the dataset, and for feedback, encouragement, and moral support, we are grateful to: George Pess and Oleksandr Stefankiv (Northwest Fisheries Science Center); James Miller, Carl Pfisterer, Dawn Wilburn, Brandon Key, Suzanne Maxwell, Gregory Buck, April Faulkner, and Jordan Head (Alaska Department of Fish and Game); Dave Kajtaniak and Michael Sparkman (California Department of Fish and Wildlife); Dean Finnerty (TU's Wild Steelhead Project); and Keith Denton, Mike McHenry, and the Lower Elwha Klallam Tribe.

Additional details

Created:
August 20, 2023
Modified:
October 24, 2023