1 min readfrom Frontiers in Marine Science | New and Recent Articles

High-accuracy fish species identification using transfer learning on vision foundation models

Our take

Citizen science initiatives are vital for large-scale monitoring of marine biodiversity, particularly in the Mediterranean Sea, a region facing significant ecological challenges. To improve the reliability of species observations from non-expert contributors, this study introduces MEDFISH101, a dataset of approximately 70,000 validated images of 101 fish species. Utilizing advanced transfer learning techniques, we developed a deep learning model, DINOv2-G, achieving a Top-1 accuracy of 94.12% in species identification.
High-accuracy fish species identification using transfer learning on vision foundation models

The Mediterranean Sea stands as a testament to marine biodiversity, yet it is also one of the most vulnerable ecosystems on the planet. As highlighted in recent discussions surrounding the complex interplay of climate change, invasive species, and habitat degradation, such as in The price of a warming sea: climate change, nonindigenous species, and their impact on Israel’s fishing economy, the challenges facing this region are manifold. In this context, the innovative application of technology in citizen science, particularly through deep learning for species identification, emerges as a crucial advancement. The recent study detailing the development of MEDFISH101, a dataset comprising 70,000 validated images for identifying 101 fish species, underscores the transformative potential of automated tools in enhancing ecological monitoring.

As non-expert participants contribute to ecological data collection, the reliability of their observations is paramount. The study's findings, particularly the efficacy of the DINOv2-G model which achieved an impressive Top-1 accuracy of 94.12%, are indicative of how cutting-edge artificial intelligence can bolster marine biodiversity monitoring. This level of accuracy not only empowers citizen scientists but also enhances the quality of data collected, allowing for more informed decision-making regarding conservation efforts. The reliance on advanced technology to assist in such critical tasks reflects a broader trend in environmental science, where collaborative efforts between professionals and the public are essential for effective monitoring and stewardship.

This shift towards integrating technology with citizen science is timely and significant. The Mediterranean ecosystem is under constant threat, and automated identification tools can help mitigate the gaps typically associated with non-expert involvement. Engaging citizens in ecological monitoring fosters a community-based approach to conservation, which is vital given the urgent need for collective action in response to environmental challenges. As noted in the article on Autonomous marine sensing, the intersection of technology and human involvement is not merely a supplementary tool but a necessary evolution in how we approach environmental data collection and analysis.

Moreover, the implications of such advancements extend beyond the Mediterranean, setting a precedent for other biodiversity monitoring initiatives worldwide. The ability to harness high-accuracy identification models could lead to similar projects in various marine ecosystems, promoting a global network of citizen scientists equipped to contribute to ecological knowledge. This democratization of data collection is crucial; it not only empowers individuals but also fosters a sense of shared responsibility for ocean stewardship. As we stand at the precipice of increased global environmental awareness, the role of technology in facilitating informed citizen engagement cannot be overstated.

Looking ahead, the challenge will be to ensure that these technologies are accessible and that the data collected through citizen science efforts are effectively utilized in conservation strategies. How will we integrate these automated tools into existing frameworks for marine management and policy-making? The collaboration between artificial intelligence and community engagement is set to redefine our approach to marine exploration and conservation. The ongoing developments in this field warrant close attention, as they may well shape the future of marine biodiversity monitoring and the collective response to the pressing threats our oceans face.

Citizen science initiatives play an important role in large-scale monitoring of marine biodiversity, engaging the public in ecological data collection and supporting long-term assessments of species distribution. The Mediterranean Sea, one of the most biodiverse yet heavily impacted marine ecosystems, faces growing pressures from climate change, invasive species, and habitat degradation. To enhance the reliability of observations contributed by non-expert participants, automated tools for species identification are becoming essential. In this study, we compile MEDFISH101, a carefully curated dataset of approximately 70,000 validated images covering 101 Mediterranean fish species. Using this resource, we developed and evaluated a series of deep learning pipelines based on transfer learning of pretrained vision foundation models to achieve accurate species recognition. Our best-performing model, DINOv2-G (self DIstillation with NO labels - Giant) trained via low rank adaptation, reached a Top-1 accuracy of 94.12%, demonstrating that current, state-of-the-art Artificial intelligence (AI) techniques can identify with high probability the correct fish species and thus robustly assist marine biodiversity monitoring. To facilitate transparency, reproducibility, and further community-driven research, a publicly accessible live demo is hosted on HuggingFace.

Read on the original site

Open the publisher's page for the full experience

View original article

Tagged with

#marine biodiversity#marine science#climate monitoring#marine life databases#in-situ monitoring#citizen science#climate change impact#ocean data#data visualization#research collaboration#research datasets#fish species identification#transfer learning#vision foundation models#species distribution#Mediterranean Sea#climate change#invasive species#habitat degradation#automated tools