2 min readfrom Frontiers in Marine Science | New and Recent Articles

Improved Transformer-based detection of underwater plastic debris in complex environments

Our take

Accurate detection of underwater plastic debris presents a significant challenge due to image degradation, small debris size, and complex backgrounds. This study introduces an improved RF-DETR detector, leveraging frequency-aware feature reweighting and adaptive query strategies to enhance the representation of challenging features. Evaluations on the TrashCan and DeepTrash datasets demonstrate superior performance compared to established baselines, achieving notable precision and mAP scores.
Improved Transformer-based detection of underwater plastic debris in complex environments

The escalating problem of plastic pollution in our oceans demands innovative solutions, and recent advancements in artificial intelligence are offering promising avenues for mitigation. This new study, detailing an improved “RF-DETR” detector for underwater plastic debris, represents a significant step forward in addressing this challenge. As highlighted in a related piece exploring the broader application of machine learning in marine monitoring [Machine learning, eDNA and citizen science in monitoring and assessing biodiversity and invasive alien species at sea], leveraging AI allows for scalable and efficient data analysis – a necessity given the vastness of the oceanic environment. The complexities of underwater imaging, characterized by low visibility, small debris size, and intricate backgrounds, have historically hampered effective detection. This research tackles these difficulties head-on with a novel architecture incorporating frequency-aware feature reweighting and adaptive query reweighting, demonstrating a discernible improvement over existing models. Furthermore, the transfer experiment on the DeepTrash dataset underscores the potential for generalizability – a crucial aspect for deploying these systems across diverse marine environments, as methods for coral reef resilience also point to the value of imagery-based monitoring techniques [PICOGRAM - informing coral reef resilience-based management through prediction of individual coral organismal growth, recruitment, and mortality].

The reported performance metrics—93.11% precision, 86.63% F1-score, and impressive mAP scores on the TrashCan dataset—are testament to the efficacy of the proposed approach. The ability to detect even small and low-contrast debris is particularly noteworthy, as these smaller fragments often constitute a significant portion of the overall plastic load and pose a considerable threat to marine ecosystems. The researchers' focus on frequency-aware feature enhancement is a clever adaptation to the unique optical properties of underwater environments, where light scattering and absorption significantly impact image quality. The inclusion of a transfer experiment further strengthens the findings, demonstrating that the model can be adapted to detect plastic debris in different datasets, suggesting robustness and potential for wider application. While the study rightly acknowledges a favorable trade-off between detection performance and model complexity, it's important to note that real-world deployment will require further optimization for computational efficiency on resource-constrained platforms.

The significance of this research extends beyond the immediate improvement in detection accuracy. It contributes to the growing body of knowledge demonstrating the potential of AI to revolutionize ocean monitoring and conservation efforts. The ability to accurately and efficiently identify and quantify plastic debris allows for more targeted cleanup initiatives, informed policy decisions, and ultimately, a better understanding of the long-term ecological impacts of plastic pollution. Moreover, the development of robust and generalizable detection models is essential for establishing baseline data and tracking the effectiveness of remediation strategies. The questions raised regarding orca species and ecotypes [Questions about the debate around orca species vs ecotypes: How certain are we that the various ecotypes of orcas don’t interbreed? Should that even matter? Are the behavioral differences between ecotypes relevant to them possibly being distinct species?] highlight the importance of precise data collection across diverse marine life – a challenge that improved AI-powered tools like this detector can help address.

Looking ahead, the integration of this technology with autonomous underwater vehicles (AUVs) and remotely operated vehicles (ROVs) holds immense promise. Real-time detection capabilities, coupled with automated data analysis, could enable continuous monitoring of plastic accumulation hotspots and facilitate rapid response to pollution events. A crucial area for future research will be exploring the development of systems capable of differentiating between various types of plastic, as this information is vital for tailoring remediation strategies and assessing the breakdown rates of different materials. The question remains: can these advances be scaled effectively and deployed globally, ensuring that the benefits of this technological innovation reach the regions most impacted by plastic pollution?

IntroductionUnderwater plastic debris detection remains challenging in visually cluttered environments because underwater images are often severely degraded, debris instances are small, and backgrounds are complex. To address these challenges, this study develops an improved RF-DETR detector for underwater plastic debris detection.MethodsThe proposed architecture integrates an underwater frequency-aware feature reweighting module, a multi-scale frequency-aware attention module, and a query adaptive reweighting module with bounded learnable scales. These modules are designed to enhance the representation of weak-texture and low-contrast features while improving query-level localization and classification. The model was evaluated on the TrashCan dataset and further assessed through a transfer experiment on the DeepTrash dataset.ResultsOn the TrashCan dataset, the proposed detector achieved 93.11% precision, an F1-score of 86.63%, an mAP@50 of 91.84%, and an mAP@50:95 of 69.92%. In the DeepTrash transfer experiment, the TrashCan-trained checkpoint was adapted to the one-class plastic target dataset and achieved 91.67% precision, 79.00% recall, an F1-score of 84.86%, an mAP@50 of 86.23%, and an mAP@50:95 of 55.06%. Compared with representative baselines, including YOLOv11n, YOLO26n, YOLO26s, and RT-DETR, the improved RF-DETR achieved the strongest overall performance in the reported TrashCan evaluation and DeepTrash transfer experiment. Ablation results further showed that the three proposed modules performed best when used in combination.DiscussionThe results demonstrate that the proposed frequency-aware feature enhancement and adaptive query reweighting strategies improve the detection of small and low-contrast underwater debris. The transfer results also indicate promising cross-dataset generalization. Overall, the proposed method provides a favorable trade-off between detection performance and model complexity on the evaluated datasets.

Read on the original site

Open the publisher's page for the full experience

View original article