Accessibility navigation


Enhancing maritime situational awareness through multimodal fusion: insights from a real-world experiment

Wohlleben, K., Hubner, M., Markchom, T. ORCID: https://orcid.org/0000-0002-2685-0738, Boyle, J. ORCID: https://orcid.org/0000-0002-5785-8046, Ferryman, J., Veigl, S., Opitz, A., Gkamaris, A. and Bratskas, R. (2025) Enhancing maritime situational awareness through multimodal fusion: insights from a real-world experiment. In: 17th Symposium Sensor Data Fusion: Trends, Solutions and Applications, 24-26 Nov 2025, Bonn, Germany. (In Press)

[thumbnail of 2025_17th_Symposium_Sensor_Data_Fusion_cam_ready.pdf] Text - Accepted Version
· Restricted to Repository staff only
· The Copyright of this document has not been checked yet. This may affect its availability.

1MB

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

Abstract/Summary

Effective maritime border surveillance is crucial. Challenges we face include irregular migration, smuggling, oil spills and the need for rapid search and rescue. Various sensing technologies, including AIS, SAR, optical and infrared sensors, as well as UAV-mounted sensors, clearly enhance maritime awareness. However, integrating their diverse outputs remains complex. Feature-level multi-modal sensor fusion is a well-known methodology for robust detection and behavior analysis. However, most research relies on simulations or isolated sensors, which limits practical insights. This study presents a controlled real-world experiment combining synchronized data from coastal ground sensors and UAV-mounted visual and infrared sensors. The recorded dataset enables the evaluation of feature-level fusion in authentic conditions. We enhance existing fusion frameworks with additional modules and assess them using operational metrics. This study contributes to our understanding of the efficacy of multi-modal fusion in complex maritime environments, while also highlighting the significant challenges involved in transitioning from simulations to controlled real-world sensor data.

Item Type:Conference or Workshop Item (Paper)
Refereed:Yes
Divisions:Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
ID Code:125325

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation