Enhancing maritime situational awareness through multimodal fusion: insights from a real-world experiment

Wohlleben, K., Hubner, M., Markchom, T. ORCID: https://orcid.org/0000-0002-2685-0738, Boyle, J. ORCID: https://orcid.org/0000-0002-5785-8046, Ferryman, J., Veigl, S., Opitz, A., Gkamaris, A. and Bratskas, R. (2025) Enhancing maritime situational awareness through multimodal fusion: insights from a real-world experiment. In: 17th Symposium Sensor Data Fusion: Trends, Solutions and Applications, 24-26 Nov 2025, Bonn, Germany. (In Press)

Abstract/Summary

Effective maritime border surveillance is crucial. Challenges we face include irregular migration, smuggling, oil spills and the need for rapid search and rescue. Various sensing technologies, including AIS, SAR, optical and infrared sensors, as well as UAV-mounted sensors, clearly enhance maritime awareness. However, integrating their diverse outputs remains complex. Feature-level multi-modal sensor fusion is a well-known methodology for robust detection and behavior analysis. However, most research relies on simulations or isolated sensors, which limits practical insights. This study presents a controlled real-world experiment combining synchronized data from coastal ground sensors and UAV-mounted visual and infrared sensors. The recorded dataset enables the evaluation of feature-level fusion in authentic conditions. We enhance existing fusion frameworks with additional modules and assess them using operational metrics. This study contributes to our understanding of the efficacy of multi-modal fusion in complex maritime environments, while also highlighting the significant challenges involved in transitioning from simulations to controlled real-world sensor data.

Item Type	Conference or Workshop Item (Paper)
URI	https://centaur.reading.ac.uk/id/eprint/125325
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Download/View statistics	View download statistics for this item