Accessibility navigation

Visual sensor fusion for active security in robotic industrial environments

Robla, S., Llata, J. R., Torre-Ferrero, C., Sarabia, E. G., Becerra, V. and Oria, J. P. (2014) Visual sensor fusion for active security in robotic industrial environments. EURSASIP Journal on Advances in Signal Processing, 2014. 88. ISSN 1687-6180

Text (Open Access (Provisional PDF)) - Accepted Version
· Available under License Creative Commons Attribution.
· Please see our End User Agreement before downloading.


It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

To link to this item DOI: 10.1186/1687-6180-2014-88


This work presents a method of information fusion involving data captured by both a standard CCD camera and a ToF camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time of light information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localization. Further development of these methods will make it possible to identify objects and their position in the real world, and to use this information to prevent possible collisions between the robot and such objects.

Item Type:Article
ID Code:36795
Uncontrolled Keywords:Active security; Industrial robot; ToF and colour cameras; Information fusion


Downloads per month over past year

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation