Accessibility navigation


Multimodal semantic-associative collateral labelling and indexing of still images

Zhu, M. and Badii, A. (2007) Multimodal semantic-associative collateral labelling and indexing of still images. In: 2007 International Workshop on Content-Based Multimedia Indexing, Proceedings. IEEE, New York, pp. 173-180. ISBN 9781424410101

Full text not archived in this repository.

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

Abstract/Summary

A novel framework for multimodal semantic-associative collateral image labelling, aiming at associating image regions with textual keywords, is described. Both the primary image and collateral textual modalities are exploited in a cooperative and complementary fashion. The collateral content and context based knowledge is used to bias the mapping from the low-level region-based visual primitives to the high-level visual concepts defined in a visual vocabulary. We introduce the notion of collateral context, which is represented as a co-occurrence matrix, of the visual keywords, A collaborative mapping scheme is devised using statistical methods like Gaussian distribution or Euclidean distance together with collateral content and context-driven inference mechanism. Finally, we use Self Organising Maps to examine the classification and retrieval effectiveness of the proposed high-level image feature vector model which is constructed based on the image labelling results.

Item Type:Book or Report Section
Divisions:Faculty of Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
ID Code:14517
Additional Information:Proceedings Paper International Workshop on Content-Based Multimedia Indexing (CBMI 2007) JUN 25-27, 2007 Bordeaux, FRANCE
Publisher:IEEE

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation