Audiovisual Integration with Segment Models for Tennis Video Parsing - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Computer Vision and Image Understanding Year : 2008

Audiovisual Integration with Segment Models for Tennis Video Parsing

Emmanouil Delakis
  • Function : Author
  • PersonId : 880274
Patrick Gros

Abstract

Automatic video content analysis is an emerging research subject with numerous applications to large video databases and personal video recording systems. The aim of this study is to fuse multimodal information in order to automatically parse the underlying structure of tennis broadcasts. The frame-based observation distributions of Hidden Markov Models are too strict in modeling heterogeneous audiovisual data. We propose instead the use of segmental features, of the framework of Segment Models, to overcome this limitation and extend the synchronization points to the segment boundaries. Considering each segment as a video scene, auditory and visual features collected inside the scene boundaries can thus be sampled and modeled with their native sampling rates and models. Experimental results on a corpus of 15-h tennis video demonstrated a performance superiority of Segment Models with synchronous audiovisual fusion over Hidden Markov Models. Results though with asynchronous fusion are less optimistic.

Dates and versions

inria-00568073 , version 1 (22-02-2011)

Identifiers

Cite

Emmanouil Delakis, Guillaume Gravier, Patrick Gros. Audiovisual Integration with Segment Models for Tennis Video Parsing. Computer Vision and Image Understanding, 2008, 111 (2), pp.142-154. ⟨10.1016/j.cviu.2007.09.002⟩. ⟨inria-00568073⟩
115 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More