logo Idiap Research Institute        
 [BibTeX] [Marc21]
Multi-Modal Audio-Visual Event Recognition for Football Analysis
Type of publication: Conference paper
Citation: barnard:2003:NNSP
Booktitle: Proc. IEEE Workshop on Neural Networks for Signal Processing (NNSP)
Year: 2003
Month: 9
Address: Toulouse, France
Note: IDIAP-RR 03-12
Crossref: barnard:2003:idiap-03-12:
Abstract: The recognition of events within multi-modal data is a challenging problem. In this paper we focus on the recognition of events by using both audio and video data. We investigate the use of data fusion techniques in order to recognise these sequences within the framework of Hidden Markov Models (HMM) used to model audio and video data sequences. Specifically we look at the recognition of play and break sequences in football and the segmentation of football games based on these two events. Recognising relatively simple semantic events such as this is an important step towards full automatic indexing of such video material. These experiments were done using approximately 3 hours of data from two games of the Euro96 competition. We propose that modelling the audio and video streams separately for each sequence and fusing the decisions from each stream should yield an accurate and robust method of segmenting multi-modal data.
Userfields: ipdmembership={learning, vision},
Projects Idiap
Authors Barnard, Mark
Odobez, Jean-Marc
Bengio, Samy
Added by: [UNK]
Total mark: 0
  • barnard_nnsp03.pdf
  • barnard_nnsp03.ps.gz