logo Idiap Research Institute        
 [BibTeX] [Marc21]
Automatic Temporal Alignment of AV Data with Confidence Estimation
Type of publication: Idiap-RR
Citation: Korchagin_Idiap-RR-40-2009
Number: Idiap-RR-40-2009
Year: 2009
Month: 12
Institution: Idiap
Address: CH-1920 Martigny, Switzerland
Abstract: In this paper, we propose a new approach for the automatic audio-based temporal alignment with confidence estimation of audio-visual data, recorded by different cameras, camcorders or mobile phones during social events. All recorded data is temporally aligned based on ASR-related features with a common master track, recorded by a reference camera, and the corresponding confidence of alignment is estimated. The core of the algorithm is based on perceptual time-frequency analysis with a precision of 10 ms. The results show correct alignment in 99% of cases for a real life dataset and surpass the performance of cross correlation while keeping lower system requirements.
Keywords: pattern matching, reliability estimation, time synchronisation, time-frequency analysis
Projects Idiap
TA2
Authors Korchagin, Danil
Garner, Philip N.
Dines, John
Crossref by Korchagin_ICASSP_2010
Added by: [ADM]
Total mark: 0
Attachments
  • Korchagin_Idiap-RR-40-2009.pdf (MD5: 8d1a0a5eb73efa9d4ce909bd647405b2)
Notes