logo Idiap Research Institute        
 [BibTeX] [Marc21]
Audio Spatio-Temporal Fingerprints for Cloudless Real-Time Hands-Free Diarization on Mobile Devices
Type of publication: Idiap-RR
Citation: Korchagin_Idiap-RR-08-2011
Number: Idiap-RR-08-2011
Year: 2011
Month: 5
Institution: Idiap
Address: Martigny, Switzerland
Abstract: In this paper, we propose a new low bit rate representation of a sound field and a new method for the corresponding cloudless low delay hands-free diarization suitable for low-performance mobile devices, e.g. mobile phones. The proposed audio spatio-temporal fingerprint representation results in low bit rate (500 bytes/second), however contains complete information about continuous audio tracking of multiple acoustic sources in an open, unconstrained environment. The core of the algorithm is based on simultaneous multiple data stream processing using audio spatio-temporal fingerprint representation to cover higher level events relevant for diarization, e.g. turns, interruptions, crosstalk, speech and non-speech segments. Performance levels achieved to date on 5 hours of hand-labelled datasets have shown the feasibility of the approach at the same time as resulting in 7.58% CPU load on 1-core ultra-low-power mobile processor running at 1 GHz and low algorithmic delay of 112 ms.
Keywords: microphone arrays, mobile computing, signal processing, source coding
Projects Idiap
Authors Korchagin, Danil
Crossref by Korchagin_HSCMA_2011
Added by: [ADM]
Total mark: 0
  • Korchagin_Idiap-RR-08-2011.pdf (MD5: 3b5d085ef05f8dbdbc1b2886aa69dbce)