logo Idiap Research Institute        
 [BibTeX] [Marc21]
Audio Spatio-Temporal Fingerprints for Cloudless Real-Time Hands-Free Diarization on Mobile Devices
Type of publication: Conference paper
Citation: Korchagin_HSCMA_2011
Booktitle: Proceedings of the 3rd Joint Workshop on Hands-Free Speech Communication and Microphone Arrays
Year: 2011
Month: May
Location: Edinburgh, UK
Crossref: Korchagin_Idiap-RR-08-2011:
Abstract: In this paper, we propose a new low bit rate representation of a sound field and a new method for the corresponding cloudless low delay hands-free diarization suitable for low-performance mobile devices, e.g. mobile phones. The proposed audio spatio-temporal fingerprint representation results in low bit rate (500 bytes/second), however contains complete information about continuous audio tracking of multiple acoustic sources in an open, unconstrained environment. The core of the algorithm is based on simultaneous multiple data stream processing using audio spatio-temporal fingerprint representation to cover higher level events relevant for diarization, e.g. turns, interruptions, crosstalk, speech and non-speech segments. Performance levels achieved to date on 5 hours of hand-labelled datasets have shown the feasibility of the approach at the same time as resulting in 7.58% CPU load on 1-core ultra-low-power mobile processor running at 1 GHz and low algorithmic delay of 112 ms.
Keywords: microphone arrays, mobile computing, signal processing, source coding
Projects Idiap
Authors Korchagin, Danil
Added by: [UNK]
Total mark: 0
  • Korchagin_HSCMA_2011.pdf