logo Idiap Research Institute        
 [BibTeX] [Marc21]
Readback Error Detection by Automatic Speech Recognition and Understanding -- Results of HAAWAII Project for Isavia?s Enroute Airspace
Type of publication: Conference paper
Citation: Helmke_SIDS2022_2022
Publication status: Accepted
Booktitle: 11th SESAR Innovation Days
Series: 1
Volume: 1
Number: 1
Year: 2022
Month: December
Pages: 9
Organization: SESAR
Abstract: One of the crucial tasks of an air traffic controller (ATCo) is to evaluate pilot readbacks and to react in case of errors. Undetected readback errors, when not corrected by the ATCo, can have a dramatic impact on air traffic management (ATM) safety. Although they seldom occur, the benefits of even one prevented incident due to automatic readback error detection justify the efforts. The HAAWAII project uses automatic speech recognition and understanding (ASRU) to support the ATCo in this critical task. This paper presents for readback error detection approaches: a rule-based and a data-driven approach based on machine learning. The combination of both detects 81% of the readback error use cases on real-life voice recordings from Isavia’s en-route airspace. Proof-of-concept trials with six ATCos from Isavia producing artificial, but challenging readback error use cases resulted in a false alarm rate of 11% and a readback error detection rate of 80%. These results are based on Word Error Rates of 5% for ATCos and 10% for pilots, respectively.
Keywords: Air traffic control, Assistant Based Speech Recognition, machine learning, Readback Error Detection, speech recognition, speech understanding
Projects Idiap
Authors Helmke, Hartmut
Ondřej, Karel
Shetty, Shruthi
Arilíusson, Hörður
Simiganoschi, Teodor S.
Kleinert, Matthias
Ohneiser, Oliver
Ehr, heiko
Juan, Zuluaga-Gomez.
Smrz, Pavel
Added by: [UNK]
Total mark: 0
  • Helmke_SIDS2022_2022.pdf