logo Idiap Research Institute        
 [BibTeX] [Marc21]
ROXSD: The ROXANNE Multimodal and Simulated Dataset for Advancing Criminal Investigations
Type of publication: Conference paper
Citation: motlicek24_odyssey
Publication status: Accepted
Booktitle: Odyssey 2024: The Speaker and Language Recognition Workshop
Year: 2024
Month: June
Pages: 17-24
URL: https://www.isca-archive.org/o...
DOI: 10.21437/odyssey.2024-3
Abstract: The ROXANNE project, conducted under the European Union’s Horizon 2020 Programme, aimed to revolutionize criminal investigations by integrating speech, language, and video technologies with criminal network analysis. Despite the success in technology development, the project faced evaluation challenges due to the scarcity and legal restrictions surrounding real-world criminal activity datasets. In response, we introduce ROXSD, a simulated dataset of communication in organized crime. ROXSD is a set of wiretapped conversations (collected through communication service providers) between drug dealing suspects, following a realistic screenplay (incl. realistic conditions and constraints of a real investigation) prepared by Law Enforcement Agencies (LEAs). With a focus on multimodality and multilinguality, the dataset comprises 20 hours of telephone and video conversations involving 104 speakers, and is further aligned with ground-truth annotations for each modality involved, enabling precise evaluation and development of technologies. In addition, the multimodal data are enhanced with metadata and prior knowledge (e.g., suspects’ biometric profiles) which is typically available as a result of lawfully intercepted communication. This paper introduces ROXSD as a pivotal resource for advancing technology in criminal research (specifically in domain of speech, text and network analysis). ROXSD not only facilitates in the domain of technology development and evaluation but also showcases the potential of simulated datasets in advancing the field of organized crime analytics, emphasizing the importance of such datasets in the absence of comprehensive real-world alternatives.
Keywords: ROXANNE, ROXSD
Projects EC H2020-ROXANNE
TRACY
Authors Motlicek, Petr
Dikici, Erinc
Madikeri, Srikanth
Rangappa, Pradeep
Janosik, Miroslav
Backfried, Gerhard
Thomas-Aniola, Dorothea
Schurz, Maximilian
Rohdin, Johan
Schwarz, Petr
Kovac, Marek
Malý, Květoslav
Boboš, Dominik
Leibiger, Mathias
Kalogiros, Costas
Alexopoulos, Andreas
Kudenko, Daniel
Ahmadi, Zahra
Nguyen, Hoang H.
Krishnan, Aravind
Zhu, Dawei
Klakow, Dietrich
Jofre, Maria
Calderoni, Francesco
Marraud, Denis
Koutras, Nikolaos
Nikolau, Nikos
Apostiki, Christiana
Douris, Panagiotis
Gkountas, Konstantinos
Sergidou, Eleni
Bosma, Wauter
Hughues, Joshua
Team, Hellenic Police
Added by: [UNK]
Total mark: 5
Attachments
  • Motlicek_ODYSSEY-2024_2024.pdf
       (ROXSDPaper)
Notes