CONF Tafasca_ICMI_2023/IDIAP The AI4Autism Project: A Multimodal and Interdisciplinary Approach to Autism Diagnosis and Stratification Tafasca, Samy Gupta, Anshul Kojovic, Nada Gelsomini, Mirko Maillart, Thomas Papandrea, Michela Schaer, Marie Odobez, Jean-Marc Autism behavior analysis. computer vision dataset gaze detection internet of things neural networks EXTERNAL https://publications.idiap.ch/attachments/papers/2023/Tafasca_ICMI_2023.pdf PUBLIC Companion Publication of the 25th International Conference on Multimodal Interaction Paris, France ICMI '23 Companion 2023 Association for Computing Machinery 414–425 9798400703218 https://doi.org/10.1145/3610661.3616239 URL 10.1145/3610661.3616239 doi Nowadays, 1 in 36 children is diagnosed with autism spectrum disorder (ASD) according to the Centers for Disease Control and Prevention (CDC) [52], which makes this condition one of the most prevalent neurodevelopmental disorders. For children on the autism spectrum who face substantial developmental delays, the trajectory of their cognitive growth can be markedly improved by interventions if the condition is identified early. Therefore, there is a critical need for more scalable screening and diagnostic tools, as well as the need to improve phenotyping to refine estimates of ASD symptoms in children. Here, we introduce AI4Autism: a 4-year project funded by the Swiss National Science Foundation, which aims to address the needs outlined above. In this project, we examine the potential of digital sensing to provide automated measures of the extended autism phenotype. This is accomplished using multimodal techniques based on computer vision and Internet of Things sensing, for the purpose of stratifying autism subtypes in ways that would allow for precision medicine. We present an overview of our main results so far, introducing datasets and annotations that we intend to make publicly available, as well as methods and algorithms for analyzing children’s behaviors and producing an ASD diagnosis.