Keywords:
- Age prediction
- Aho-Corasick algorithm
- Alzheimer's disease
- ASR
- ASR robustness
- Author profiling
- Automatic Depression Detection
- automatic speech recognition (ASR)
- Bag OF Words
- Benchmark
- Benchmarking
- BERT
- BERTopic
- bias
- bias aware
- bias word error rate
- Clinical Interviews
- Computational linguistics
- contact-center speech
- Contextual Adaptation
- contextual ASR
- Contextual Entrepreneurship
- Contextualisation and adaptation of ASR
- conversational agents
- conversational AI
- conversational hallucination
- Cross-modal Alignment
- Cross-modal Attentio
- Cross-modal Attention
- Data Mining
- Data Selection
- dataset
- deep learning
- deep learning models
- Depression Corpora
- depression detection
- dialogue evaluation
- dialogue flow
- dialogue simulation
- digital mental health
- domain adaptation
- Domain Classification
- Dual mode encoder
- Early Risk Detection
- embedding
- entity-aware evaluation
- Etrepreneurial Challenges
- explainability
- F1 score
- fact checking
- factual reporting
- finite-state transducers
- flow-aware metrics
- Foundation Models
- Gender prediction
- GPU decoding
- Graph Convolutional Network (GCN)
- Graph Convolutional Networks
- Graph Neural Networks
- hallucination
- hallucination detection
- health care
- Human-Computer Interaction
- Industry Context
- information verification
- Intelligent Systems
- Intent Classification
- Inter-pretable Models
- Interpretability
- Interpretable Models
- knowledge distillation
- language identification
- Language Production
- Large Language Models
- limited training data
- LLM
- LLM evaluation
- LLM-based ASR
- Location prediction
- low-resource
- low-resource domains
- machine learning
- media bias
- Medical Sector
- Mental Health
- Mental Lexicon
- Mexican Tourist Text
- Multi-modal Approach
- multimodal analysis
- Multimodal classification
- multitask learning
- multitask training
- Nahuatl and Spanish utterances
- named entity recognition
- Natural language processing
- Natural Language Understanding
- news media
- node weighted graphs
- Occupation prediction
- online speech recognition
- Operant Motive Test
- orchestration
- personas
- procedural hallucination
- procedural similarity
- prompt projection
- pseudo-labelling
- Psycholinguistics
- Raw Speech
- real-time ASR
- real-time speech recognition
- Recommendation System
- reinforcement learning
- reliability estimation
- reproducibility
- resources and evaluation
- scenario management
- self-supervised learning
- Sentiment Analysis
- Service Robots
- Sexual predators identification
- shallow fusion
- slot filling
- social media analysis
- Speaker change detection
- speaker turn detection
- speech recognition
- Speech-to-LLM alignment
- speech-to-text alignment
- spoken dialogue systems
- Spoken Language Understanding
- streaming ASR
- streaming transducer
- Supervised Autoencoders
- synthetic dialogue
- task-oriented dialogue
- Text Analysis
- Text classification
- text denoising
- Text fine-tuning
- Text Information Organization Schemes
- Text Mining
- Text Representation
- topic detection
- topic modeling
- topic modelling
- transformer transducer
- transformers
- whisper
- Word Consensus Networks
- Word-Confusion-Networks
- XLSR
- XLSR-Transducer
- Zipformer
Publications of Esaú Villatoro-Tello sorted by journal and type
Publications of type Idiap-RR
2020
| Idiap Submission to Swiss-German Language Detection Shared Task, , , , and , Idiap-RR-11-2020 |
|
Cognitive Computation
| Applying Attention-Based Models for Detecting Cognitive Processes and Mental Health Conditions, , , and , in: Cognitive Computation:18, 2021 |
[DOI] [URL] |
Cognitive Systems Research
| A lexical-availability-based framework from short communications for automatic personality identification, , , , and , in: Cognitive Systems Research, 79:126-137, 2023 |
[DOI] [URL] |
In Journal of Computación y Sistemas (CyS)
| Author Profiling in Social Media with Multimodal Information., , , and , in: In Journal of Computacion y Sistemas (CyS), 24(3), 2020 |
[URL] |
Journal of Research in Computing Science
| Analysis of Vector Representations in Maintenance Logs in the Industry: Towards an Information Retrieval System, , , and , in: Journal of Research in Computing Science, 2021 |
| Topic analysis and tracking from Mexico's President daily press briefing, , and , in: Journal of Research in Computing Science, 2021 |
|
Mathematics
| Natural Language Understanding for Navigation of Service Robots in Low-Resource Domains and Languages: Scenarios in Spanish and Nahuatl, , , , and , in: Mathematics, 12(8), 2024 |
[DOI] [URL] |
The Prague Bulletin of Mathematical Linguistics
| Inferring Highly-dense Representations for Clustering Broadcast Media Content, , , and , in: The Prague Bulletin of Mathematical Linguistics, 2020 |
[URL] |
Publications of type Book
2023
| Intelligent Technologies: Concepts, Applications, and Future Directions, Volume 2, and , Springer, volume 1098, 2023 |
[DOI] |
2022
| Natural Language Processing in Healthcare, , , , and , Taylor & Francis Groups, 2022 |
[DOI] [URL] |
Intelligent Technologies: Concepts, Applications, and Future Directions. Studies in Computational Intelligence (2022)
| Classifying the Social Media Author Profile Through a Multimodal Representation, , , and , in: Intelligent Technologies: Concepts, Applications, and Future Directions. Studies in Computational Intelligence, Springer, 2022 |
[DOI] [URL] |
IEEE Spoken Language Technology 2026 (2026)
| Abstract Compression of Conversational Audio Context for LLM-based ASR, , , , , , , , , and , in: IEEE Spoken Language Technology 2026, 2026 |
[URL] |
INTERSPEECH 2026 (2026)
| Avoiding Catastrophic Forgetting in Text-Only Adaptation of LLM-based ASR via Multi-View Text Denoising, , , , , , , , and , in: INTERSPEECH 2026, 2026 |
|
| Closing the Speech-Text Gap with Limited Audio for Effective Domain Adaptation in LLM-Based ASR, , , , , , , , , , , and , in: INTERSPEECH 2026, 2026 |
|
| Context Projector: Complementary Keyword and Dialogue Context Embeddings for LLM-based ASR, , , , , , , , , , and , in: INTERSPEECH 2026, 2026 |
|
IEEE Spoken Language Technology 2026 (2026)
| How to Leverage Synthetic Speech for LLM-Based ASR Systems?, , , , , , , , , , , and , in: IEEE Spoken Language Technology 2026, 2026 |
[URL] |
Text, Speech, and Dialogue. TSD 2026. Lecture Notes in Computer Science (2026)
| Modelling Thematic Structure in Clinical Dialogues for Interpretable Depression Detection, , , , , , and , in: Text, Speech, and Dialogue. TSD 2026. Lecture Notes in Computer Science, 2026 |
[DOI] [URL] |
IEEE SLT (2026)
| No Audio, No Transcripts, No Problem: LLM-based ASR Adaptation Using Only Domain Documents, , , , , , , and , in: IEEE SLT, 2026 |
|
ICASSP 2026 (2026)
| Reducing Prompt Sensitivity in LLM-based Speech Recognition Through Learnable Projection, , , , , , , , , and , in: ICASSP 2026, 2026 |
|
EACL (2026)
| SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation, , , , , , , , , and , in: EACL, 2026 |
|
ICASSP (2026)
| Text-only adaptation in LLM-based ASR through text denoising, , , , , , , , , , and , in: ICASSP, 2026 |
|
LREC 2026 (2026)
| When Consistency Becomes Bias: Interviewer Effects in Semi-Structured Clinical Interviews, , , , , , and , in: LREC 2026, Palma de Mallorca, Spain, ELRA Language Resource Association, 2026 |
[DOI] [URL] |
IEEE Spoken Language Technology 2026 (2026)
| When Synthetic Speech Is All You Have: Better Call GRPO, , , , , , , and , in: IEEE Spoken Language Technology 2026, 2026 |
[URL] |
Interspeech 2025 (2025)
| Better Semi-supervised Learning for Multi-domain ASR Through Incremental Retraining and Data Filtering, , , , , , , , , , , , and , in: Interspeech 2025, Rotterdam, The Netherlands, pages 3618--3622, 2025 |
[DOI] [URL] |
Proc. Interspeech (2025)
| Efficient Data Selection for Domain Adaptation of ASR Using Pseudo-Labels and Multi-Stage Filtering, , , , , , , , , , , , and , in: Proc. Interspeech, 2025 |
|
SALMA Workshop, Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2025)
| Performance Evaluation of SLAM-ASR: The Good, the Bad, the Ugly, and the Way Forward, , , , , , , , , and , in: SALMA Workshop, Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Hyderabad, India, IEEE, 2025 |
[URL] |
2025 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025) (2025)
| Speech Data Selection for Efficient ASR Fine-Tuning using Domain Classifier and Pseudo-Label Filtering, , , , , , , , , , , and , in: 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025), 2025 |
[DOI] [URL] |
Academy of Management Proceedings 2025. (2025)
| The Greatest Challenge For Startups: Computational Text Analysis on Swiss Ventures, , , , and , in: Academy of Management Proceedings 2025., 2025 |
[URL] |
2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) (2025)
| TokenVerse++: Towards Flexible Multitask Learning with Dynamic Task Activation, , , , , , , , , , and , in: 2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), IEEE, 2025 |
|
Text, Speech, and Dialogue. TSD 2025. Lecture Notes in Computer Science, Springer (2025)
| Unifying Global and Near-Context Biasing in a Single Trie Pass., , , , , , , , , , , and , in: Text, Speech, and Dialogue. TSD 2025. Lecture Notes in Computer Science, Springer, Springer, 2025 |
[DOI] [URL] |
Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2025)
| XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models, , , , , , , and , in: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Hyderabad, India, IEEE, 2025 |
[DOI] [URL] |
Proceedings of the 6th Clinical Natural Language Processing Workshop (2024)
| DAIC-WOZ: On the Validity of Using the Therapist's prompts in Automatic Depression Detection from Clinical Interviews, , , , , and , in: Proceedings of the 6th Clinical Natural Language Processing Workshop, Mexico City, Mexico, pages 82–90, Association for Computational Linguistics, 2024 |
[DOI] [URL] |
Findings of the Association for Computational Linguistics: EMNLP 2024 (2024)
| Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper, , , , , , , , and , in: Findings of the Association for Computational Linguistics: EMNLP 2024, pages 16747–16762, Association for Computational Linguistics (ACL), 2024 |
[DOI] [URL] |
Proceedings of the 15th International Conference of the CLEF Association: Experimental IR Meets Multilinguality, Multimodality, and Interaction (2024)
| Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions, , , and , in: Proceedings of the 15th International Conference of the CLEF Association: Experimental IR Meets Multilinguality, Multimodality, and Interaction, Grenoble, France, pages 127-138, Springer Nature Switzerland, 2024 |
[DOI] [URL] |
Proceedings of the 49th IEEE International Conference on Acoustics, Speech, & Signal Processing (ICASSP) 2024 (2024)
| Multitask Speech Recognition and Speaker Change Detection for Unknown Number of Speakers, , , , , , , and , in: Proceedings of the 49th IEEE International Conference on Acoustics, Speech, & Signal Processing (ICASSP) 2024, Seoul, Republic of Korea, pages 12592-12596, IEEE, 2024 |
[DOI] [URL] |
| Probability-Aware Word-Confusion-Network-to-Text Alignment Approach for Intent Classification, , , , , , , and , in: Proceedings of the 49th IEEE International Conference on Acoustics, Speech, & Signal Processing (ICASSP) 2024, Seoul, Republic of Korea, pages 12617-12621, IEEE, 2024 |
[DOI] [URL] |
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (2024)
| Reliability Estimation of News Media Sources: Birds of a Feather Flock Together, , , and , in: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Mexico City, Mexico, pages 6900–6918, Association for Computational Linguistics, 2024 |
[DOI] [URL] |
Memorias De Las JAIIO (2024)
| Temporal fine-tuning for early risk detection, , , and , in: Memorias De Las JAIIO, Argentina, pages 137-149, 2024 |
[URL] |
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (2024)
| TokenVerse: Towards Unifying Speech and NLP Tasks via Transducer-based ASR, , , , , , , , and , in: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 20988–20995, Association for Computational Linguistics (ACL), 2024 |
[DOI] [URL] |
Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (2023)
| Effectiveness of Text, Acoustic, and Lattice-based representations in Spoken Language Understanding tasks, , , , , , , , and , in: Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing, 2023 |
|
Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2023), CEUR Workshop Proceedings (2023)
| Enhancing Multi-modal Classification of Violent Events using Image Captioning, , and , in: Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2023), CEUR Workshop Proceedings, Jaén, Spain, 2023 |
[URL] |
Proc. Interspeech 2023 (2023)
| Implementing contextual biasing in GPU decoder for online ASR, , , , , , and , in: Proc. Interspeech 2023, pages 4494--4498, 2023 |
[DOI] [URL] |
Proceedings of Interspeech (2023)
| Node-weighted Graph Convolutional Network for Depression Detection in Transcribed Clinical Interviews, , , and , in: Proceedings of Interspeech, 2023 |
|
Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (2022)
| Expanded Lattice Embeddings for Spoken Document Retrieval on Informal Meetings, , , , and , in: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, 2022 |
[DOI] |
The 5th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE @ EMNLP 2022) (2022)
| IDIAPers @ Causal News Corpus 2022: Efficient Causal Relation Identification Through a Prompt-based Few-shot Approach, , , , , , and , in: The 5th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE @ EMNLP 2022), 2022 |
[URL] |
| IDIAPers @ Causal News Corpus 2022: Extracting Cause-Effect-Signal Triplets via Pre-trained Autoregressive Language Model, , , , , , and , in: The 5th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE @ EMNLP 2022), 2022 |
[URL] |
Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2022) (2022)
| Leveraging Events Sub-Categories for Violent-Events Detection in Social Media, , and , in: Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2022), 2022 |
[URL] |
| The Winning Approach for the Recommendation Systems Shared Task @REST_MEX 2022, , , , and , in: Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2022), 2022 |
[URL] |
Proceedings of the 2021 International Conference on Multimodal Interaction (2021)
| Approximating the Mental Lexicon from Clinical Interviews as a Support Tool for Depression Detection, , , , and , in: Proceedings of the 2021 International Conference on Multimodal Interaction, ACM, 2021 |
[DOI] |
Proceeding of International Conference on Information Technology (OCIT) (2021)
| Automatic Dialect Detection for Low Resource Santali Language, , , , , and , in: Proceeding of International Conference on Information Technology (OCIT), 2021 |
|