Keywords:
- Analysis of Neural Networks
- attention-based models
- autoencoders
- deep learning
- distributional semantics
- entailment
- evaluation
- generation
- hallucination detection
- Hierarchical Attention Networks
- human annotations
- language modeling
- latent space learning
- LLM
- Machine Translation
- Multilingual Learning
- multilinguality
- natural language
- natural language generation
- Natural language processing
- natural language semantics
- neural machine translation
- neural networks
- NLP
- Nonparametric Variational Information Bottleneck
- Nonparametric VIB
- Out-of-domain generalisation
- output representation learning
- Parsing
- Post-training regularisation
- QA
- Reinterpretation
- representation learning
- style transfer
- Summarization
- Text classification
- Transformer
- transformers
- unsupervised learning
- VAE
- variable-size
- VIB
- word embedding
- word sense disambiguation
- Zero-shot Learning
Publications of James Henderson sorted by journal and type
| 1 | 2 |
Publications of type Idiap-RR
2023
| Idiap Scientific Report 2022, , , , , , , , , , , , , , , , , and , Idiap-RR-05-2023 |
|
2021
| Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation, and , Idiap-RR-21-2021 |
2020
| Plug and Play Autoencoders for Conditional Text Generation, , , , and , Idiap-RR-24-2020 |
|
2019
| Learning Entailment-Based Sentence Embeddings from Natural Language Inference, , and , Idiap-RR-20-2019 |
[URL] |
ArXiv
| Nonparametric Variational Regularisation of Pretrained Transformers, and , in: ArXiv, 2023 |
[DOI] [URL] |
arxiv
| A Variational AutoEncoder for Transformers with Nonparametric Variational Information Bottleneck, and , in: arxiv, 2022 |
[DOI] [URL] |
| HyperMixer: An MLP-based Green AI Alternative to Transformers, , , , , , and , in: arxiv, 2022 |
Transactions of the Association for Computational Linguistics
| Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement, and , in: Transactions of the Association for Computational Linguistics, 2020 |
[URL] |
Transactions of the Association for Computational Linguistics (2021)
| Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement, and , in: Transactions of the Association for Computational Linguistics (2021), 9:18, 2021 |
[DOI] [URL] |
Transactions of the Association for Computational Linguistics (TACL)
| GILE: A Generalized Input-Label Embedding for Text Classification, and , in: Transactions of the Association for Computational Linguistics (TACL), 2019 |
|
| Integrating Weakly Supervised Word Sense Disambiguation into Neural Machine Translation, , , and , in: Transactions of the Association for Computational Linguistics (TACL), 2018 |
|
Transactions of the Association for Computational Linguistics(under submission)
| Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement, and , in: Transactions of the Association for Computational Linguistics(under submission), 2020 |
Transactions on Machine Learning Research
| Inducing Meaningful Units from Character Sequences with Dynamic Capacity Slot Attention, and , in: Transactions on Machine Learning Research, 2023 |
[URL] |
Proceedings of the 3rd Workshop on Knowledge Augmented Methods for NLP (2024)
| GADePo: Graph-Assisted Declarative Pooling Transformers for Document-Level Relation Extraction, , , and , in: Proceedings of the 3rd Workshop on Knowledge Augmented Methods for NLP, Association for Computational Linguistics, 2024 |
[DOI] [URL] |
First conference on Language Modelling (2024)
| Nonparametric Variational Regularisation of Pretrained Transformers, and , in: First conference on Language Modelling, 2024 |
[URL] |
The Eleventh International Conference on Learning Representations (2023)
| A VAE for Transformers with Nonparametric Variational Information Bottleneck, and , in: The Eleventh International Conference on Learning Representations, 2023 |
[URL] |
Proc. of the 61st Annual Meeting of the Association for Computational Linguistics (2023)
| HyperMixer: An MLP-based Low Cost Alternative to Transformers, , , , , , and , in: Proc. of the 61st Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Toronto, Canada, pages 15632-15654, 2023 |
[DOI] |
The 2023 Conference on Empirical Methods in Natural Language Processing (2023)
| Learning to Abstract with Nonparametric Variational Information Bottleneck, , and , in: The 2023 Conference on Empirical Methods in Natural Language Processing, 2023 |
[URL] |
Association for Computational Linguistics: ACL 2023 (2023)
| RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question, , , , , , and , in: Association for Computational Linguistics: ACL 2023, Toronto, Canada, 2023 |
[URL] |
Procceedings of 8th Workshop on Representation Learning for NLP (2023)
| Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling, and , in: Procceedings of 8th Workshop on Representation Learning for NLP, 2023 |
[URL] |
Big Picture Workshop at EMNLP 2023 (2023)
| Transformers as Graph-to-Graph Models, , , and , in: Big Picture Workshop at EMNLP 2023, 2023 |
Workshop on Generation, Evaluation and Metrics (GEM) (2022)
| A Corpus and Evaluation for Predicting Semi-Structured Human Annotations, , , , and , in: Workshop on Generation, Evaluation and Metrics (GEM), 2022 |
|
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (2022)
| Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation, and , in: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Association for Computational Linguistics, Online, pages 468–488, 2022 |
[URL] |
Findings of Association for >Computational Linguistics: ACL 2022 (2022)
| Graph Refinement for Coreference Resolution, and , in: Findings of Association for >Computational Linguistics: ACL 2022, 2022 |
Proceedings of the 11th Joint Conference on Lexical and Computational Semantics (2022)
| Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers, , , , and , in: Proceedings of the 11th Joint Conference on Lexical and Computational Semantics, Seattle, USA, pages 89–100, 2022 |
|
ACL (2022)
| PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models, , , , , , and , in: ACL, 2022 |
|
The 2022 Conference on Empirical Methods in Natural Language Processing (2022)
| SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages, , , , , and , in: The 2022 Conference on Empirical Methods in Natural Language Processing, 2022 |
|
Workshop on Generation, Evaluation and Metrics (GEM) (2022)
| Unsupervised Token-level Hallucination Detection from Summary Generation By-products, and , in: Workshop on Generation, Evaluation and Metrics (GEM), 2022 |
|
The 2022 Conference on Empirical Methods in Natural Language Processing (2022)
| What Do Compressed Multilingual Machine Translation Models Forget?, , , , , and , in: The 2022 Conference on Empirical Methods in Natural Language Processing, 2022 |
|
NeurIPS (2021)
| Compacter: Efficient Low-Rank Hypercomplex Adapter Layers, , and , in: NeurIPS, 2021 |
|
| 1 | 2 |