Papers
2024
Predict the Next Word: `Humans exhibit uncertainty in this task and language models _____`
Evgenia Ilia and Wilker Aziz. In EACL, 2024.
[arXiv]
Evgenia Ilia and Wilker Aziz. In EACL, 2024.
[arXiv]
Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?
Joris Baan, Raquel Fernández, Barbara Plank, Wilker Aziz. In EACL, 2024.
[arXiv]
Joris Baan, Raquel Fernández, Barbara Plank, Wilker Aziz. In EACL, 2024.
[arXiv]
2023
What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability
Mario Giulianelli, Joris Baan, Wilker Aziz, Raquel Fernández, Barbara Plank. In EMNLP, 2023.
[arXiv]
Mario Giulianelli, Joris Baan, Wilker Aziz, Raquel Fernández, Barbara Plank. In EMNLP, 2023.
[arXiv]
Uncertainty in Natural Language Generation: From Theory to Applications
Joris Baan, Nico Daheim, Evgenia Ilia, Dennis Ulmer, Haau-Sing Li, Raquel Fernández, Barbara Plank, Rico Sennrich, Chrysoula Zerva, Wilker Aziz. Pre-print. 2023.
[arXiv]
Joris Baan, Nico Daheim, Evgenia Ilia, Dennis Ulmer, Haau-Sing Li, Raquel Fernández, Barbara Plank, Rico Sennrich, Chrysoula Zerva, Wilker Aziz. Pre-print. 2023.
[arXiv]
VISION DIFFMASK: Faithful Interpretation of Vision Transformers with Differentiable Patch Masking
Angelos Nalmpantis, Apostolos Panagiotopoulos, John Gkountouras, Konstantinos Papakostas, Wilker Aziz. In XAI4CV at CVPR, 2023.
[arXiv] [poster] [code]
Angelos Nalmpantis, Apostolos Panagiotopoulos, John Gkountouras, Konstantinos Papakostas, Wilker Aziz. In XAI4CV at CVPR, 2023.
[arXiv] [poster] [code]
2022
Sampling-Based Minimum Bayes Risk Decoding for Neural Machine Translation
Bryan Eikema and Wilker Aziz. In EMNLP, 2022.
[arXiv] [code]
Bryan Eikema and Wilker Aziz. In EMNLP, 2022.
[arXiv] [code]
Stop Measuring Calibration When Humans Disagree
Joris Baan, Wilker Aziz, Barbara Plank, and Raquel Fernandez. In EMNLP, 2022.
[arXiv]
Joris Baan, Wilker Aziz, Barbara Plank, and Raquel Fernandez. In EMNLP, 2022.
[arXiv]
Sparse Communication via Mixed Distributions
António Farinhas, Wilker Aziz, Vlad Niculae, and André F. T. Martins. In ICLR, 2022.
[arXiv] [code]
António Farinhas, Wilker Aziz, Vlad Niculae, and André F. T. Martins. In ICLR, 2022.
[arXiv] [code]
Statistical Model Criticism of Variational Auto-Encoders
Claartje Barkhof and Wilker Aziz. Pre-print. 2022.
[arXiv]
Claartje Barkhof and Wilker Aziz. Pre-print. 2022.
[arXiv]
2021
Editing Factual Knowledge in Language Models
Nicola De Cao, Wilker Aziz, and Ivan Titov. In EMNLP, 2021.
[arXiv] [code]
Nicola De Cao, Wilker Aziz, and Ivan Titov. In EMNLP, 2021.
[arXiv] [code]
Highly Parallel Autoregressive Entity Linking with Discriminative Correction
Nicola De Cao, Wilker Aziz, and Ivan Titov. In EMNLP, 2021.
[arXiv] [code]
Nicola De Cao, Wilker Aziz, and Ivan Titov. In EMNLP, 2021.
[arXiv] [code]
2020
Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translation
Bryan Eikema and Wilker Aziz. In Coling, 2020. Best paper
[arXiv] [code]
Bryan Eikema and Wilker Aziz. In Coling, 2020. Best paper
[arXiv] [code]
Efficient Marginalization of Discrete and Structured Latent Variables via Sparsity
Gonçalo M. Correia, Vlad Niculae, Wilker Aziz, and André F. T. Martins. In NeurIPS, 2020. Spotlight
[arXiv] [code]
Gonçalo M. Correia, Vlad Niculae, Wilker Aziz, and André F. T. Martins. In NeurIPS, 2020. Spotlight
[arXiv] [code]
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking
Nicola De Cao, Michael Schlichtkrull, Wilker Aziz, and Ivan Titov. In EMNLP, 2020.
[arXiv] [code]
Nicola De Cao, Michael Schlichtkrull, Wilker Aziz, and Ivan Titov. In EMNLP, 2020.
[arXiv] [code]
The Power Spherical Distribution
Nicola De Cao and Wilker Aziz. In ICML Workshop on Invertible Neural Networks, Normalizing Flows, and Explicit Likelihood Models, 2020.
[arXiv] [slides] [code]
Nicola De Cao and Wilker Aziz. In ICML Workshop on Invertible Neural Networks, Normalizing Flows, and Explicit Likelihood Models, 2020.
[arXiv] [slides] [code]
Effective Estimation of Deep Generative Language Models
Tom Pelsmaeker and Wilker Aziz. In ACL, 2020.
[arXiv] [slides] [talk] [code]
Tom Pelsmaeker and Wilker Aziz. In ACL, 2020.
[arXiv] [slides] [talk] [code]
A Latent Morphology Model for Open-Vocabulary Neural Machine Translation
Duygu Ataman, Wilker Aziz, and Alexandra Birch. In ICLR, 2020. Spotlight
[arXiv]
Duygu Ataman, Wilker Aziz, and Alexandra Birch. In ICLR, 2020. Spotlight
[arXiv]
Disease Normalization with Graph Embeddings
Dhruba Pujary, Camilo Thorne, and Wilker Aziz. In IntelliSys, 2020.
[arXiv]
Dhruba Pujary, Camilo Thorne, and Wilker Aziz. In IntelliSys, 2020.
[arXiv]
Latent Transformations for Discrete-Data Normalising Flows
Rob Hesselink and Wilker Aziz. Pre-print. 2020.
[arXiv]
Rob Hesselink and Wilker Aziz. Pre-print. 2020.
[arXiv]
2019
Auto-Encoding Variational Neural Machine Translation
Bryan Eikema and Wilker Aziz. In RepL4NLP, 2019.
[arXiv] [code] [demo]
Bryan Eikema and Wilker Aziz. In RepL4NLP, 2019.
[arXiv] [code] [demo]
Interpretable Neural Predictions with Differentiable Binary Variables
Jasmijn Bastings, Wilker Aziz and Ivan Titov. In ACL, 2019.
[arXiv] [code]
Jasmijn Bastings, Wilker Aziz and Ivan Titov. In ACL, 2019.
[arXiv] [code]
Latent Variable Model for Multi-modal Translation
Iacer Calixto, Miguel Rios and Wilker Aziz. In ACL, 2019.
[arXiv]
Iacer Calixto, Miguel Rios and Wilker Aziz. In ACL, 2019.
[arXiv]
Block Neural Autoregressive Flow
Nicola De Cao, Wilker Aziz and Ivan Titov. In UAI, 2019. Spotlight
[arXiv] [code]
Nicola De Cao, Wilker Aziz and Ivan Titov. In UAI, 2019. Spotlight
[arXiv] [code]
Question Answering by Reasoning Across Documents with Graph Convolutional Networks
Nicola De Cao, Wilker Aziz and Ivan Titov. In NAACL, 2019.
[arXiv]
Nicola De Cao, Wilker Aziz and Ivan Titov. In NAACL, 2019.
[arXiv]
2014-2018 - PD
A Stochastic Decoder for Neural Machine Translation
Philip Schulz, Wilker Aziz and Trevor Cohn. In Proceedings of ACL 2018, 2018.
[arXiv] [appendix] [code]
Philip Schulz, Wilker Aziz and Trevor Cohn. In Proceedings of ACL 2018, 2018.
[arXiv] [appendix] [code]
Deep Generative Model for Joint Alignment and Word Representation
Miguel Rios, Wilker Aziz, Khalil Sima'an. In Proceedings of NAACL-HLT 2018, 2018.
[arXiv] [slides] [code]
Miguel Rios, Wilker Aziz, Khalil Sima'an. In Proceedings of NAACL-HLT 2018, 2018.
[arXiv] [slides] [code]
Modeling Latent Sentence Structure in Neural Machine Translation
Jasmijn Bastings, Wilker Aziz, Ivan Titov, Khalil Sima'an. In Extended abstract at ACL's NMT workshop, 2018.
[arXiv]
Jasmijn Bastings, Wilker Aziz, Ivan Titov, Khalil Sima'an. In Extended abstract at ACL's NMT workshop, 2018.
[arXiv]
Graph Convolutional Encoders for Syntax-aware Neural Machine Translation
Jasmijn Bastings, Ivan Titov, Wilker Aziz, Diego Marcheggiani, Khalil Sima'an. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017.
[arXiv] [slides]
Jasmijn Bastings, Ivan Titov, Wilker Aziz, Diego Marcheggiani, Khalil Sima'an. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017.
[arXiv] [slides]
Fast Collocation-Based Bayesian HMM Word Alignment
Philip Schulz and Wilker Aziz. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, 2016.
[code]
Philip Schulz and Wilker Aziz. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, 2016.
[code]
Examining the Relationship between Preordering and Word Order Freedom in Machine Translation
Joachim Daiber, Miloš Stanojević, Wilker Aziz and Khalil Sima'an. In ACL 2016 First Conference on Machine Translation (WMT16) , 2016.
[slides] [code]
Joachim Daiber, Miloš Stanojević, Wilker Aziz and Khalil Sima'an. In ACL 2016 First Conference on Machine Translation (WMT16) , 2016.
[slides] [code]
Word alignment without NULL words
Philip Schulz, Wilker Aziz and Khalil Sima'an. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016.
[poster] [code]
Philip Schulz, Wilker Aziz and Khalil Sima'an. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016.
[poster] [code]
Grasp: Randomised Semiring Parsing
Wilker Aziz. In The Prague Bulletin of Mathematical Linguistics, 2015.
[poster] [code]
Wilker Aziz. In The Prague Bulletin of Mathematical Linguistics, 2015.
[poster] [code]
Quality estimation for ASR K-best list rescoring in spoken language translation
Raymond W. M. Ng, Kashif Shah, Wilker Aziz, Lucia Specia, and Thomas Hain. In 40th IEEE International Conference on Acoustics, Speech and Signal Processing, 2015.
[draft]
Raymond W. M. Ng, Kashif Shah, Wilker Aziz, Lucia Specia, and Thomas Hain. In 40th IEEE International Conference on Acoustics, Speech and Signal Processing, 2015.
[draft]
Exact Decoding for Phrase-Based Statistical Machine Translation
Wilker Aziz, Marc Dymetman and Lucia Specia. In Proceedings of the 2014 Conference on Empirical Methods on Natural Language Processing, 2014.
[slides] [talk]
Wilker Aziz, Marc Dymetman and Lucia Specia. In Proceedings of the 2014 Conference on Empirical Methods on Natural Language Processing, 2014.
[slides] [talk]
The USFD Spoken Language Translation System for IWSLT 2014
Raymond W. M. Ng, Mortaza Doulaty, Rama Doddipatla, Wilker Aziz, Kashif Shah, Oscar Saz, Madina Hasan, Ghada AlHarbi, Lucia Specia and Thomas Hain. In , 2014.
Raymond W. M. Ng, Mortaza Doulaty, Rama Doddipatla, Wilker Aziz, Kashif Shah, Oscar Saz, Madina Hasan, Ghada AlHarbi, Lucia Specia and Thomas Hain. In , 2014.
2011-2013 - PhD
Exact Sampling and Optimisation in Statistical Machine Translation
Wilker Aziz. PhD thesis, University of Wolverhampton. 2013.
Wilker Aziz. PhD thesis, University of Wolverhampton. 2013.
Investigations in Exact Inference for Hierarchical Translation
Wilker Aziz, Marc Dymetman and Sriram Venkatapathy. In Proceedings of the 8th Workshop on Statistical Machine Translation, 2013.
[slides]
Wilker Aziz, Marc Dymetman and Sriram Venkatapathy. In Proceedings of the 8th Workshop on Statistical Machine Translation, 2013.
[slides]
Multilingual WSD-like Constraints for Paraphrase Extraction
Wilker Aziz and Lucia Specia. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning (CoNLL), 2013.
[slides] [poster]
Wilker Aziz and Lucia Specia. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning (CoNLL), 2013.
[slides] [poster]
Ranking Machine Translation Systems via Post-Editing
Wilker Aziz, Ruslan Mitkov and Lucia Specia. In Proceedings of Text, Speech and Dialogue (TSD), pages 410-418, 2013.
[draft] [poster] [data]
Wilker Aziz, Ruslan Mitkov and Lucia Specia. In Proceedings of Text, Speech and Dialogue (TSD), pages 410-418, 2013.
[draft] [poster] [data]
Post-editing time as a measure of cognitive effort
Maarit Koponen, Wilker Aziz, Luciana Ramos and Lucia Specia. In AMTA 2012 Workshop on Post-Editing Technology and Practice, 2012.
[data]
Maarit Koponen, Wilker Aziz, Luciana Ramos and Lucia Specia. In AMTA 2012 Workshop on Post-Editing Technology and Practice, 2012.
[data]
PET: a Tool for Post-editing and Assessing Machine Translation
Wilker Aziz, Sheila Castilho and Lucia Specia. In Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), 2012.
[poster] [code] [data]
Wilker Aziz, Sheila Castilho and Lucia Specia. In Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), 2012.
[poster] [code] [data]
Predicting Machine Translation Adequacy
Lucia Specia, Najeh Hajlaoui, Catalina Hallett and Wilker Aziz. In Proceedings of the 13th Machine Translation Summit, 2011.
Lucia Specia, Najeh Hajlaoui, Catalina Hallett and Wilker Aziz. In Proceedings of the 13th Machine Translation Summit, 2011.
Fully Automatic Compilation of a Portuguese-English Parallel Corpus for Statistical Machine Translation
Wilker Aziz and Lucia Specia. In Proceedings of the 8th Brazilian Symposium in Information and Human Language Technology, 2011.
[data]
Wilker Aziz and Lucia Specia. In Proceedings of the 8th Brazilian Symposium in Information and Human Language Technology, 2011.
[data]
2010 - BSc
Learning an Expert from Human Annotations in Statistical Machine Translation: the Case of Out-of-Vocabulary Words
Wilker Aziz, Marc Dymetman, Lucia Specia and Shachar Mirkin. In Proceedings of the 14th Annual Conference of the European Association for Machine Translation, 2010.
[slides]
Wilker Aziz, Marc Dymetman, Lucia Specia and Shachar Mirkin. In Proceedings of the 14th Annual Conference of the European Association for Machine Translation, 2010.
[slides]