logo Idiap Research Institute        
 [BibTeX] [Marc21]
A Survey on Language Modeling using Neural Networks
Type of publication: Idiap-RR
Citation: Pappas_Idiap-RR-32-2012
Number: Idiap-RR-32-2012
Year: 2012
Month: 11
Institution: Idiap
Abstract: A Language Model (LM) is a helpful component of a variety of Natural Language Processing (NLP) systems today. For speech recognition, machine translation, information retrieval, word sense disambiguation etc., the contribution of an LM is to provide features and indications on the probability of word sequences, their grammaticality and semantical meaningfulness. What makes language modeling a challenge for Machine Learning algorithms is the sheer amount of possible word sequences: the curse of dimensionality is especially encountered when modeling natural language. The survey will summarize and group literature that has addressed this problem and we will examine promising recent research on Neural Network techniques applied to language modeling in order to overcome the mentioned curse and to achieve better generalizations over word sequences.
Keywords: Artificial Neural Networks, Language Models
Projects Idiap
Authors Pappas, Nikolaos
Meyer, Thomas
Added by: [ADM]
Total mark: 0
Attachments
  • Pappas_Idiap-RR-32-2012.pdf (MD5: e8546f91467fbc1098cdf3f1d8b64494)
Notes