Chapter 3. Statistical Language Modeling
- Alexander Clark PhD member Lecturer2,
- Dr Chris Fox Reader3 and
- Shalom Lappin Professor4
Published Online: 29 JUN 2010
DOI: 10.1002/9781444324044.ch3
Copyright © 2010 Blackwell Publishing Ltd
Book Title

The Handbook of Computational Linguistics and Natural Language Processing
Additional Information
How to Cite
Chelba, C. (2010) Statistical Language Modeling, in The Handbook of Computational Linguistics and Natural Language Processing (eds A. Clark, C. Fox and S. Lappin), Wiley-Blackwell, Oxford, UK. doi: 10.1002/9781444324044.ch3
Editor Information
- 2
Royal Holloway, University of London, UK
- 3
University of Essex, UK
- 4
King's College London, UK
Publication History
- Published Online: 29 JUN 2010
- Published Print: 16 JUL 2010
Book Series:
ISBN Information
Print ISBN: 9781405155816
Online ISBN: 9781444324044
- Summary
- Chapter
Keywords:
- statistical language modeling;
- statistical language model, prior probability values P(W) for strings of words W in a vocabulary V;
- measures of language model quality;
- n-gram language model, finite state machine (FSM) - driving decoding (search) process;
- language model, assigning non-zero probability - to unseen strings of words;
- structured language model;
- formal language, and class of context-free grammars (CFGs);
- separate left-to-right word predictor - in language model;
- UPenn Treebank corpus - subset of WSJ (Wall Street Journal) corpus
Summary
This chapter contains sections titled:
Introduction to Statistical Language Modeling
Structured Language Model
Speech Recognition Lattice Rescoring Using the Structured Language Model
Richer Syntactic Dependencies
Comparison with Other Approaches
Conclusion
Notes