For the past forty years, linguistics has been dominated by the idea that language is categorical and linguistic competence discrete. It has become increasingly clear, however, that many levels of representation, from phonemes to sentence structure, show probabilistic properties, as does the language faculty. Probabilistic linguistics conceptualizes categories as distributions and views knowledge of language not as a minimal set of categorical constraints but as a set of gradient rules that may be characterized by a statistical distribution. Whereas categorical approaches focus on the endpoints of distributions of linguistic phenomena, probabilistic approaches focus on the gradient middle ground. Probabilistic linguistics integrates all the progress made by linguistics thus far with a probabilistic perspective. This book presents a comprehensive introduction to probabilistic approaches to linguistic inquiry. It covers the application of probabilistic techniques to phonology, morphology, semantics, syntax, language acquisition, psycholinguistics, historical linguistics, and sociolinguistics. It also includes a tutorial on elementary probability theory and probabilistic grammars.
Bradford Books imprint
Rens Bod is one of the principal architects of the Data-Oriented Parsing (DOP) model, which provides a general framework for probabilistic natural language processing.
Jennifer Hay is Lecturer in Linguistics at the University of Canterbury.
Stefanie Jannedy works on the development of text-to-speech systems at Lucent Technologies/Bell Labs
For over forty years, probabilistic research on language has been banished to the wilderness by categorial theories of linguistics. This book demonstrates decisively that the two approaches can not only live alongside one another in peace, but be of mutual benefit.
Mark Aronoff, Stony Brook University
Since the emergence of generative linguistics, most students of language have denied themselves the challenge of methodologically exploiting the stochastic nature of language. The present wonderful volume convincingly demonstrates this to be a mistake. Modern probability theory provides powerful tools for theory construction and verification for a variety of linguistic fields.
Willem J.M. Levelt, Max Planck Institute for Psycholinguistics