Spoken Language Processing: A Guide to Theory, Algorithm and System Development, 1st edition

  • Xuedong Huang
  • Alex Acero
  • HsiaoWuen Hon

Unfortunately, this item is not available in your country.


  • New advances in spoken language processing: theory and practice
  • In-depth coverage of speech processing, speech recognition, speech synthesis, spoken language understanding, and speech interface design
  • Many case studies from state-of-the-art systems, including examples from Microsoft's advanced research labs

Spoken Language Processing draws on the latest advances and techniques from multiple fields: computer science, electrical engineering, acoustics, linguistics, mathematics, psychology, and beyond. Starting with the fundamentals, it presents all this and more:

  • Essential background on speech production and perception, probability and information theory, and pattern recognition
  • Extracting information from the speech signal: useful representations and practical compression solutions
  • Modern speech recognition techniques: hidden Markov models, acoustic and language modeling, improving resistance to environmental noises, search algorithms, and large vocabulary speech recognition
  • Text-to-speech: analyzing documents, pitch and duration controls; trainable synthesis, and more
  • Spoken language understanding: dialog management, spoken language applications, and multimodal interfaces

To illustrate the book's methods, the authors present detailed case studies based on state-of-the-art systems, including Microsoft's Whisper speech recognizer, Whistler text-to-speech system, Dr. Who dialog system, and the MiPad handheld device. Whether you're planning, designing, building, or purchasing spoken language technology, this is the state of the art—from algorithms through business productivity.

Table of contents

(NOTE: Each chapter ends with Historical Perspective and Further Reading.)

1. Introduction.

Motivations. Spoken Language System Architecture. Book Organization. Target Audiences.


2. Spoken language Structure.

Sound and Human Speech Systems. Phonetics and Phonology. Syllables and Words. Syntax and Semantics.

3. Probability, Statistics, and Information Theory.

Probability Theory. Estimation Theory. Significance Testing. Information Theory.

4. Pattern Recognition.

Bayes' Decision Theory. How to Construct Classifiers. Discriminative Training. Unsupervised Estimation Methods. Classification and Regression Trees.


5. Digital Signal Processing.

Digital Signals and Systems. Continuous-Frequency Transforms. Discrete-Frequency Transforms. Digital Filters and Windows. Digital Processing of Analog Signals. Multirate Signal Processing. Filterbanks. Stochastic Processes.

6. Speech Signal Representations.

Short-Time Fourier Analysis. Acoustical Model of Speech Production. Linear Predictive Coding. Cepstral Processing. Perceptually Motivated Representations. Formant Frequencies. The Role of Pitch.

7. Speech Coding.

Speech Coders Attributes. Scalar Waveform Coders. Scalar Frequency Domain Coders. Code Excited Linear Prediction (CELP). Low-Brit Speech Coders.


8. Hidden Markov Models.

The Markov Chain. Definition of the Hidden Markov Model. Continuous and Semicontinuous HMMs. Practical Issues in Using HMMs. HMM Limitations.

9. Acoustic Modeling.

Variability in the Speech Signal. How to Measure Speech Recognition Errors. Signal Processing—Extracting Features. Phonectic Modeling—Selecting Appropriate Units. Acoustic Modeling—Scoring Acoustic Features. Adaptive Techniques—Minimizing Mismatches. Confidence Measures: Measuring the Reliability. Other Techniques. Case Study: Whisper.

10. Environmental Robustness.

The Acoustical Environment. Acoustical Transducers. Adaptive Echo Cancellation (AEC). Multimicrophone Speech Enhancement. Environment Compensation Preprocessing. Environment Model Adaptation. Modeling Nonstationary Noise.

11. Language Modeling.

Formal Language Theory. Stochastic Language Models. Complexity Measure of Language Models. N-Gram Smoothing. Adaptive Language Models. Practical Issues.

12. Basic Search Algorithms.

Basic Search Algorithms. Search Algorithms for Speech Recognition. Language Model States. Time-Synchronous Viterbi Beam Search. Stack Decoding (A Search).

13. Large-Vocabulary Search Algorithms.

Efficient Manipulation of a Tree Lexicon. Other Efficient Search Techniques. N-Best and Multipass Search Strategies. Search-Algorithm Evaluation. Case Study—Microsoft Whisper.


14. Text and Phonetic Analysis.

Modules and Data Flow. Lexicon. Document Structured Detection. Text Normalization. Linguistic Analysis. Homograph Disambiguation. Morphological Analysis. Letter-to-Sound Conversion. Evaluation. Case Study: Festival.

15. Prosody.

The Role of Understanding. Prosody Generation Schematic. Speaking Style. Symbolic Prosody. Duration Assignment. Pitch Generation. Prosody Markup Languages. Prosody Evaluation.

16. Speech Synthesis.

Attributes of Speech Synthesis. Formant Speech Synthesis. Concatenative Speech Synthesis. Prosodic Modification of Speech. Source-Filter Models for Prosody Modification. Evaluation of TTS Systems.


17. Spoken Language Understanding.

Written vs. Spoken Languages. Dialog Structure. Semantic Representation. Sentence Interpretation. Discourse Analysis. Dialog Management. Response Generation and Rendition. Evaluation. Case Study—Dr. Who.

18. Applications and User Interfaces.

Application Architecture. Typical Applications. Speech Interface Design. Internationalization. Case Study—MIPAD.


Published by Pearson (April 25th 2001) - Copyright © 2001