2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition...
-
Upload
merryl-wright -
Category
Documents
-
view
220 -
download
3
Transcript of 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition...
![Page 1: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/1.jpg)
2004/11/16 1
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
LAWRENCE R. RABINER, FELLOW, IEEEPresented by: Chi-Chun Hsia
![Page 2: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/2.jpg)
2004/11/16 2
Markov ChainMarkov Chain
![Page 3: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/3.jpg)
2004/11/16 3
Markov ChainMarkov Chain
![Page 4: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/4.jpg)
2004/11/16 4
Markov ChainMarkov Chain
And then, what does “hidden” means?
It results in a Geometric Distribution
![Page 5: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/5.jpg)
2004/11/16 5
Extension to Hidden Markov ModelExtension to Hidden Markov Model
![Page 6: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/6.jpg)
2004/11/16 6
Extension to Hidden Markov ModelExtension to Hidden Markov Model
![Page 7: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/7.jpg)
2004/11/16 7
Elements of an HMMElements of an HMM
![Page 8: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/8.jpg)
2004/11/16 8
The Three Basic ProblemsThe Three Basic Problems
![Page 9: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/9.jpg)
2004/11/16 9
Solution to Problem 1Solution to Problem 1
![Page 10: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/10.jpg)
2004/11/16 10
Solution to Problem 1Solution to Problem 1
![Page 11: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/11.jpg)
2004/11/16 11
Forward-Backward ProcedureForward-Backward Procedure
![Page 12: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/12.jpg)
2004/11/16 12
Forward-Backward ProcedureForward-Backward Procedure
![Page 13: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/13.jpg)
2004/11/16 13
Forward-Backward ProcedureForward-Backward Procedure
![Page 14: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/14.jpg)
2004/11/16 14
Forward-Backward ProcedureForward-Backward Procedure
![Page 15: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/15.jpg)
2004/11/16 15
Solution to Problem 2Solution to Problem 2
![Page 16: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/16.jpg)
2004/11/16 16
Solution to Problem 2Solution to Problem 2
![Page 17: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/17.jpg)
2004/11/16 17
Viterbi AlgorithmViterbi Algorithm
![Page 18: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/18.jpg)
2004/11/16 18
Viterbi AlgorithmViterbi Algorithm
![Page 19: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/19.jpg)
2004/11/16 19
Solution to Problem 3Solution to Problem 3
![Page 20: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/20.jpg)
2004/11/16 20
Solution to Problem 3Solution to Problem 3
![Page 21: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/21.jpg)
2004/11/16 21
EM Algorithm for HMMEM Algorithm for HMM
X.D. HUANG, Y. ARIKI, M.A. JACK
HIDDEN MARKOV MODELSFOR SPEECH RECOGNITION
EDINBURGH UNIVERSITY PRESS
![Page 22: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/22.jpg)
2004/11/16 22
Types of HMMsTypes of HMMs
![Page 23: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/23.jpg)
2004/11/16 23
Continuous Type HMMsContinuous Type HMMs
![Page 24: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/24.jpg)
2004/11/16 24
Autoregressive HMMsAutoregressive HMMs
![Page 25: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/25.jpg)
2004/11/16 25
Optimization CriterionOptimization CriterionMaximum Likelihood (ML)
Maximum Mutual Information (MMI)
Minimum Discrimination Information (MDI)
Minimum Classification Error (MCE) Chang.
![Page 26: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/26.jpg)
2004/11/16 26
Implementation Issues for HMMsImplementation Issues for HMMs
• Scaling
• Multiple Observation Sequences
• Initial Estimates of HMM Parameters
• Effect of Insufficient Training Data
• Choice of Model
![Page 27: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/27.jpg)
2004/11/16 27
ScalingScaling
![Page 28: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/28.jpg)
2004/11/16 28
ScalingScaling
![Page 29: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/29.jpg)
2004/11/16 29
ScalingScaling
And so on and on and on and on……………..
![Page 30: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/30.jpg)
2004/11/16 30
Multiple Observation SequencesMultiple Observation Sequences
![Page 31: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/31.jpg)
2004/11/16 31
Initial Estimates of HMM ParametersInitial Estimates of HMM Parameters
![Page 32: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/32.jpg)
2004/11/16 32
Effect of Insufficient Training DataEffect of Insufficient Training Data
![Page 33: 2004/11/161 A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition LAWRENCE R. RABINER, FELLOW, IEEE Presented by: Chi-Chun.](https://reader030.fdocuments.us/reader030/viewer/2022032703/56649d1f5503460f949f2ac4/html5/thumbnails/33.jpg)
2004/11/16 33
Choice of ModelChoice of Model