Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cs-679:lectures [2014/09/30 21:24]
ringger
cs-679:lectures [2014/12/10 08:52] (current)
ringger
Line 6: Line 6:
 ! PowerPoint ! PowerPoint
 ! Screencast ! Screencast
 +! Supplement
 ! Title ! Title
 |- |-
Line 12: Line 13:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture01-intro.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture01-intro.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture01-intro.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture01-intro.pptx PPTX]
-| -+--- 
 +| ---
 | Intro. to Natural Language Processing; Linguistic Ambiguity | Intro. to Natural Language Processing; Linguistic Ambiguity
 |- |-
Line 19: Line 21:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture02-whydata.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture02-whydata.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture02-whydata.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture02-whydata.pptx PPTX]
-| -+--- 
 +| ---
 | Why Data? | Why Data?
 |- |-
Line 26: Line 29:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture03-lmintro.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture03-lmintro.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture03-lmintro.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture03-lmintro.pptx PPTX]
-| -+--- 
 +| ---
 | Intro. to Language Modeling; n-Gram Language Models | Intro. to Language Modeling; n-Gram Language Models
 |- |-
Line 33: Line 37:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture04-interpolation.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture04-interpolation.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture04-interpolation.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture04-interpolation.pptx PPTX]
-| -+--- 
 +| ---
 | Language Model Smoothing with Interpolation | Language Model Smoothing with Interpolation
 |- |-
Line 40: Line 45:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture05-lmdiscount.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture05-lmdiscount.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture05-lmdiscount.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture05-lmdiscount.pptx PPTX]
-| -+--- 
 +| ---
 | Language Modeling Metrics; Language Model Smoothing with Discounting | Language Modeling Metrics; Language Model Smoothing with Discounting
 |- |-
Line 47: Line 53:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture06-goodturing.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture06-goodturing.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture06-goodturing.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture06-goodturing.pptx PPTX]
-| -+--- 
 +| ---
 | Good-Turing Smoothing | Good-Turing Smoothing
 |- |-
Line 54: Line 61:
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture07-kneserney.pdf PDF] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture07-kneserney.pdf PDF]
 | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture07-kneserney.pptx PPTX] | [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture07-kneserney.pptx PPTX]
-| -+--- 
 +| ---
 | Kneser-Ney Smoothing | Kneser-Ney Smoothing
 |- |-
 | 8 | 8
 | 9/30/2014 | 9/30/2014
-| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture08-kneserney.pdf PDF] +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture08-maxent.pdf PDF] 
-| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture08-kneserney.pptx PPTX]+| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture08-maxent.pptx PPTX] 
 +| --- 
 +| --- 
 +| Learning Maximum Entropy Models (Logistic Regression) 
 +|- 
 +| 9 
 +| 10/7/2014 
 +| (to appear) 
 +| (to appear) 
 +| --- 
 +| --- 
 +| Naive Bayes as Special Case of Logistic Regression 
 +|- 
 +| 10 
 +| 10/9/2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture10-neuralnets.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture10-neuralnets.pptx PPTX] 
 +| --- 
 +| --- 
 +| The Power of Discriminative Models (Bridge from Logistic Regression to Neural Nets) 
 +|- 
 +| 11 
 +| 10/​14/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture11-memm.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture11-memm.pptx PPTX] 
 +| --- 
 +| --- 
 +| Sequence Labeling; Maximum Entropy Markov Models 
 +|- 
 +| 12 
 +| 10/​16/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture12-namedentity.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture12-namedentity.pptx PPTX] 
 +| --- 
 +| --- 
 +| Feature Engineering for Maximum Entropy Markov Models; Named Entity Recognition 
 +|- 
 +| 13 
 +| 10/​21/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture13-undirectedgm.pdf PDF] 
 +| --- 
 +| --- 
 +| [http://​users.soe.ucsc.edu/​~niejiazhong/​slides/​murphy.pdf Murphy Tutorial] 
 +| Introduction to Undirected Graphical Models 
 +|- 
 +| 14 
 +| 10/​23/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture13-undirectedgm.pdf PDF] 
 +| --- 
 +| --- 
 +| [http://​users.soe.ucsc.edu/​~niejiazhong/​slides/​murphy.pdf Murphy Tutorial] 
 +| Introduction to Undirected Graphical Models (continued) 
 +|- 
 +| 15 
 +| 10/​28/​2014 
 +| --- 
 +| --- 
 +| --- 
 +| --- 
 +| Introduction to Undirected Graphical Models (continued) 
 +|- 
 +| 16 
 +| 10/​30/​2014 
 +| --- 
 +| --- 
 +| --- 
 +| --- 
 +| Solutions to your tagging problems 
 +|- 
 +| 17 
 +| 11/3/2014 
 +| --- 
 +| --- 
 +| --- 
 +| --- 
 +| Introduction to Undirected Graphical Models (continued) 
 +|- 
 +| 18 
 +| 11/​11/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture18-intropcfg.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture18-intropcfg.pptx PPTX] 
 +| --- 
 +| --- 
 +| Intro. to Parsing: Probabilistic Context Free Grammars (PCFGs) 
 +|- 
 +| 19, 20 
 +| 11/​13/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture19-indep.pdf PDF], [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture20-pcky.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture19-indep.pptx PPTX], [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture20-pcky.pptx PPTX] 
 +| --- 
 +| --- 
 +| Independence assumptions in PCFGs; CKY parsing algorithm; PCKY algorithm; Analysis of PCKY 
 +|- 
 +| 21, 22 
 +| 11/​18/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture21-markovized.pdf PDF], [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture22-markovgrammar.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture21-markovized.pptx PPTX], [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture22-markovgrammar.pptx PPTX] 
 +| --- 
 +| --- 
 +| PCFG Transformations:​ Markovization,​ Binarization;​ More probabilistic generative syntax models: Markov grammars, Lexicalized grammars 
 +|- 
 +| 23 
 +| 11/​20/​2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture22-markovgrammar.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture22-markovgrammar.pptx PPTX] 
 +| --- 
 +| --- 
 +| Dependency Parsing 
 +|-
 | - | -
-Learning Maximum Entropy ​Models+11/​25/​2014 
 +| --- 
 +| --- 
 +| --- 
 +| --- 
 +| Student Paper Presentations 
 +|- 
 +| 24 
 +| 12/2/2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture24-intromt.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture24-intromt.pptx PPTX] 
 +| --- 
 +| --- 
 +| Intro. to Machine Translation;​ Word Alignment ​Models: IBM Model 1; Training Model 1 with EM 
 +|- 
 +| 25 
 +| 12/4/2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture25-mtwordalign2.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture25-mtwordalign2.pptx PPTX] 
 +| --- 
 +| --- 
 +| Modeling Distortion (word movement); IBM Model 2; Training Model 2 with EM 
 +|- 
 +| 26, 27 
 +| 12/9/2014 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture26-mtwordalign3.pdf PDF], [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture27-decoding.pdf PDF] 
 +| [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture26-mtwordalign3.pptx PPTX], [http://​faculty.cs.byu.edu/​~ringger/​Fall2014-CS679/​lectures/​Lecture27-decoding.pptx PPTX] 
 +| --- 
 +| --- 
 +| Modeling "​Fertility";​ Cascaded Training; Choosing Alignments; Evaluating Alignments; Decoding / Translation;​ Translation Metrics
 |- |-
 |} |}
 +
  
 ---- ----
cs-679/lectures.1412133852.txt.gz · Last modified: 2014/09/30 21:24 by ringger
Back to top
CC Attribution-Share Alike 4.0 International
chimeric.de = chi`s home Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0