CS224n

Some of the important concepts, formulas, derivations, assignments, and models encountered during my self-study of CS224n: Natural Language Processing with Deep Learning will be recorded here.

Layouts

• Home
• Chapters:
  • Word Embeddings:
    • Word2vec
    • GloVe
  • Language Models:
    • Language Models
    • RNN
    • LSTM
    • Summary
  • Neural Machine Translation:
    • Seq2Seq
    • Attention
  • Transformers
  • Pretraining
• Math:
  • Matrix Derivative
  • SVD
• Assignments:
  • Assignment 1
  • Assignment 2
  • Assignment 3
  • Assignment 4
  • Assignment 5

References:

1. Dan Jurafsky and James H. Martin. Speech and Language Processing (3rd ed. draft)
2. Zhang, Aston and Lipton, Zachary C. and Li, Mu and Smola, Alexander J. Dive into Deep Learning
3. CS224n: Natural Language Processing with Deep Learning