README.md

DL-course-2021

Taking together Stanford CS224n course

Course page: link
YouTube Videos: link
Track your progress here

Russian version of the course:

• Spring 2020: link
  
• Summer 2019: link
  
• Fall 2018: link
  

---

How to submit homework:

1. Fork repository
2. Commit finished assignment and push it
3. Make a pull request
4. Wait until 1 or 2 reviewers approve your solution
5. Merge your pull request

Syllabus

Week 1. Word Vectors

• Video lecture
• Additional materials:
  • Word2Vec Tutorial - The Skip-Gram Model
  • Efficient Estimation of Word Representations in Vector Space - Word2Vec paper
  • Distributed Representations of Words and Phrases and their Compositionality - negative sampling paper
  • A Corrected CBOW Implementation

Week 2. Word Vectors and Word Senses

• Video lecture
• Enriching Word Vectors with Subword Information
• Additional materials:
  • GloVe paper
  • FastText talk
  • CS231n: Backpropagation
• Optional materials:
  • A Latent Variable Model Approach to PMI-based Word Embeddings

Assignments

Assignment 1
deadline: 16/07/21

Assignment 2 explanation
Assignment 2 code
deadline: 30/07/21

Project ideas

• Adversarial attacks on NLP models (https://arxiv.org/pdf/1911.03677.pdf)
• NLP models (BERT, RoBERT, ALBERT, etc.) in continual or multitask learning setting