Section outline
-
Date
Topic
Material
20/2/2023 Introduction slides (1-36) 21/2/2023 Introduction slides (37-91) 22/2/2023 Overview slides 27/2/2023 Language Models slides
Suggested readings:- SLP, Chapter 3.
Notebook:
28/2/2023 Word Vectors slides (1-24)
Notebook:1/3/2023 Word Vectors slides (25-53)
video
Suggested readings:6/3/2023 Word2Vec Tutorial
Contextual Word Embeddingsslides (54-86)
Notebook:7/3/2023 Text Classification slides
Suggested readings:- SLP Chapter 6
8/3/2023 Classification slides
Notebook:13/3/2023 Tokenization slides
Notebook:14/3/2023 Hidden Markov Models slides
Suggested readings:- SLP Chapter 9
15/3/2023 Correction of Homework 1 Notebook: 20/3/2023 Named Entity Recognition slides
Notebook:
Suggested readings:- SLP Chapter 9
21/3/2023 Convolutional Neural Networks slides
Notebook:22/3/2023 Recurrent Neural Networks for NLP slides
Notebook:
Further readings:27/3/2023 Long Short Term Memories slides
Further readings:28/3/2023 Attention and the Transformer slides (1-58)
Video:29/3/2023 Transformer (Continued) slides (59-77) 3/4/2023 Transformer Architectures slides
Notebooks:12/4/2023 Prompt Tuning slides
Video:17/4/2023 ChatGPT and Reinforcement Learning slides 18/4/2023 Introduction to Python and Keras Notebook: 19/4/2023 Introduction to TensorFlow slides
Notebook:24/4/2023 Introduction to PyTorch.
HuggingFace TutorialNotebooks: 26/4/2023 Parsing slides (1-70)
Suggested readings:- SLP Chapters 12, 13, 14
- Joakim Nivre. 2004. Incrementality in Deterministic Dependency Parsing. Workshop on Incremental Parsing.
- Danqi Chen and Christopher D. Manning. 2014. A Fast and Accurate Dependency Parser using Neural Networks. EMNLP 2014.
- Sandra Kübler, Ryan McDonald, Joakim Nivre. 2009. Dependency Parsing. Morgan and Claypool.
- Daniel Andor, Chris Alberti, David Weiss, Aliaksei Severyn, Alessandro Presta, Kuzman Ganchev, Slav Petrov, and Michael Collins. 2016. Globally Normalized Transition-Based Neural Networks. ACL 2016.
2/5/2023 Dependency Parsing: Training slides (71-)
Notebooks:3/5/2023 Analysis of Language Models (aka BERTology) slides
Notebooks:8/5/2023 Machine Translation slides 9/5/2023 Statistical Machine Translation slides 10/5/2023 Neural Machine Translation slides 15/5/2022 Project: topics and advice Project Topics
Project Advice16/5/2023 Reading Comprehension slides
Further readings:- SQuAD: 100,000+ Questions for Machine Comprehension of Text
- Bidirectional Attention Flow for Machine Comprehension
- Reading Wikipedia to Answer Open-Domain Questions
17/5/2023 Open Domain Question Answering slides
Further readings:- SQuAD: 100,000+ Questions for Machine Comprehension of Text
- Bidirectional Attention Flow for Machine Comprehension
- Reading Wikipedia to Answer Open-Domain Questions
- Latent Retrieval for Weakly Supervised Open Domain Question Answering
- Dense Passage Retrieval for Open-Domain Question Answering
- Learning Dense Representations of Phrases at Scale
22/5/2023 Trends and Future of NLP 23/5/2023 Bonus: Thinking Fast and Slow slides
Further readings:- D. Kahneman. Thinking Fast and Slow. Farrar, Straus and Giroux. 2013.