Natural Language Methods

Preparatory Reading Material

• Natural Language Processing in-and-for Design Research - L Siddharth, Lucienne T. M. Blessing, Jianxi Luo.

Experience

• Google N-Gram Viewer
• WebVectors - Online Word Embeddings Demo

Lecture Slides

• Lecture 6 PDF (UPDATED) (PDF - 7Mb)

Lecture Notes

• Lecture Notes (Web)

Additional Reading Material

• Word2Vec Tutorial - The Skip-Gram Model
• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• What Is ChatGPT Doing … and Why Does It Work?
• The GPT-3 Architecture, on a Napkin
• How tokenizers work