The workshop covers basic NLP topics, Transformers, key innovations behind language models like BERT and GPT-3, and the impact of Transfer Learning as well as a hands-on example of NLP.