Navigation

26D111NOP - Advanced Natural Language Processing

Course specification
Course title Advanced Natural Language Processing
Acronym 26D111NOP
Study programme Electrical Engineering and Computing
Module Software Engineering
Type of study doctoral studies
Lecturer (for classes)
Lecturer/Associate (for practice)
    Lecturer/Associate (for OTC)
      ESPB 9.0 Status elective
      Condition
      The goal Present advanced models and tasks in natural language processing. Familiarize students with different large language model architectures and their applications.
      The outcome Students will learn advanced techniques of processing texts written in natural languages and will be able to apply the state-of-the-art statistical methods in solving problems from this domain.
      Contents
      Contents of lectures Large language models and transfer learning in NLP. Encoder and decoder models. Model fine-tuning and few-shot learning. Monolingual and multilingual models and their cross-lingual applications. Prompt engineering and hallucinations in generative models. Bias in NLP models. Question answering, text summarization and simplification, coreference resolution, multimodal tasks.
      Contents of exercises Joint design and development of the course project topic and content; familiarizing students with relevant concepts, approaches, tools and literature; monitoring and discussion of the solutions, results and possible improvements throughout the work on the project and its documentation.
      Literature
      1. Speech and Language Processing, Dan Jurafsky, James H. Martin, 3rd edition draft (Original title)
      2. Natural Language Processing with Transformers, Lewis Tunstall, Leandro von Werra, Thomas Wolf, O'Reilly, 2022 (Original title)
      Number of hours per week during the semester/trimester/year
      Lectures Exercises OTC Study and Research Other classes
      8
      Methods of teaching Lecturing and supervising students regarding the implementation of the course project
      Knowledge score (maximum points 100)
      Pre obligations Points Final exam Points
      Activites during lectures Test paper
      Practical lessons Oral examination 30
      Projects 70
      Colloquia
      Seminars