Application of Transformer Models

Wednesday 10:00 - 11:45 am // Learn how to apply state-of-the-art transformer models


Für diesen Kurs kann man keine Teilnahmenbescheinigung erhalten.

Bei ausreichender Teilnahme und Erbringung eines der angebotenen Leistungsnachweise kannst Du ein Leistungszertifikat erwerben.



Our courses are open to all and free of charge for students, pupils, trainees, founders, scientific staff, job seekers, refugees, and pensioners. For employees and self-employed persons, a fee of 200 euros is charged. Employees and self-employed persons can apply for a scholarship via

The course instruction is online, however if enough participants are interested, we might have some hybrid sessions to meet in presence with those who are located in Kiel. It is expected that you turn on your camera and have a sufficient internet connection.

What you get

In this course you will, at first, get a very general, rather non-technical introduction into transformer models and its underlying self-attention mechanism. You will get an introduction into using transformers via prompt design , and thereafter, on how to fine-tune and apply them by using the Hugging Face library. The main part of the course will then focus on how to efficiently use the Hugging Face API to fine-tune models and on discussing different transformer models and their application in more detail.

As in all our machine learning courses, a main focus of this course will be the completion of your own NLP project that all course participants will have to conduct. You are free to bring your own ideas or data sets for the project.

All needed software and online course content is free.
This course is part of the Machine Learning Degree. Participants of the program for the Machine Learning Degree get preferred access to this course. Find more information on the Machine Learning Degree here.

What you should bring

You already have some programming knowledge and basic knowledge of neural nets and machine learning algorithms.

In order to receive a certificate of achievement ("Leistungszertifikat"/ ECTS) for this course, active participation is expected, no more than two classes may be missed, and you have to conduct a practice project in a team of 2 to 4 persons. At the end of the course the project has to be presented and a well documented project source code has to be submitted.

Before the first course meeting there will be a Course Kick-Off Event on October 6:
In the Kick-Off you can meet your course instructor and ask questions about the participation in the course. The attendance at the Kick-Off is not mandatory but recommended for all participants.


Application of Transformer Models
Online or in presence in Kiel
Wintersemester 2022/2023
10:00 - 12:00 Uhr


Steffen Brandt