Transformers for Natural Language Processing and Beyond

Wednesday 10:00 - 11:45 am // Learn how to apply state-of-the-art transformer models

ANMELDEFRIST ABGELAUFEN

Für diesen Kurs kann man keine Teilnahmenbescheinigung erhalten.

Bei ausreichender Teilnahme und Erbringung eines der angebotenen Leistungsnachweise kannst Du ein Leistungszertifikat erwerben.

Kursinformation

KURSBESCHREIBUNG

Our courses are open to all and free of charge for students, pupils, trainees, founders, scientific staff, job seekers, refugees, and pensioners. For employees and self-employed persons, a fee of 200 euros is charged when acquiring a certificate of achievement. Employees and self-employed persons can apply for a scholarship via stipendium@opencampus.sh.

The course instruction is online, however if enough participants are interested, we might have some hybrid sessions to meet in presence with those who are located in Kiel. It is expected that you turn on your camera and have a sufficient internet connection.

What you get

In this course you will, at first, get a very general, rather non-technical introduction into transformer models and its underlying self-attention mechanism. You will get an introduction into using transformers via prompt design , and thereafter, on how to fine-tune and apply them by using the Hugging Face library. The main part of the course will then focus on how to efficiently use the Hugging Face API to fine-tune models and on discussing different transformer models and their application in more detail.

As in all our machine learning courses, a main focus of this course will be the completion of your own NLP project that all course participants will have to conduct. You are free to bring your own ideas or data sets for the project.

All needed software and online course content is free.
This course is part of the opencampus.sh Machine Learning Degree. Participants of the program for the Machine Learning Degree get preferred access to this course. Find more information on the opencampus.sh Machine Learning Degree here.

What you should bring

You already have some programming knowledge and basic knowledge of neural nets and machine learning algorithms.

In order to receive a certificate of achievement ("Leistungszertifikat"/ ECTS) for this course, active participation is expected, no more than two classes may be missed, and you have to conduct a practice project in a team of 2 to 4 persons. At the end of the course the project has to be presented and a well documented project source code has to be submitted.

Before the first course meeting there will be a Course Kick-Off Event on April 7.
In the Kick-Off you will meet your course instructor, can ask questions about the participation in the course, and get helpful information to prepare for the start of the course. The attendance at the Kick-Off is not mandatory but recommended for all participants.

ALLGEMEINE INFOS

Kursname:
Transformers for Natural Language Processing and Beyond
Format:
Online or in presence in Kiel
ECTS:
2.5
Semester:
Sommersemester 2022
Anmeldefrist:
10.04.2022
Start:
20.04.2022
Ende:
15.06.2022
Zeiten:
10:00 - 12:00 Uhr

Kursleitung

Name:
Steffen Brandt
E-Mail:
steffen@opencampus.sh
Telefon:
0431/90894380