- This event has passed.
Advanced Deep Learning with Transformers
18 Apr 2023 @ 09:00 - 19 Apr 2023 @ 16:00 CEST
Overview
In recent years, Graph Neural Networks (GNNs) and Transformers have led to numerous breakthrough achievements in a variety of fields such as Natural Language Processing (NLP), chemistry, and physics. By doing away with the need for fixed-size inputs, these architectures significantly extend the scope of problems to which deep learning can be applied.
This workshop will take you from the representation of graphs and finite sets as inputs for neural networks to the implementation of full GNNs for a variety of tasks. You will learn about the central concepts used in GNNs in a hands-on setting using Jupyter Notebooks and a series of coding exercises. While the workshop will use problems from the field of chemistry as an example for applications, the skills you learn can be transferred to any domain where finite set or graph-based representations of data are appropriate. From GNNs, we will make the leap to Transformer architectures, and explain the conceptual ties between the two.
The workshop is free of charge and will be conducted entirely online using zoom.
Prerequisites
To successfully participate in this workshop, you should have a good understanding of linear algebra and core concepts of deep learning such as CNNs, stochastic gradient descent, and supervised learning. You should also be familiar with the implementation of neural networks using PyTorch. A basic conceptual understanding of mathematical graphs is recommended but not a prerequisite.
Agenda
To be announced soon.
Registration
This event is fully booked.
Follow our Events Schedule
Follow us on Twitter and subscribe to our Newsletter to stay tuned to our events and other news.
————
This training is intended for users established in the European Union or a country associated with Horizon 2020. You can read more about the countries associated with Horizon2020 here https://ec.europa.eu/info/research-and-innovation/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_en
Related Events
This project has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 951732. The JU receives support from the European Union’s Horizon 2020 research and innovation programme and its associated countries .