- This event has passed.
GPU Programming. Why. When. How (Online)
Nov 12 • 09:00 – Nov 14 • 16:00 CET
About the workshop
This workshop is based on a multilateral collaboration between GPU programming specialists from the Nordic countries. It is meant to help both software developers and decision-makers navigate the GPU programming landscape and make more informed decisions on which languages or frameworks to learn and use for their projects.
This workshop will cover basic aspects of GPU programming concepts and models including:
- GPU hardware and software ecosystem
- GPU programming concepts & models
- Directive-based models (OpenACC, OpenMP)
- Portable kernel-based models (Kokkos, OpenCL, SYCL, etc.)
- Non-portable kernel-based models I (CUDA, HIP)
- High-level language support (Python, Julia)
- Multi-GPU programming with MPI
- Preparing code for GPU porting
- Hand-on examples
What you will learn
- Understand why and when to use GPUs.
- Become comfortable with key concepts in GPU programming.
- Acquire a comprehensive overview of different software frameworks, what levels they operate at, and which to use when.
- Learn the fundamentals in at least one framework to a level which will enable you to quickly become a productive GPU programmer.
Prerequisites
This workshop is most relevant to researchers and engineers who already develop software that runs on CPUs in workstations or supercomputers. We recommend familiarity with one or more programming languages like C/C++, Fortran, Python or Julia.
However, the first morning session on November 12 (9:00-12:00) is appropriate also to decision-makers or project managers who don’t write code but make strategic decisions in software projects, whether it’s in academia, industry, or the public sector. If you wish to attend only the first morning session, please indicate so in the registration form.
In the final afternoon session, we urge participants to bring their own code, discuss it with experts, and get concrete advice.
Agenda
Day 1 (Nov. 12)
| Time | Contents |
|---|---|
| Welcome | |
| 09:20-09:45 | Why GPUs? |
| 09:45-10:15 | GPU hardware and software ecosystem |
| 10:15-10:30 | Coffee break |
| 10:30-11:00 | What problems fit to GPU? |
| 11:00-11:30 | GPU programming concepts |
| 11:30-12:00 | Introduction to GPU programming models |
| 12:00-13:00 | Lunch break |
| 13:00-14:10 | Directive-based models (OpenACC, OpenMP) |
| 14:10-14:30 | Coffee break |
| 14:30-15:50 | Portable kernel-based models (C++ stdpar, Kokkos, OpenCL, SYCL) |
| 15:50-16:00 | Wrap-up |
Day 2 (Nov. 13)
| Time | Contents |
|---|---|
| | Non-portable kernel-based models (CUDA, HIP) |
| 10:30-10:45 | Coffee break |
| 10:45-12:00 | Exercises (on various programming models) |
| 12:00-13:00 | Lunch break |
| 13:00-14:15 | High-level language support (Python and Julia) |
| 14:15-14:30 | Coffee break |
| 14:30-15:55 | Multi-GPU programming with MPI |
| 15:50-16:00 | Wrap-up |
Day 3 (Nov 14)
| Time | Contents |
|---|---|
| | Preparing code for GPU porting |
| 10:00-10:30 | Recommendations and discussions |
| 10:30-10:45 | Coffee break |
| 10:45-11:55 | End-to-end GPU programming example |
| 11:55-12:00 | Wrap-up |
| 12:00-13:00 | Lunch break |
| 13:00-15:50 | Bring your code and get expert advice |
| 15:50-16:00 | Summary of this workshop |
Why learning GPU programming is important
Graphical processing units (GPUs) are the workhorse of many high-performance computing (HPC) systems around the world. Currently, the majority of HPC computing power available to researchers and engineers is provided by GPUs or other types of accelerators. Programming GPUs and other accelerators is thus increasingly important to developers who write software that is executed on HPC systems.
The landscape of GPU hardware, software, and programming environments is complicated. Multiple vendors compete in the high-end GPU market, each vendor provides their own software stack and development toolkits, and even beyond that, there is a proliferation of tools, languages, and frameworks that can be used to write code for GPUs. It can thus be difficult for individual developers and project owners to know how to navigate this landscape and select the most appropriate GPU programming framework for their projects based on the requirements of a given project and the technical specifics of existing code.
ENCCS Lessons
Have a look at ENCCS lesson materials where you can find multiple lessons on GPU programming, data analysis, HPC optimisation, and more!
Disclaimer
Due to EuroCC2 regulations, we CAN NOT ACCEPT generic or private email addresses. Please use your official university or company email address for registration.
This training is for users who live and work in the European Union or a country associated with Horizon 2020. You can read more about the countries associated with Horizon2020 here https://ec.europa.eu/info/research-and-innovation/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_e
Related Events
This project has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 951732. The JU receives support from the European Union’s Horizon 2020 research and innovation programme and its associated countries .