GPU Programming. Why. When. How (Online)

About the workshop

This workshop is based on a multilateral collaboration between GPU programming specialists from the Nordic countries. It is meant to help both software developers and decision-makers navigate the GPU programming landscape and make more informed decisions on which languages or frameworks to learn and use for their projects.

This workshop will cover basic aspects of GPU programming concepts and models including:

• GPU hardware and software ecosystem
• GPU programming concepts & models
• Directive-based models (OpenACC, OpenMP)
• Portable kernel-based models (Kokkos, OpenCL, SYCL, etc.)
• Non-portable kernel-based models I (CUDA, HIP)
• High-level language support (Python, Julia)
• Multi-GPU programming with MPI
• Preparing code for GPU porting
• Hand-on examples

What you will learn

• Understand why and when to use GPUs.
• Become comfortable with key concepts in GPU programming.
• Acquire a comprehensive overview of different software frameworks, what levels they operate at, and which to use when.
• Learn the fundamentals in at least one framework to a level which will enable you to quickly become a productive GPU programmer.

Prerequisites

This workshop is most relevant to researchers and engineers who already develop software that runs on CPUs in workstations or supercomputers. We recommend familiarity with one or more programming languages like C/C++, Fortran, Python or Julia.

However, the first morning session on November 12 (9:00-12:00) is appropriate also to decision-makers or project managers who don’t write code but make strategic decisions in software projects, whether it’s in academia, industry, or the public sector. If you wish to attend only the first morning session, please indicate so in the registration form.

In the final afternoon session, participants are invited to bring their own code, discuss it with experts and get concrete advice.

Agenda

Day 1 (Nov. 12)

Day 2 (Nov. 13)

Day 3 (Nov 14)

Why learning GPU programming is important

Graphical processing units (GPUs) are the workhorse of many high-performance computing (HPC) systems around the world. Currently, the majority of HPC computing power available to researchers and engineers is provided by GPUs or other types of accelerators. Programming GPUs and other accelerators is thus increasingly important to developers who write software that is executed on HPC systems.

The landscape of GPU hardware, software, and programming environments is complicated. Multiple vendors compete in the high-end GPU market, each vendor provides their own software stack and development toolkits, and even beyond that, there is a proliferation of tools, languages, and frameworks that can be used to write code for GPUs. It can thus be difficult for individual developers and project owners to know how to navigate this landscape and select the most appropriate GPU programming framework for their projects based on the requirements of a given project and the technical specifics of existing code.

ENCCS Lessons

Have a look at ENCCS lesson materials where you can find multiple lessons on GPU programming, data analysis, HPC optimisation, and more!

Disclaimer

Due to EuroCC2 regulations, we CAN NOT ACCEPT generic or private email addresses. Please use your official university or company email address for registration.

This training is for users who live and work in the European Union or a country associated with Horizon 2020. You can read more about the countries associated with Horizon2020 here https://ec.europa.eu/info/research-and-innovation/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_e