Parallel Programming Concepts (WT 2013/14)

Dr. Peter Tröger


Since the very beginning of computers, processors were build with ever-increasing clock frequencies and instruction-level optimizations for faster serial code execution, such as ILP, caches, or speculative engines. Software developers and industry got used to the fact that applications get faster by just exchanging the underlying hardware. For several years now, these rules are proven to be no longer valid. Moore's law about the ever-increasing number of transistors per die is still valid, but decreased structural sizes and increased power consumption demand stalling, or even reduced, clock frequencies. Due to this development, serial execution performance no longer improves automatically with the next processor generation.

In the 'many-core era' that happens now, additional transistors are used not to speed up serial code paths, but to offer multiple execution engines ('cores') per processor. This changes every desktop-, server-, or even mobile system into a parallel computer. The exploitation of additional transistors is therefore now the responsibility of software, which makes parallel programming a mandatory approach for all software with scalability demands.

Introduction

Terminology & Fundamental Concepts

Date: October 24, 2013
Language: English
Duration: 01:24:56
Date: October 28, 2013
Language: English
Duration: 00:40:28
Date: October 28, 2013
Language: English
Duration: 00:33:46
Date: November 4, 2013
Language: English
Duration: 00:37:42

Execution Environments

Date: November 7, 2013
Language: English
Duration: 01:19:08
Date: November 11, 2013
Language: English
Duration: 01:19:24
Date: November 14, 2013
Language: English
Duration: 01:12:54
Date: November 25, 2013
Language: English
Duration: 01:27:34
Date: November 28, 2013
Language: English
Duration: 01:19:42

GPU Computing with OpenCL

Shared Nothing Parallelism

Date: January 9, 2014
Language: English
Duration: 00:37:30
Date: January 13, 2014
Language: English
Duration: 00:33:59
MPI 00:33:59
Recap 00:12:55
MPI Prefix Scan 00:16:28
What Else 00:04:36

Recent Trends of Discussed Topics

Date: January 13, 2014
Language: English
Duration: 00:37:48
Date: January 27, 2014
Language: English
Duration: 01:19:16
Date: February 6, 2014
Language: English
Duration: 00:23:34

Summary