Class Room

  • ML H44

Class Times

  • Lecture: Friday, 10:15 – 12:00 (ML H44)
  • Exercise: Friday, 08:15 – 10:00 (ML H44)

Computer Rooms

  • HG E26.1, E26.3, E27

The environment provided by these computers is similar to the exam environment.

Class Material


Schedule and Lecture Slides

21.09.2018 Introduction, Architectures, Performance
28.09.2018 Shared Memory, Concurrency, Threads (updated 04.01.2019)
05.10.2018 Open-MP part 1 (updated 31.12.2018)
12.10.2018 Open-MP part 2, Pipelining and Vectorization (updated 18.10.2018)
19.10.2018 HPC Libraries and Linear Algebra
26.10.2018 SVD and Neural Networks, Lecture Notes

Additional Reading: A tutorial on PCA, Shlens 2014

02.11.2018 Neural Networks as Matrix-Vector Multiply, Lecture Notes (Linear feature extraction), Lecture Notes (Back-propagation), Blackboard Pictures

Additional Reading: Rumelhart 1986, Hinton 1992

09.11.2018 Distributed Memory, MPI part 1
16.11.2018 MPI part 2, Strong/Weak Scaling  (updated 23.11.2018)
23.11.2018 MPI part 3, Hybrid and I/O (updated 30.11.2018)
30.11.2018 Diffusion: Structured Grids and Finite Differences (updated 14.12.2018)
07.12.2018 Diffusion: Particles and N-Body Solvers
14.12.2018 Linked Lists and Particle Approximations, Vortex Methods BookLecture Notes (updated 14.12.2018)
21.12.2018 Mock-up exam (w/o computers) followed by discussion of solutions
11.01.2019 Exam

Exercises

The exercises begin in the second week of the semester.

Date Exercise Handout Solution
28.09.2018 Set 1 PDF (updated 29.09.2018), Tutorial Solution
05.10.2018 Set 2 PDF, Tutorial Solution, Mistakes
12.10.2018 Set 3 PDF, Slides Solution, Mistakes
19.10.2018 Set 4 PDF Solution, Review
26.10.2018 Set 5 PDF Solution (updated 07.01.2019)
02.11.2018 Set 6 PDF, Tutorial Solution
09.11.2018 Set 7 PDF, Tutorial, Addendum Solution
16.11.2018 Set 8 PDF Solution
23.11.2018 Set 9 PDF, Slides Solution, Slides
30.11.2018 Set 10 PDF, Slides, Scaling discussion Solution
07.12.2018 Set 11 PDF (updated 14.12.2018), Slides Solution
14.12.2018 Set 12 PDF, Slides (updated 17.12.2018) Solution (updated 02.01.2019)

Exam

You are allowed to bring a handwritten summary of 4 A4 sheets, written on the front and back pages (8 pages total). In addition, we will provide you with the following material:

  • Lecture slides
  • Exercise solutions
  • Additional lecture notes distributed during the lecture
  • OpenMP specification and reference card (pdf)
  • MPI standard and reference card (pdf)
  • Offline version of cppreference.com
  • Offline version of the Intel intrinsics guide
  • The book by Victor Eijkhout

Textbooks


Additional Material

Old Exam Sheets

Useful Links

General links on HPC and clusters
Tutorials
C++
OpenMP
MPI
SIMD
For Windows users
Others