Teaching Assistants

• ML H44

Class Times

• Lecture: Friday, 10:15 – 12:00 (ML H44)
• Exercise: Friday, 08:15 – 10:00 (ML H44)

Computer Rooms

• HG E26.1, E26.3, E27

The environment provided by these computers is similar to the exam environment.

Schedule and Lecture Slides

 21.09.2018 Introduction, Architectures, Performance 28.09.2018 Shared Memory, Concurrency, Threads (updated 04.01.2019) 05.10.2018 Open-MP part 1 (updated 31.12.2018) 12.10.2018 Open-MP part 2, Pipelining and Vectorization (updated 18.10.2018) 19.10.2018 HPC Libraries and Linear Algebra 26.10.2018 SVD and Neural Networks, Lecture Notes Additional Reading: A tutorial on PCA, Shlens 2014 02.11.2018 Neural Networks as Matrix-Vector Multiply, Lecture Notes (Linear feature extraction), Lecture Notes (Back-propagation), Blackboard Pictures Additional Reading: Rumelhart 1986, Hinton 1992 09.11.2018 Distributed Memory, MPI part 1 16.11.2018 MPI part 2, Strong/Weak Scaling  (updated 23.11.2018) 23.11.2018 MPI part 3, Hybrid and I/O (updated 30.11.2018) 30.11.2018 Diffusion: Structured Grids and Finite Differences (updated 14.12.2018) 07.12.2018 Diffusion: Particles and N-Body Solvers 14.12.2018 Linked Lists and Particle Approximations, Vortex Methods Book,  Lecture Notes (updated 14.12.2018) 21.12.2018 Mock-up exam (w/o computers) followed by discussion of solutions 11.01.2019 Exam

Exercises

The exercises begin in the second week of the semester.

 Date Exercise Handout Solution 28.09.2018 Set 1 PDF (updated 29.09.2018), Tutorial Solution 05.10.2018 Set 2 PDF, Tutorial Solution, Mistakes 12.10.2018 Set 3 PDF, Slides Solution, Mistakes 19.10.2018 Set 4 PDF Solution, Review 26.10.2018 Set 5 PDF Solution (updated 07.01.2019) 02.11.2018 Set 6 PDF, Tutorial Solution 09.11.2018 Set 7 PDF, Tutorial, Addendum Solution 16.11.2018 Set 8 PDF Solution 23.11.2018 Set 9 PDF, Slides Solution, Slides 30.11.2018 Set 10 PDF, Slides, Scaling discussion Solution 07.12.2018 Set 11 PDF (updated 14.12.2018), Slides Solution 14.12.2018 Set 12 PDF, Slides (updated 17.12.2018) Solution (updated 02.01.2019)

Exam

You are allowed to bring a handwritten summary of 4 A4 sheets, written on the front and back pages (8 pages total). In addition, we will provide you with the following material:

• Lecture slides
• Exercise solutions
• Additional lecture notes distributed during the lecture
• OpenMP specification and reference card (pdf)
• MPI standard and reference card (pdf)
• Offline version of cppreference.com
• Offline version of the Intel intrinsics guide
• The book by Victor Eijkhout