Seminar Parallel Programming and Parallel Algorithms

1
Seminar Parallel Programming andParallel
Algorithms

• Winter term 2009/2010

2
Motivation

• Parallel computing has always played a major role
  in science
• DNA analysis, weather forecast, earthquake
  simulation, etc.
• Recently Parallel computing becomes important to
  home users
• Multi-core CPUs (dual-/quad-cores), GPGPUs
• Consequences
• Parallel programming will become increasingly
  vital
• Future software has to support multi-core
  computers
• Software developers must be familiar with
  parallel programming
• Areas of interest (selection)
• architectures (SIMD, MIMD)
• hardware (file system, communication)
• APIs (MPI, OpenMP, TBB)
• algorithms (matrix computations, sorting,
  searching)

3
Organizational matters

• Audience Master and Diploma students
• For Diploma students only Relevant for PI, Inf,
  and IS
• Number of participants 12
• Language English (draft, workout presentation)
• Date 6 January 2010 - 15 January 2010
  (approximately)
• Presumed knowledge Nothing special, but some
  topics may require C programming experience
• Deadlines
• Draft 6 December 2009 (optional, but strongly
  recommended)
• Workout 20 December 2009
• Presentation 3 January 2010

4
Requirements

• Textual workout (20 pages)
• Oral presentation (45 minutes)
• Discussion/defence (15 minutes)
• Active participation
• Homepage http//www.wi.uni-muenster.de/pi/lehre/w
  s0910/
• pppa/index.html
• latest announcements
• downloads (document templates, hints)
• additional hints (workout presentation)
• literature

5
Topics

• Architectures of parallel computers
• Open Multi-Processing 3.0 (OpenMP)
• Message Passing Interface 2.0 (MPI)
• Threading Building Blocks 2.1 (TBB)
• Storage schemes for sparse matrices
• Matrix-vector multiplication
• Matrix-matrix multiplication
• Solving linear equation systems
• Sorting (Samplesort Hyperquicksort)
• Combinatorial search
• Distributed file systems
• Distributed clocks and snapshots

6
Assistants

• Philipp Ciechanowicz
• philipp.ciechanowicz_at_wi.uni-muenster.de
• 49 (251) 83 38 265
• room 326
• Christian Hermanns
• christian.hermanns_at_wi.uni-muenster.de
• 49 (251) 83 38 263
• room 326