Seminar
Parallel Programming and
Parallel Algorithms
Winter term 2009/2010
Seminar „Parallel Programming and Parallel Algorithms“ in winter term 2009/2010
Prof. Dr. H. Kuchen, Philipp Ciechanowicz, Christian Hermanns
Motivation
Parallel computing has always played a major role in science
DNA analysis, weather forecast, earthquake simulation, etc.
Recently: Parallel computing becomes important to home users
Multi-core CPUs (dual-/quad-cores), GPGPUs
Consequences:
Parallel programming will become increasingly vital
Future software has to support multi-core computers
Software developers must be familiar with parallel programming
Areas of interest (selection)
architectures (SIMD, MIMD)
hardware (file system, communication)
APIs (MPI, OpenMP, TBB)
algorithms (matrix computations, sorting, searching)
Seminar „Parallel Programming and Parallel Algorithms“ in winter term 2009/2010
1
Prof. Dr. H. Kuchen, Philipp Ciechanowicz, Christian Hermanns
Organizational matters
Audience: Master and Diploma students
For Diploma students only: Relevant for PI, Inf, and IS
Number of participants: 12
Language: English (draft, workout + presentation)
Date: 6 January 2010 - 15 January 2010 (approximately)
Presumed knowledge: Nothing special, but some topics may
require C++ programming experience
Deadlines
Draft: 6 December 2009 (optional, but strongly recommended)
Workout: 20 December 2009
Presentation: 3 January 2010
Seminar „Parallel Programming and Parallel Algorithms“ in winter term 2009/2010
2
Prof. Dr. H. Kuchen, Philipp Ciechanowicz, Christian Hermanns
Requirements
Textual workout (20 pages)
Oral presentation (45 minutes)
Discussion/defence (15 minutes)
Active participation
Homepage: http://www.wi.uni-muenster.de/pi/lehre/ws0910/
pppa/index.html
latest announcements
downloads (document templates, hints)
additional hints (workout + presentation)
literature
Seminar „Parallel Programming and Parallel Algorithms“ in winter term 2009/2010
3
Prof. Dr. H. Kuchen, Philipp Ciechanowicz, Christian Hermanns
Topics
Architectures of parallel computers
Open Multi-Processing 3.0 (OpenMP)
Message Passing Interface 2.0 (MPI)
Threading Building Blocks 2.1 (TBB)
Storage schemes for sparse matrices
Matrix-vector multiplication
Matrix-matrix multiplication
Solving linear equation systems
Sorting (Samplesort + Hyperquicksort)
Combinatorial search
Distributed file systems
Distributed clocks and snapshots
Seminar „Parallel Programming and Parallel Algorithms“ in winter term 2009/2010
4
Prof. Dr. H. Kuchen, Philipp Ciechanowicz, Christian Hermanns
Assistants
Philipp Ciechanowicz
[email protected]
+49 (251) 83 38 265
room 326
Christian Hermanns
[email protected]
+49 (251) 83 38 263
room 326
Seminar „Parallel Programming and Parallel Algorithms“ in winter term 2009/2010
5
Prof. Dr. H. Kuchen, Philipp Ciechanowicz, Christian Hermanns