Parallel Computer Architecture and Programming
Course ID 15618
Description The fundamental principles and engineering tradeoffs involved in designing modern parallel computers, as well as the programming techniques to effectively utilize these machines. Topics include naming shared data, synchronizing threads, and the latency and bandwidth associated with communication. Case studies on shared-memory, message-passing, data-parallel and dataflow machines will be used to illustrate these techniques and tradeoffs. Programming assignments will be performed on one or more commercial multiprocessors, and there will be a significant course project.
Key Topics
Parallel programming models / frameworks; Characteristics of parallel hardware; Ubiquitous computing workloads
Learning Resources
Piazza; Course website
Course Relevance
From smart phones, to multi-core CPUs and GPUs, to the world's largest supercomputers and web sites, parallel processing is ubiquitous in modern computing. This class covers how these systems operate and are programmed.
Course Goals
Provide a deep understanding of the fundamental principles and engineering trade-offs involved in designing modern parallel computing systems as well as to teach parallel programming techniques necessary to effectively utilize these machines.
Pre-required Knowledge
15-213 is required. Other experience with systems and C programming is valuable.
Assessment Structure
Programming Assignments: 40 percent; Exams: 30 percent; Final Project: 25 percent; Participation: 5 percent
Extra Time Commitments
This course 15-618 is for graduate students. Undergraduates should enroll in 15-418.
Course Link
https://csd.cs.cmu.edu/course-profiles/15-418-Parallel-Computer-Architecture-an…