CS546 Parallel and Distributed Processing (3 cr. sect. 1) -- Fall 2018

Last modified August 17, 2018


3:15 pm - 4:30 pm, Monday and Wednesday, 121 Rober Pritzker Science Center (Life Science) , MC


CS430 (Introduction to Algorithms) and CS450 (Operating Systems)


All information provide here in are tentative and subject to change

General Information


Prof. Xian-He Sun, email: sun at iit dot edu

Office Hours (Dr. Sun)

4:30pm to 5:30 p.m. Monday and Wednesday or by appointment

235C Stuart Building
Teaching Assistants

Mr. Xiaoyang Lu , email: xlu40 at hawk dot iit dot edu

Office Hours

12:50pm - 1:50pm, Tuesday and Thursday

Room 003, Stuart Building

Course Description

This course covers general issues of parallel and distributed processing, which include system, algorithm, programming, performance evaluation, and application of parallel computers. Approximately two third of the course will be devoted to basic concepts and techniques, and the remaining third will be on programming and assorted current topics in parallel processing, including cloud computing, data intensive (big data) systems, and GPGPU. We will not follow any particular text through out the entire class. Instead, we will use two texts as the general guideline of the lecture, one for basic concepts and another one for programming skill. Three reference books are also listed. Assigned readings may give from time to time to complement the lectures. Homework assignments will include question/answer execises and programming assignments. For the last part of the course we will read an assortment of papers and work on different term projects.

Topics include:

Course Materials


Ananth Grama, Anshul Gupta, and George Karypis, Vipin Kumar
Introduction to Parallel Computing (2nd Edition)
Addison-Wesley, 2003 (see here for additional resources related to the text).

W. Gropp, et. al.,
Using MPI Tow -Volume Set
MIT Press, 1999 (see here for additional resources related to the text).


Kai Hwang,Jack Dongarra, and Geoffrey C. Fox
Distributed and Cloud Computing: From Parallel Processing to the Internet of Things
Morgan Kaufmann Publishers, 2011 (see here for additional resources related to this text.)

Ian Foster and Carl Kesselman
The Grid 2: Blueprint for a New Computing Infrastructure
Morgan Kaufmann Publishers, 2003 (see here for additional resources related to the text.)

David Kirk, and Wen-Wei Hwu
Programming Massively Parallel Processors
Morgan Kaufmann Publishers (2nd Edition), 2012 (see here for additional resources related to the text.)

On-Line Resources
MPI Web site
Parallel Processing Web site
Grid Forum Web site

Lecture Script (will be updated through the course)


Assignments will be given each week. Normally these will be due in two weeks. Large assignments and the term project will be given longer periods of time.


Solutions of the homeworks and program assignments may be provided from time to time to meet the need.

Term Project