High-Performance – Parallelism – Concurrency. – Hardware ⇐. • Parallel
Computer Architecture. • Concurrent ... K. Hwang, Advanced Computer
Architecture: Parallelism, Scalability,and. Programmability , McGraw-Hill, 1993.
Bräunl 2004. 7.
Topics • Advanced Computer Architecture • High-Performance – Parallelism – Concurrency
Advanced Computer Architectures
– Hardware ⇐ • Parallel Computer Architecture • Concurrent Computer Architecture
A/Prof. Thomas Bräunl
– Software ← • Parallel Software Design • Concurrent Software Design
The University of Western Australia Electrical, Electronic and Computer Eng., 2005
Bräunl 2004
1
Bräunl 2004
Topics
Topics
Hardware • Networks of single computers – multicomputers (MIMD) • Tightly coupled CPUs – vector computers and SIMD • Pipeline processing
Software • Programming of Networks/MIMD computers • Programming of Vector- and SIMD computers • Automatic parallelization/vectorization vs. parallel programming languages / libraries
Bräunl 2004
Bräunl 2004
3
2
4
Textbook: Parallel Processing, 2004
Recommended Reading
I
Fundamentals
III Synchronous Parallelism
•
1. 2. 3. 4. 5.
Introduction Classifications Petri-Networks Parallel Processing Concepts Network Structures
11. 12. 13. 14. 15.
• •
Structure of a SIMD System Communication in SIMD-Systems Problems with Asynchronous Parallelism SIMD-Programming Languages Massively Parallel Algorithms
•
II Asynchronous Parallelism
IV Other Models of Parallelism
6. Structure of a MIMD System 7. Synchronization and Communication in MIMD-Systems 8. Problems with Asynchronous Parallelism 9. MIMD-Programming Languages 10. Coarse-Grained Parallel Algorithms
16. Automatic Parallelization and Vectorization 17. Non-Procedural Parallel Programming Languages 18. Performance of Parallel Systems
Bräunl 2004
5
Bräunl 2004
6
Intranet
Fundamentals Petri-Nets Asynchronous Parallelism Synchronous Parallelism Performance of Parallel Systems Automatic Parallelization/Vectorization
Bräunl 2004
• •
Contents 1. 2. 3. 4. 5. 6.
•
T. Bräunl, Parallel Programming, Prentice Hall, Englewood Cliffs, NJ, 1993 “Parallel Processing 2nd Edition”, 2004 T. Bräunl, Parallel Image Processing, Springer, 2001 Parallel and Distributed Programming Using C++, Cameron Hughes, Addison Wesley Longman, 2003 H. El-Rewini, T. G. Lewis and, Distributed and Parallel Computing, Manning, Greenwich CT, 1998 M. J. Quinn, Parallel Computing: Theory and Practice, McGraw-Hill, New York, 1994 Computer Architecture: A Quantitative Approach, John L. Hennessy, David A. Patterson, David Goldberg, 3rd Ed. Morgan Kaufmann, 2002 K. Hwang, Advanced Computer Architecture: Parallelism, Scalability,and Programmability , McGraw-Hill, 1993
http://robotics.ee.uwa.edu.au/courses/adv-comp-arch
7
Bräunl 2004
8
