You are on page 1of 16

Module 1 Introduction to Parallel Processing

Mr. S.S. Sayyad Assistant Professor, ADCET Ashta suhelsayyad2006@gmail.com

Department of CSE, ADCET, Ashta

Trends towards Parallel Processing


Data Processing Increasing Volumes of Raw Material to be processed Increasing Complexity and sophistication in processing Information Processing Knowledge Processing Intelligence Processing

Department of CSE, ADCET, Ashta

Trends Towards Parallel Processing


Data processing: data space is largest, including numeric number

in various format, character symbols, and multidimensional measure


Information processing: Collection of data objects that are

related by some syntactic structure or relation.


Knowledge processing: consist of information items plus some

semantic meanings.
Intelligence processing: is derived from a collection of

knowledge items.

Department of CSE, ADCET, Ashta

Trends towards Parallel Processing


From Operating Systems point of view, computer systems

are improved in four phases


Batch Programming Multiprogramming Time Sharing Multiprocessing

Parallel Processing is an efficient form of information

processing which emphasizes the exploitation of concurrent events in the computing process.

Department of CSE, ADCET, Ashta

Trends towards Parallel Processing


Parallel programming can be challenged in four

programmable levels
Job or Program Level Task or Procedure Level Inter instruction Level Intra instruction Level

Hardware Software Trade Offs Parallel and Distributed processing

Department of CSE, ADCET, Ashta

Parallel Computer Architectures


Pipeline Computers: A pipeline computer performs

overlapped computations to exploit temporal parallelism. Array Processors: An array processor uses multiple synchronized arithmetic logic units to achieve spatial parallelism Multiprocessor Systems: A multiprocessor system achieves asynchronous parallelism through a set of interactive processors with shared resources. Data Flow Computers

Department of CSE, ADCET, Ashta

Pipeline Computer

Department of CSE, ADCET, Ashta

Array Processor

Department of CSE, ADCET, Ashta

Multiprocessor Systems
Aimed at : Improving throughput, reliability, flexibility and

availability. Basic multiprocessor system contain two or more processor. All processor share access to common sets of memory module, I/O channels and peripheral devices. Most importantly, whole system is controlled by a single integrated operating system. Beside the shared memories and I/O devices, each processor has its own local memory and private devices. Inter processor communication can be done throw shared memory or throw interrupt network.

Department of CSE, ADCET, Ashta

Data Flow Computers


Programs for Data Driven Computation Calculation of z= (x+y)*2 Template Implementation

Basic Data Flow Mechanism

Department of CSE, ADCET, Ashta

Multiplicity of Instruction Data Streams


Single Instruction Stream- Single Data Stream Processing Units Control Units

Memory Modules

Department of CSE, ADCET, Ashta

Multiplicity of Instruction Data Streams


Single Instruction Stream- Multiple Data Stream

Department of CSE, ADCET, Ashta

Multiplicity of Instruction Data Streams


Multiple Instruction Stream- Single Data Stream

Department of CSE, ADCET, Ashta

Multiplicity of Instruction Data Streams


Multiple Instruction Stream- Multiple Data Stream

Department of CSE, ADCET, Ashta

Serial v/s Parallel Processing Fengs Scheme


Use degree of parallelism to classify various computer

architectures. Maximum number of binary digits (bits) that can be processed within a unit by a computer system is called the maximum parallelism degree P. Average Parallelism Degree Equation: Processing Methods and their Examples (text) Word Serial Bit Serial Word Parallel Bit Serial Word Serial Bit Parallel Word Parallel Bit Serial
Department of CSE, ADCET, Ashta

Parallel Processing Applications


Predictive Modeling and Simulations
Numerical Weather Forecasting Oceanography and Astrophysics Socioeconomics and government use

Engineering Design and Automation


Finite Element Analysis Computational Aerodynamics Artificial Intelligence and Automation Remote Sensing Applications

Medical Military and Basic Research


Computer assisted tomography Genetic Engineering Weapon Research and Defense.
Department of CSE, ADCET, Ashta

You might also like