Module 2: Network and Parallelism With Data-Structures

Question 1

What does MPI mean?

Answer 1

Message Passing Interface

Question 2

A communicator defines a group of processes that can communicate with one another.

Answer 2

Message Passing Interface (MPI)

Question 3

It is a basic approach for Inter-Process Communication

Answer 3

Message Passing

Question 4

The ________ acts as a service provider, the client issues the request and waits for the response from the ____. (Same word)

Answer 4

Server

Question 5

Until the client makes a call, the ____ does not communicate.

Answer 5

Server

Question 6

Direct communication between processes.

Answer 6

Peer to peer

Question 7

Here, there is no client or server, anyone can make a request to others and get a response.

Answer 7

Peer to peer

Question 8

Acts as an intermediate among independent processes.

Answer 8

Message Systems

Question 9

It also acts as a switch through which processes exchange messages asynchronously in a decoupled manner.

Answer 9

Message systems

Question 10

Distributing data from one process to all processes in a group

Answer 10

Broadcast

Question 11

Takes an array of elements and distributes the elements in the order of process rank

Answer 11

Scatter

Question 12

Takes elements from many processes and gathers them into a one single process.

Answer 12

Gather

Question 13

The inverse of MPI Scatter

Answer 13

Gather

Question 14

Takes an array of elements on each process and returns an array of output elements to the root process.

Answer 14

Reduce

Question 15

Returns the maximum element

Answer 15

MPI_MAX

Question 16

Returns the minimum element

Answer 16

MPI_MIN

Question 17

Sums the element

Answer 17

MPI_SUM

Question 18

Multiplies the element

Answer 18

MPI_PROD

Question 19

Performs a logical and across the elements

Answer 19

MPI_LAND

Question 20

Performs a logical or across the elements.

Answer 20

MPI_LOR

Question 21

Performs a bitwise and across the bits of the elements

Answer 21

MPI_BAND

Question 22

Performs a bitwise or across the bits of the elements

Answer 22

MPI_BOR

Question 23

Returns the maximum value and the rank of the process that owns it

Answer 23

MPI_MAXLOC

Question 24

Returns the minimum value and the rank of the process that owns it

Answer 24

MPI_MINLOC

Question 25

Are essential in collective communication to distinguish processes from one another and enable efficient data routing and synchronization.

Answer 25

Unique Identifiers

Question 26

Process Rank

Answer 26

**Process Rank** * **Simple Integer**: Each process is assigned a unique integer value. * **Advanges**: Easy to implement and manage. * **Disadvantages**: Limited flexibility, especially in dynamic systems where processes may join or leave.

Question 27

Process ID

Answer 27

**Process ID** * **System-assigned identifier**: The operating system assigns each process a unique identifier. * **Advantages**: Provides a globally unique identifier. * **Disadvantages**: Can be more complex to manage and may require additional system resources.

Question 28

Logical Topology

Answer 28

**Logical Topology** * **Hierarchical or grid-based structure:** Processes are organized into a logical topology, such as a tree or grid. * **Advantages:** Can provide information about the relationships between processes and facilitate efficient data routing. * **Disadvantages:** Implementing and managing it may be more complex, especially in dynamic systems.

Question 29

Custom Identifiers

Answer 29

**Custom Identifiers** * **User-defined Identifiers:** Processes can be assigned unique identifiers based on various criteria such as location, function, or workload. * **Advantages:** Can provide flexibility and adaptability to specific application requirements. * **Disadvantages:** May require additional management and can be more complex to implement.

Question 30

A numerical identifier for groups that process together a signle unit

Answer 30

Process Group ID (PGID)

Question 31

Associates a group of processes with a particular user session.

Answer 31

Session ID (SID)

Question 32

Why we need unique identifiers ( 4 answers )

Answer 32

* Process Differentiation * Data Routing * Synchronization * Fault Tolerance

Question 33

Is a collection of tightly or loosely connected computers that work together so that they act as a single entity

Answer 33

Cluster Computing

Question 34

Is a fundemental paradigm in cluster computing where processes communicate by exchanging messages.

Answer 34

Message passing

Question 35

This approach is particularly well-suited for clusters due to their distributed nature and the ability to scale horizontally.

Answer 35

Message passing

Question 36

The server acts as a service provider, the client issues the request and waits for the response from the server.

Answer 36

Client Server

Question 37

The sender and the receiver have to "meet" at their respective send/receive operations so that data can be transferred.

Answer 37

Synchronous message passing

Question 38

Other terms for "Synchronous message passing"

Answer 38

Rendezvous or Handshaking

Question 39

The sender does not wait for the receiver to reach its receive operation, rather it gets rid of the prepared data and continues its execution.

Answer 39

Asynchronous message passing

Question 40

This form of transfer does not force the sender to wait, but creates another problem: there may be messages that have already been send but not yet received, and they have to be stored somewhere.

Answer 40

Asynchronous message passing

Question 41

Where data is aggregated or disseminated from/to multiple processes

Answer 41

Collective communication

Question 42

Blocks until all processes have reached a synchronization point

Answer 42

Barrier Synchronization

Question 43

Broadcast, Scatters, Gather, All to All transmission of data across the communicator.

Answer 43

Data Movement (or Global Communication)

Question 44

One process from which the communicator collects data from each process and operates on that data to compute a result.

Answer 44

Collective Operations (or Global Reduction)

Question 45

Blocks all processes that have reached this routine

Answer 45

MPI_Barrier

Question 46

Broadcasts a message from the process with rank "root" to all other processes of the group.

Answer 46

MPI_Bcast

Question 47

Sends data from one task to all other tasks in a group

Answer 47

MPI_Scatter

Question 48

Gathers together values from a group of processes.

Answer 48

MPI_Gather

Question 49

Gathers data from all tasks and distribute it to all.

Answer 49

MPI_Allgather

Question 50

Reduces values on all processes to a single value.

Answer 50

MPI_Reduce