Parallel & Distributed Systems Flashcards
What is parallel computing?
Parallel computing involves processing multiple tasks simultaneously by dividing them into smaller sub-tasks that can be executed concurrently improving overall computation speed.
Explain the difference between parallel and distributed computing.
Parallel computing focuses on performing multiple tasks simultaneously within a single system while distributed computing involves processing tasks across multiple connected systems.
How does parallel computing enhance performance?
Parallel computing enhances performance by dividing complex tasks into smaller manageable parts enabling faster execution through simultaneous processing.
What is the role of message passing in distributed computing?
Message passing in distributed computing involves communication between different nodes or processors allowing them to share information and coordinate their activities.