Lambda Architecture Flashcards
Understand When to implement Lambda Architecture
What is the Lambda architecture?
A data processing architecture designed to handle massive volumes of data by combining both batch and stream processing methods.
It consists of three layers: batch layer, speed layer, and serving layer.
What are the three layers of Lambda architecture?
- Batch layer
- Speed layer
- Serving layer
Each layer has distinct responsibilities for data storage, processing, and insights.
What is the function of the batch layer in Lambda architecture?
To store and process historical data.
This layer handles large volumes of data accumulated over time.
What is the function of the speed layer in Lambda architecture?
To perform real-time data processing.
This layer allows for immediate insights from incoming data streams.
What is the function of the serving layer in Lambda architecture?
To merge results from the batch and speed layers and provide insights.
This layer acts as the interface for querying processed data.
What are the key benefits of using Lambda architecture?
- Fault-tolerant
- Scalable
- Low-latency data processing solutions
These benefits make it suitable for handling large-scale data applications.
What is one major limitation of Lambda architecture?
Maintaining two pipelines in parallel.
This results in increased complexity and potential synchronization issues.
True or False: Lambda architecture requires data duplication.
True
Data duplication can lead to inefficiencies and increased costs.
What challenges arise from code changes in Lambda architecture?
Code changes must be made in two places, increasing complexity.
This can complicate the development and maintenance process.