Tech Terms Flashcards
Streaming Data Platform
Designed to handle and process real time data streams
What does streaming data platforms allow for
Continuous ingestion, processing and analysis of data
What does streaming data platforms enable
Orgs to react to events in near real-time
Data ingestion
Collecting data from various sources in real time. Ex: social media
Data processing
Transforms, aggregates and enriches data on the fly
Data stream
Continuous flow of data that is generated, processed and consumed in real time
Data stream vs Traditional batch data
Traditional batch data is collected and processed in discrete chunks
Data streams are dynamic and ongoing for immediate processing and analysis of the data as it arrives
What does continuous flow mean for DS
Data is produced continuously at a high velocity from sources like financial transactions and social media feeds
What does real time processing mean for DS
Data is processed as it arrives enabling immediate analysis and decision making
Batch Processing
Execution of a series of jobs or tasks on a large volume of data
Data is collected, processed and analyzed in groups or batches
Packages
Help organize code and manage dependencies more efficiently
Libraries
Collection of pre-written code that developers use to optimize tasks
Lambda
- Serverless
- Allows you to run code without provision or managing servers
- Executes your code only when needed
EC2
Elastic Compute Cloud
- virtual server (instances)
- provides resizable compute capacity in the cloud
Server Side Applications