Section 12 - Big Data Flashcards
What are the 3 aspects of Big Data?
- Volume: It is too big to fit on a single server
- Velocity: It should take milliseconds or seconds to respond, particularly with streamlined data
- Variety: The data may be in many forms
What is the key issue with Big Data?
It lacks structure, meaning data can not be organised into a relational database and it is impossible to use standard query tools
What does Big Data collection and processing allow us to do?
Detect and analyse relationships within and among individual pieces of information
What is the best programming paradigm to use with Big Data?
Functional programming
What are the advantages of functional programming?
- There are no side effects
- They allow for higher order functions
- Variables are immutable
What are fact-based models?
An alternative to the relational data model in which immutable facts are recorded with timestamps. This means that data is never deleted and the data set is always growing
How do graph databases work?
Data is stored in nodes and relationships, with them each having properties. They can be used to represent connected data and to perform analysis on very large datasets