big data Flashcards
Big Data
data that won’t fit the usual containers
big data in terms of volume
too big to fit into a single server
big data in terms of velocity
streaming data, milliseconds to seconds to respond
big data in terms of variety
data in many forms such as structured, unstructured, text, multimedia.
what happens when data sizes are so big as not to fit on to a single server
the processing must be distributed across more than one machine
functional programming is a solution, because it makes it easier to write correct and efficient distributed code
features of functional programming make it easier to write
correct code
code that can be distributed to run across more than one server.
what big data is
data may lack a structure
data will not fit on one server
data must be processed at high velocity
challenges that big data might have
cannot be stored on one server
data cannot be represented in a table
unstructured data are difficult to analalyse
cannot process data quickly with one computer
how to overcome the challenges big data might have
distribute database systems across multiple servers
use of functional programming
function to data model