5.3 Big Data Flashcards
what is big data
collection of data that is so large and complex that it is difficult to maange using tradiitonal dbms!!!
Is Big Data the same thing as large amount of traditional data?
no!!! separate things because Big Data refers to new forms of data (the vibratiosn of a song, the structural integrity of abridge at separate points)
What do big data systems do?
make predictions
Define Big Data (5 components)
1) has variety
2) includes structured, unstructued, and semi structured data
3) generated at high velocity w uncertain patterns
4) cant fit into into traditional relational databases
5) an be captured, processed, and transformed by info systems
Types of big data
1) Traditional enterprise data
Data about customer info from crm systems, transactional data, operations data etc
Types of big data
2) machine generated sensor data
data about manufacturing sensors, sensors in different electronics, and equipment related data
Types of big data
3) social data
things lke customer feedback comments, social media sites,
Types of big data
4) visual data
data from images located around the worldround the world
3 characterisitcs of big data
1) volume
2) velocity
3) variety
Characteristics of big data:
volume
big data usually has a lot of volumec
characterisitcs of big data
velocity
the rate at which data flows into an org is rapidly increading!!!
velocity is super high
charcateristics of big data
variety
big data changes rapidly! include satellite imagery, audio streams, music, web pages
is all big data valuable!
yes!! just in different ways!!!
issues of big data
1) can come from untrusted sources (comes from various sources so it could not always be relevant)
2) dirty: inaccurate, incomplete, incrorrect,duplicate data
3) big daata changes, especially in data streams: data quality can change in different conditions!
EX: if there is a real time data tracker and something happens to the physical tracker how does this impact the data?
has big data helped business?
yes! made things easier today that were way harder before
how do we manage big data?
1) use information silos
2)invensting in good Info management systems
information silos
a way to manage big daata, this is IS that does not communicate with any other related IS
*FIRST step in big data management
what is NoSQL
“not only sql “
this is another form of a dbms that uses more than just sql
difference between NoSQL and Oracle/SQL
Oracle/SQL: store data in tables organized in rows and columns (Each row linked to specific record, each column is a field that defines an attribute)
NoSQL: manages both structured and unstructured data, and also dirty data (incomplete data)
Oracle/SQL: store data in tables organized in rows and columns (Each row linked to specific record, each column is a field that defines an attribute)
NoSQL: manages both structured and unstructured data, and also dirty data (incomplete data)
Oracle/SQL: store data in tables organized in rows and columns (Each row linked to specific record, each column is a field that defines an attribute)
NoSQL: manages both structured and unstructured data, and also dirty data (incomplete data)Oracle/SQL: store data in tables organized in rows and columns (Each row linked to specific record, each column is a field that defines an attribute)
NoSQL: manages both structured and unstructured data, and also dirty data (incomplete data)
Oracle/SQL: store data in tables organized in rows and columns (Each row linked to specific record, each column is a field that defines an attribute)
NoSQL: manages both structured and unstructured data, and also dirty data (incomplete data)
how do you make big data useful?
1) make it available: let stakeholders have access to it so businesses can use it to solve problems
2) enable orgs to conduct experinments:
3)microsgmentation of customers: SEPARATING customers into very small groups!
3) create new business models:
4) organizations can analyze more data:
big data in the functional areas of the org:
HR
when hiring people you can do tests that assess the persons abilities
big data in the functional areas of the org:
Product development
can use big data to find general publics opinions- useful in product development
big data in the functional areas of the org:
operations
using data to improve operations, like sensors, timers, gps
big data in the functional areas of the org:
marketing
customer demographic data
big data in fucntional areas: government operations
doing things like census and other surveys for the city
