Data Warehousing with Apache Hive

Question 1

What is a star schema in data warehousing?

Answer 1

A star schema is a type of database schema that is a popular design pattern for data warehouses and business intelligence applications. It consists of one or more fact tables referencing any number of dimension tables, resembling a star.

Question 2

What is the role of a fact table in a star schema?

Answer 2

The fact table is the central table in a star schema. It contains measurable, quantitative data (like sales amount) and foreign keys from dimension tables, representing the core data being analyzed.

Question 3

What are dimension tables in a star schema?

Answer 3

Dimension tables in a star schema store attributes or dimensions that describe the objects in the fact table. These include descriptive data like dates, products, or geographic locations.

Question 4

What are the benefits of using a star schema?

Answer 4

Star schemas simplify data modeling and querying. They enhance query performance due to their straightforward structure, making them ideal for business intelligence and data warehousing.

Question 5

How does a star schema differ from a snowflake schema?

Answer 5

Unlike the more complex snowflake schema, the star schema is simpler with denormalized dimension tables. This simplicity can lead to faster query times but potentially larger storage requirements due to denormalization.

Question 6

What would a fact table for a product order transaction typically include?

Answer 6

A fact table for a product order transaction would include measurable, quantitative data such as Order ID, Product ID, Quantity Ordered, Total Price, and possibly foreign keys linking to dimension tables like Date, Customer, Product, and Store.

Question 7

What attributes might a Date dimension table contain for a product order?

Answer 7

The Date dimension table could include Date ID (as primary key), Day, Month, Quarter, Year, and other relevant time-related attributes like Weekday or Holiday.

Question 8

What would you typically find in a Customer dimension table?

Answer 8

A Customer dimension table would feature Customer ID, Name, Address, Contact Information, Demographic Data, and possibly a Customer Segment or Category.

Question 9

What are common fields in a Product dimension table?

Answer 9

The Product dimension table would contain Product ID, Name, Description, Category, Supplier, Price, and potentially Size, Color, or other product-specific attributes.

Question 10

What details might a Store dimension table include for a product order?

Answer 10

A Store dimension table might have Store ID, Location, Address, Region, Manager, and Store Type or Size. This table provides context about where the order was placed or fulfilled.

Question 11

What is a snowflake schema in data warehousing?

Answer 11

A snowflake schema is a type of database schema often used in data warehousing. It’s an extension of the star schema, where dimension tables are normalized into multiple related tables, forming a structure resembling a snowflake.

Question 12

How does normalization work in a snowflake schema?

Answer 12

In a snowflake schema, dimension tables are broken down into more tables to eliminate redundancy and improve data integrity. This leads to a more complex structure with more joins than in a star schema.

Question 13

What is the role of a fact table in a snowflake schema?

Answer 13

Similar to the star schema, the fact table in a snowflake schema is at the center. It stores transactional data (like sales) and links to dimension tables, which are further normalized.

Question 14

What are the benefits of using a snowflake schema?

Answer 14

Snowflake schemas offer better data organization and improved data integrity due to normalization. They can also reduce data redundancy and storage costs.

Question 15

How does a snowflake schema differ from a star schema?

Answer 15

The snowflake schema is more complex due to the normalization of dimension tables, leading to more joins and potentially slower query performance, compared to the simpler, denormalized structure of the star schema.

Question 16

What is a galaxy schema in data warehousing?

Answer 16

A galaxy schema, also known as a fact constellation schema, is a data warehouse design that includes multiple fact tables sharing dimension tables. It’s a complex schema designed for multifaceted data analysis across various business processes.

Question 17

How is a galaxy schema structured?

Answer 17

In a galaxy schema, there are several fact tables that are related to shared dimension tables. Each fact table corresponds to a different business process but can share dimensions with other fact tables, resembling a collection of star schemas (hence the name “galaxy”).

Question 18

What is the role of fact tables in a galaxy schema?

Answer 18

Each fact table in a galaxy schema represents a specific business process or event, such as sales or inventory, containing the metrics or measurements of that process.

Question 19

How do shared dimension tables work in a galaxy schema?

Answer 19

Shared dimension tables in a galaxy schema serve multiple fact tables. For instance, a ‘Time’ dimension could be shared by both ‘Sales’ and ‘Inventory’ fact tables.

Question 20

What are the advantages of using a galaxy schema?

Answer 20

The galaxy schema allows for extensive and complex analysis across different business processes, providing a more comprehensive view. It’s flexible in accommodating diverse business requirements and analyses.

Question 21

What is a star schema?

Answer 21

The star schema is the simplest data warehouse schema, characterized by a central fact table connected to multiple dimension tables. It’s efficient for querying large data sets and is easy to understand.

Question 22

What is a snowflake schema?

Answer 22

The snowflake schema is a variation of the star schema where dimension tables are normalized, breaking them down into additional tables. This reduces redundancy but increases complexity.

Question 23

What is a galaxy schema?

Answer 23

The galaxy schema, or fact constellation schema, involves multiple fact tables that share dimension tables. It’s suitable for complex data warehousing scenarios involving multiple business processes.

Question 24

How do star, snowflake, and galaxy schemas compare in terms of complexity and performance?

Answer 24

Star schemas are simplest and fastest for queries. Snowflake schemas are more complex due to normalization, potentially slowing down queries. Galaxy schemas are the most complex, suitable for advanced, multifaceted analysis.

Question 25

Which schema should be used based on business requirements?

Answer 25

Star schemas are great for straightforward, large-volume data querying. Snowflake schemas suit scenarios needing normalized data structures for maintaining data integrity. Galaxy schemas fit complex analytical needs across various business domains.

Question 26

What is a data mart?

Answer 26

A data mart is a subset of a data warehouse focused on a specific business line or team. It contains data relevant to a particular group, like sales, finance, or marketing, making it more manageable and specific than the broader data warehouse.

Question 27

What is the primary purpose of a data mart?

Answer 27

The main purpose of a data mart is to provide business users with access to relevant data tailored to their specific needs. It simplifies data analysis by offering a more focused view of data, which is particularly useful for department-specific reporting and analysis.

Question 28

What are the different types of data marts?

Answer 28

There are three main types of data marts: independent, dependent, and hybrid. Independent data marts are created without a data warehouse. Dependent data marts are sourced from an existing data warehouse. Hybrid data marts combine both approaches.

Question 29

What are the advantages of using data marts?

Answer 29

Data marts offer improved performance for specific queries, ease of use for end-users, lower cost than full-scale data warehouses, and quicker implementation. They are tailored to specific needs, providing more relevant insights.

Question 30

How does a data mart differ from a data warehouse?

Answer 30

A data mart is a subset of a data warehouse designed for a specific line of business or purpose. While a data warehouse contains a broad view of the company's data for all departments, a data mart focuses on specific needs, making it smaller and more focused.

Question 31

What are Slowly Changing Dimensions (SCD)?

Answer 31

Slowly Changing Dimensions are dimensions in a data warehouse that undergo changes infrequently but must be managed to maintain historical accuracy of data. These changes could be due to updates in business processes or alterations in data interpretation.

Question 32

What is SCD Type 1?

Answer 32

SCD Type 1 involves overwriting the old data with new data, without keeping historical data. This is suitable when it's not necessary to keep track of historical changes.

Question 33

What is SCD Type 2?

Answer 33

SCD Type 2 involves keeping multiple rows to store historical data, with new records added for changes. This method maintains the history of dimensional changes, useful for tracking trends over time.

Question 34

What is SCD Type 3?

Answer 34

SCD Type 3 keeps the current and previous value in the same row. This method limits the history to a specific number of changes and is less commonly used.

Question 35

What is Slowly Changing Dimension Type 0 (SCD Type 0) in data warehousing?

Answer 35

SCD Type 0 refers to a dimension attribute that never changes once it has been loaded into the data warehouse. It's a passive method where historical data remains as it was at the time of its initial load, with no updates or changes allowed. This type is used for permanent or historical data that must be preserved in its original state, such as birth dates or original account numbers, which are significant for historical reporting and analysis and should not be altered.

Question 36

What is a surrogate key in the context of database management?

Answer 36

A surrogate key is an artificial or synthetic key used in a database table. It's a unique identifier for each row in the table, typically assigned by the database system itself. Surrogate keys are not derived from application data, unlike natural keys which are derived from meaningful data. They are often used in data warehousing to provide a unique identifier for each record, regardless of any changes to the actual data. Surrogate keys are useful for simplifying relationships between tables and improving query performance.

Question 37

What is the basic concept of SCD Type 2 in data warehousing?

Answer 37

SCD Type 2 is used to track and store the entire history of data changes. It involves adding new records to the dimension table with each change, preserving historical data for accurate analysis over time.

Question 38

What are key features of SCD Type 2?

Answer 38

It includes features like maintaining multiple historical records for each change, using surrogate keys for uniqueness, and possibly date/time stamps to record when changes occurred.

Question 39

How is SCD Type 2 typically implemented?

Answer 39

Implementation involves creating new entries in the dimension table for each change, along with effective and expiration dates for each record, and a flag to indicate the most current record.

Question 40

Why is SCD Type 2 important in business intelligence and reporting?

Answer 40

It's crucial for detailed historical analysis, allowing businesses to track changes over time and understand trends and patterns in historical data, leading to more informed decision-making.

Question 41

What should be considered when using SCD Type 2?

Answer 41

Considerations include the impact on storage and query performance, the complexity of managing historical data, and the need for robust data management practices to handle the volume and complexity of the data.