Data Warehousing: Data Marting and Metadata

1
Data Warehousing Data Marting and Metadata

• DATA
• WAREHOUSING
• IN THE REAL WORLD Chapters 6 9
• Sam Anahory
• Dennis Murray
• Presented by Lance Kelson 10/25/00

2
Data Warehousing Data Marting and Metadata

• Chapter 6 PARTITIONING STRATEGY
• Chapter 7 AGGREGATIONS
• Chapter 8 DATA MARTING
• Chapter 9 METADATA

3
Data Warehousing Data Marting and Metadata
Chapter 6 PARTITIONING STRATEGY

• Horizontal

4
Data Warehousing Data Marting and Metadata
Chapter 6 PARTITIONING STRATEGY

• Vertical
• Normalization
• Row Splitting
• Machine
• Striping Data Across MPP Nodes
• Horizontal

5
Data Warehousing Data Marting and Metadata
Chapter 7 AGGREGATIONS

• Purpose Balance Operating Effort
• with Query Times
• Approx 70 Query Times Reasonable
• Start w/50, End Up w/200
• Min, Max, Avg
• Most Common Grouping

6
Data Warehousing Data Marting and Metadata
Chapter 8 DATA MARTING

• Purpose PERFORMANCE!

7
Data Warehousing Data Marting and Metadata
Chapter 9 METADATA

• Purpose
• Data Transformation and Load
• Data Management
• Query Generation

8
Data Warehousing Data Marting and Metadata
Chapter 9 METADATA

• Data Transformation and Load

• Source
• Destination
• Transformation

9
Data Warehousing Data Marting and Metadata
Chapter 9 METADATA

• Data Management

• Tables
• Indexes
• Views
• Constraints
• Fields
• Tables
• Aggregations
• Partitions

10
Data Warehousing Data Marting and Metadata
Chapter 9 METADATA

• Query Generation

• Records Queries
• Tables
• Restrictions
• Joins
• Aggregations
• Group By
• Sort By
• Syntax
• Resources
• When, Who