Data Warehousing Management
Data Warehousing Management
Data Warehousing Management
MANAGEMENT
DATA LAKE
DATA WAREHOUSE DATA MART
Data lakes are designed to Data warehouses primarily Data marts are subsets of
store both structured and store structured data that has data warehouses or data
unstructured data, including been cleaned, transformed, lakes that contain data
raw, unprocessed data. and integrated for analysis. specific to a particular
business unit or department.
DATA WAREHOUSE
A data warehouse is a central repository of information that can be
analyzed to make more informed decisions. Data flows into a data
warehouse from transactional systems, relational databases, and
other sources, typically on a regular cadence.
source
system
source source
system system
source
system
DATA WAREHOUSE
source
source system
system
REPOSITORY
A repository, or repo, is computer storage for
maintaining data or software packages.
Data Warehouse Architecture
01
BOTTOM TIER
The bottom tier is responsible for storing
raw data from various source systems. It
acts as the foundation of the data
warehouse.
02
MIDDLE TIER
The middle tier is responsible for preparing
and organizing data for analytical purposes.
03
TOP TIER
The top tier is where end-users interact with
the data warehouse to extract insights and
perform analytical tasks.
Data Business
Warehousing Intelligence (BI)
refers to the procedural and technical
infrastructure that collects, stores, and
analyzes the data produced by a
company's activities. BI is a broad term
that encompasses data mining, process
analysis, performance benchmarking, and
descriptive analytics.
END.
Building a Data Warehouse
Data-Driven Approach
01
STARTING WITH DATA carefully designing how the data will be organized and stored.This
STRUCTURE: involves considering how different pieces of information relate to
each other and how they can be efficiently accessed and analyzed.
Building a Data Warehouse
Data-Driven Approach
02
OPTIMIZATION FOR The primary goal of structuring the data is to optimize it for
ANALYSIS AND analysis and reporting purposes.
REPORTING
Building a Data Warehouse
Data-Driven Approach
03
BUILDING APPLICATIONS you can then develop applications and tools that leverage this
AND TOOLS AROUND well-organized data.
DATA:
Building a Data Warehouse
Data-Driven Approach
04
LIBRARY ANALOGY This allows for greater flexibility in how the data can be stored,
accessed, and analyzed.
DATA ANALYSIS
TECHNIQUES
The techniques of data analysis can
impact the type of data model
selected and its content.
Data Analysis. Several methods of data analysis are in common use
NORMALIZED DATA
MODEL:
REPORT
PREPARATION
REPORT DELIVERY
Query and Reporting. The process of query and reporting starts with query
definition and ends with
report delivery