Data Stage Course Content: Unit-1 Data Warehousing Concepts
Data Stage Course Content: Unit-1 Data Warehousing Concepts
Data Stage Course Content: Unit-1 Data Warehousing Concepts
Unit-1
Data Warehousing Concepts
What is Data Warehouse
Enterprise DWH Database Evaluation
Data Acquisition
Data Cleansing
Data Scrubbing
Data Merging
OLTP&OLAP
Types of ETL Tools & Reporting Tools
Tables in Data Warehouse
Dimension Tables &Fact Tables
SCD Type-I, SCD Type-II, SCD Type-III
Types of Schemas
Data Quality& Data Profiling
B-Tree Index& Bit Map Index
Differences Between OLTP &Data Warehouse
ETL Project Life Cycle
Unit-2
Introduction to Data Stage
History and Features
About Ascential suite
Traditional Batch Processing
Partition & Pipeline parallelism
Partitioning & Re-Partitioning Techniques
Combining & Collecting Techniques
IBM Web Sphere DataStage&Quality Stage Architecture
Configuration File & Node Components
Unit-3
About Data Stage8.7
Differences between 7.5X2 & 8.X
Parallel Processing environments (SMP, MPP)
Information Analyzer Overview
DataStage & DataStage Quality stage overview
Web Console for Information Server
Unit-4
Types of Jobs in Data stage and Stages
Difference between server & parallel jobs
Overview of Parallel jobs, Server jobs, Mainframe jobs, migration jobs and job sequencing
jobs
Repository, DS Designer toolbar & Palette
Active and Passive stages
Unit-5
File Stages
Sequential file Stage
Data Set
File set & lookup File set
Differences between Dataset, File set & Sequential file stage
Complex flat file
Unit-6
Development Debugging Stages
Row Generator
Column Generator
Head Stage
Tail Stage
Sample Stage
Peek Stage
Unit-7
Relational Stages
Oracle Enterprise
ODBC Enterprise
Dynamic RDBMS
DB2 or UDB Enterprise
DB2 Connector
Dynamic RDBMS
ODBC connector
Unit-9
Processing Stages
Aggregator
Change Apply
Change Capture
Compare
Compress
Copy
Decode
Difference
Encode
Expand
Filter
Funnel
Join
Look up
Merge
Modify
Pivot
Remove Duplicate
External Filter
Sort
Surrogate Key Generator
Switch
Transformer
FTP
SCD
Unit-10
Real Time & Restructure Stages& Importing &Exporting Data Stage Components
XML Input & XML output stage
Column Export and Column Import Stage
Importing jobs &Exporting jobs
Parameter set
Table Definitions
Unit-11
Performance Tuning
Environmental Variables
Portioning Techniques
Techniques for Job Development
Data Rules stage
Local Container &Shared Container
Unit-12
Job Control & Job Sequencing Stages
Job Activity
Execute Command Activity
Notification Activity
Terminator Activity
Wait for file Activity
End Loop Activity
Start loop Activity
Sequencer
Unit-13
Introduction About Information Analyzer
Column Analysis
Base Line Analysis
Key Analysis
Cross Domain Analysis
Data rules &Rule Sets& Bench Mark
Unit-14
Introduction About Web console
Creating Users in Web Console
Assigning List of suite components to the users
Creating Users
Creating Group