Business Intelligence Training Deck

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test processes and scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 2

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 3

What is Business Intelligence?

Business intelligence (BI) is a broad category of applications and technologies for gathering, storing, analyzing, and providing access to data to help enterprise users make better business decisions.

BI applications include the activities of decision support systems, query and reporting, online analytical processing (OLAP), statistical analysis, forecasting, and data mining.

BI Testing Services | Testing Center of Excellence 4

Inputs to Business Intelligence

BI Testing Services | Testing Center of Excellence 5

Basics(elements) of BI

BI Testing Services | Testing Center of Excellence 6

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 7

Why BI Testing needed?

Data, its flow and its transformation in Business Intelligence Systems need to be carefully validated due to increasing reliance of Senior Executives across organizations, in all sectors, on this data to make data driven decisions which have significant impact on organizations. Importance The success of business decisions depends on the quality of underlying information It is difficult to obtain an Integrated view of the important dimensions of business to monitor, track and improve business performance Due to rapidly changing business environment, decisions may need to be based on near-real time data accuracy of data is very important Business Intelligence is essential for organizations that believe in adapting quickly to market changes and customer requirements and helps in modifying business rules according to the changing conditions. Effects of BI Testing Simpler faster cost-effective implementation Analytical mechanisms that enabled faster and more insightful decision-making Leads to improved efficiencies Improved Usability due to Integration Adapting quickly to changing business needs Cycle time is more

BI Testing Services | Testing Center of Excellence 8

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 9

How BI Testing is Different

BI Testing differs from testing of operational systems on several accounts. The key areas are described in this section below,
CHALLENGES in Business Intelligence Testing
Multiple, abstract sub-systems Sources Data Integration Extract, Match, Validate, Cleanse, Complete, Conform Data Structures Staging, ODS, EDW, Marts Presentation semantic layer, information delivery Multiple technologies & vendors RDBMS, ETL, Data Quality, MDM, Metadata Mgmt, Analytics & Reporting Interactive user interfaces to view data Data processed via backend data feeds BI systems not only need to be tested for validity of data processing as per business rules, but also for robust Data Integration & Reporting processes Extremely high, batch oriented Data processing BI Process Information presentation
Business Analysis

Complex Data Architecture

Technologies

Interfaces

I M P A C T

Organization Decisions

Data & BI Process Centric High Data Volumes Multiple Focus Areas

Strategic Planning

BI Testing Services | Testing Center of Excellence 10

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 11

Basic Skill set for BI Tester

Knowledge of SQL. Basic knowledge of UNIX Understanding of Data warehouse concepts Knowledge of ETL processes and tool Knowledge of Reporting tool Basic knowledge of marketing, sales, purchase and finance processes to understand the business needs

BI Testing Services | Testing Center of Excellence 12

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 13

Business Intelligence Workflow

Any tool, process or activity that can be used for obtaining the best information of supporting the decisionmaking process.

BI Testing Services | Testing Center of Excellence 14

BI Testing Approach

BI Testing Services | Testing Center of Excellence 15

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 16

Data Warehouse
A Data warehouse is a central repository of data which is created by integrating data from one or more disparate sources. Data warehouses store current as well as historical data and are used for creating trending reports for senior management reporting such as annual and quarterly comparisons.

BI Testing Services | Testing Center of Excellence 17

Important characteristics
Subject oriented Integrated Time- variant Non-volatile

BI Testing Services | Testing Center of Excellence 18

Data Warehouse Process Flow

BI Testing Services | Testing Center of Excellence 19

Data Marts
A data mart is a simple form of a data warehouse that is focused on a single subject (or functional area), such as Sales, Finance, or Marketing. Data marts are often built and controlled by a single department within an organization. Two types of Data Marts -Dependent -Independent

BI Testing Services | Testing Center of Excellence 20

Dependent Data marts

Top Down Approach or Dependent Data Marts (W.H.Inmon)

BI Testing Services | Testing Center of Excellence 21

Dependent Data marts

BI Testing Services | Testing Center of Excellence 22

Independent Data marts

Bottom-Up Approach or Independent Data Marts (Ralph Kimball)

BI Testing Services | Testing Center of Excellence 23

Independent Data marts

BI Testing Services | Testing Center of Excellence 24

BI Testing Services | Testing Center of Excellence 25

Data Warehouse - Dimensional Modeling Dimension Table

Dimension tables contain textual information that represents the attributes of the business Contain relatively static data Dimension tables are joined to a fact able through foreign key reference

Examples: Retail store name, zip code, product name, product category, day of week. Telecommunications -- call origin, call destination Banking customer name, account number, branch, account officer Insurance policy type, insured party

BI Testing Services | Testing Center of Excellence 26

Data Warehouse - Dimensional Modeling Fact Table

Contain numerical metrics of the business Can hold large volumes of data Can grow quickly

Examples: Retail number of units sold, sales amount Telecommunications Length of call in minutes, average number of calls Banking Average monthly balance

Insurance Claims amount

BI Testing Services | Testing Center of Excellence 27

Data Warehouse - Schemas

A schema is a collection of database objects, including tables, views, indexes, and synonyms. Data Warehouse environment usually transforms the relational data model into some special architectures. There are many schema models designed for data warehousing but the most commonly used are: Star Schema Snowflake Schema Fact constellation Schema Galaxy Schema

BI Testing Services | Testing Center of Excellence 28

Star Schema Example

BI Testing Services | Testing Center of Excellence 29

Snow Flake Schema Example

BI Testing Services | Testing Center of Excellence 30

Galaxy Schema Example

BI Testing Services | Testing Center of Excellence 31

Fact Constellation Schema Example

BI Testing Services | Testing Center of Excellence 32

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test processes and scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 33

ETL Introduction
ETL is a process used to collect data from various sources, transform the data depending on business rules/needs and load the data into a destination database Extract, Transform, Load, this three database functions that are combined into one tool to pull data out of one database and place it into another database The process of updating the data warehouse.

BI Testing Services | Testing Center of Excellence 34

ETL Tools
Informatica - Power Center IBM - Web sphere Data Stage SAP - Business Objects Data Integrator AB Initio

BI Testing Services | Testing Center of Excellence 35

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 36

ETL TEST PROCESS - Data extraction

Purpose
To show that all source data, for every data specification, with all known data errors will be handled correctly

Scope
All data extraction programs to be tested on samples of all source data files Source data have been tested, have been analyzed Test extraction (and SA filling) for every source file Test extraction (and SA filling) for every source / domain spec. Check extraction (and SA-filling) for every data item Test every data item on boundary values, on coded values Test all validation output Test all counters and totaling options

Prerequisites Techniques and requirements

ETL

SA

SA ETL

SA
DM BI
Queries

DM

BI

OLAP Reporting

SA ETL DWH DM BI
Data mining

BI Testing Services | Testing Center of Excellence 37

ETL TEST PROCESS Data transformation

Purpose
To show that all data transformation rules are implemented and do function as specified.
All data transformation programs to be tested against all transformation rules / specifications. Source data have been tested, have been analyzed Standard techniques to be applied for black box unit test Covering all data transformation rules as there are Coding and decoding of data values Consolidation of data records, production of totals Addition of linked data items

Scope

Prerequisites

Techniques and requirements

ETL

SA

SA ETL

SA
DM BI
Queries

DM

BI

OLAP Reporting

SA ETL DWH DM BI
Data mining

BI Testing Services | Testing Center of Excellence 38

ETL TEST PROCESS Data loading

Purpose
To show that all data loading (in the data warehouse) will function undisturbed without errors, performing as required From (final) staging area to data warehouse itself. Staging area data are available in full size preferable with more than one increment, in order to test for linearity Well require performance requirements in full Performance testing techniques and analysis tools to be used

Scope

ETL SA

Prerequisites

Techniques and requirements

SA ETL

SA
DM BI
Queries

DM

BI

OLAP Reporting

SA ETL DWH DM BI
Data mining

BI Testing Services | Testing Center of Excellence 39

ETL Test Scenario

Data insertion as per source target mapping sheet - Correctness of data based on transformation rules - Data types, length of source and targets - Duplicate data - Data loss - Data Quality Update of data as per defined update strategy Delete/Close scenarios as per defined strategy Data accuracy Metadata testing Scripts/Power jobs execution and dependencies

BI Testing Services | Testing Center of Excellence 40

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 41

Introduction to Reporting
Business intelligence reporting describe the practice of analyzing large amounts of data in the form of human readable format. Reports are summaries or collections of information about an aspect of an organizations business. They contain views of the current data in your organizations database, organized and formatted the way you want. You can use two types of data sources when creating reports: detailed and summary.

BI Testing Services | Testing Center of Excellence

42

BI Reporting tool architecture

BI Testing Services | Testing Center of Excellence 43

Reporting Process

BI Testing Services | Testing Center of Excellence 44

Reporting Tools
Business Objects Cognos BI Crystal Reports Micro Strategy Oracle Reports

BI Testing Services | Testing Center of Excellence 45

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 46

Reporting test scenarios

Prompt Type of prompt Description of prompt Default selection Values in prompt Search of value in prompt Minimum and Maximum selection Mandatory prompts Report Label and Headings Layout and Graphs Measures/Metrics Correctness of Data Page by and sorting Drilling Export

BI Testing Services | Testing Center of Excellence 47

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 48

Trust BI Methodology
DELIVER Project Delivery Methodology
Inception
Requirement Gathering Solution Definition Functionality Matrix Architecture

Elaboration
Use Cases, Technical Design, Data Model, Report Specification, ETL Mapping, ETL Process

Construction
Database Objects, ETL, Reports

Transition
Deployment Production Support & Maintenance

TrustBI Methodology
Initiate & Plan
Knowledge Acquisition Process Understand Requirements, Architecture, Testing Scope, Success Criteria, Risks Test cycles & alignment with SDLC Test Data Mgmt requirements Test Environment Requirements

Design
Test Plan & Cases objective, prerequisite, expected results UAT Performance Module Integration Tests Base line regression tests Test Data Mgmt Profile Test Data Source Test data slice size, frequency, periodicity Test env. privileges

Prepare
Setup test environment Scripts / procedures to mask & copy test data (from production) Profile data for test case fulfillment Scripts / procedures to create / procure missing test data Create SQL & associate data sets & expected results for test cases

Execute
Run test procedures for new code Identify impact on existing code and run regression tests Record results

Evaluate
Conduct severity and causal analysis Raise Change Requests, if required Log results

The TrustBI Methodology is based on our proven TMap methodology The focus is on Business & Risk driven testing Test Intensity & Test Data Mgmt are directly proportional to the project risks that are required to be mitigated

Activities

Test Project Plan Test Strategy

Scope Test Data Mgmt Test environment mgmt Defect management Change management Configuration mgmt. Test metrics & reporting Standards & Tools

Deliverables

UAT plans & cases Performance Testing plans & cases SIT plan & cases Module Testing plan & cases Test Data Mgmt plan Test data volumes to be used Test data refresh approach Test data masking algorithms Test data creation process

Test Environment Test Data Test Data creation scripts Test Cases associated test scripts, test data and expected results

Test results Defect logs

Test results severity & root cause Change Requests

BI Testing Services | Testing Center of Excellence 49

Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases

BI Testing Services | Testing Center of Excellence 50

Sample test cases

ETL Sample test cases as below -Inserted later on Reporting test cases as below -Inserted later on

BI Testing Services | Testing Center of Excellence 51

Q&A

BI Testing Services | Testing Center of Excellence 52

Thank You
BI Testing Services | Testing Center of Excellence 53