DataGovernancePrimer Hosch 2018-11-04
DataGovernancePrimer Hosch 2018-11-04
DataGovernancePrimer Hosch 2018-11-04
1
Overview
Data governance concepts and major aspects
Maturity models
Technological “solutions”
2
Outcomes for workshop participants
Identify characteristics of
a data governance Discuss how technology Explain principles of
system; analyze where may assist but not change management in Construct an action plan
their own institution has perform data higher education for next steps on their
gaps; and create an governance; describe institutions and how they own campus to advance
outline for how data major functions of data will enable development data governance
governance could fit into governance software of data governance on activities
existing organizational applications or “solutions” their campuses
structures
3
What this workshop will not do
4
WHAT IS DATA GOVERNANCE?
5
Data Governance Definitions (Generic)
• “the execution and enforcement of authority over the management of data
and data-related assets” - R. Seiner (2014)
6
Data Governance Definitions from Universities
• “the discipline which provides all data management practices with the
necessary structure, strategy, and support needed to ensure that data are
managed and used as a critical University asset” – U of Rochester
7
The 5-second elevator definition
• a set of guidelines
Data for how people
governance behave and make
is … decisions about data
8
Master data management is often confused with data
governance
9
Important characteristics of DG definitions
Data governance IS Data Governance IS NOT
• More about people and • IT’s responsibility
behavior than data
• Solved by technology
• A system that requires and
promotes shared agreement • Equally applied across all
data assets
• Formal (i.e. written down)
10
Activity 1 – What data governance features do you have?
Formal Informal
• List formal and informal structures you have for promoting
Policies/Practices data governance
Groups
Roles
Responsibilities
11
WHY DO WE NEED DATA GOVERNANCE?
12
Justifications for Data Governance
Educause (2015). “The compelling case for data governance,” retrieved October 15, 2018 from
https://library.educause.edu/~/media/files/library/2015/3/ewg1501-pdf.pdf
14
Justifications for Data Governance – Cost (1)
Gartner. (2014). “Why data governance matters to your online business,” retrieved August 1, 2016
from http://www.gartner.com/newsroom/id/1898914s-why-data-governance-matters-to-your-online-business/
15
Justifications for Data Governance – Cost (2)
IBM. (n.d.). “Extracting business value from the 4 V's of big data,” retrieved October 1, 2018 from
https://www.ibmbigdatahub.com/infographic/extracting-business-value-4-vs-big-data
16
Justifications for Data Governance – Cost (3)
Forbes (2017). “Poor-quality data imposes costs and risks on businesses,” retrieved
October 22, 2018 from https://
www.forbes.com/sites/forbespr/2017/05/31/poor-quality-data-imposes-costs-and-risk
s-on-businesses-says-new-forbes-insights-report
17
Justifications for Data Governance - Risks
Fines Imposed by Federal Student Aid
Fiscal Year Clery/Part 86 Imposed Fines IPEDS Imposed Fines Other Imposed Fines Total Imposed Fines
18
Data as an Asset
19
Data as an Asset for Universities
Generic Example At Colleges & Universities
20
Who owns the data?
21
Activity 2 - Why do we need data governance?
• Costs – what costs are you incurring because data are not well
governed?
• Risks – what risks are you taking because data are not well governed?
22
FEATURES OF DATA GOVERNANCE
23
Key features of data governance systems
• Positions/office to
support DG
24
Principles and values
25
Principles of Data Governance (Generic)
Ownership and
Consistency of data in its
Quality which is accountability defined
sourcing and in its
proactively assessed and across the data lifecycle
vocabulary, definitions,
standards applied and recorded in the
and taxonomies
information asset register
Source: Carruthers, C. & Jackson, P. (2018). The chief data officer’s playbook, London: Facet, p. 145 26
Principles and Values – Example
University of Wisconsin - Madison
Accountability Determining who is responsible for the management of data at UW Madison as well as
holding them to our outlined standards.
Stewardship Determine formal roles for those in charge of data. This does not mean that everyone on
campus is not responsible despite formal roles.
Transparency We will make it clear how and when decisions are made and when processes are
created. We also strive to ensure that decisions and processes are audited to
support compliance based requirements.
Source: https://data.wisc.edu/data-governance/#principles 27
Principles and Values – Example
Stony Brook University
Values
Shared Assets Stewardship Quality Privacy &
Data and information Employees of Stony Brook University To ensure data Confidentiality
are shared have a responsibility for the curation retain value, Maintenance of individual
organizational of data. They serve as caretakers of quality of data privacy and confidentiality of
resources that data to ensure data are collected, is actively educational and personal
constitute valuable stored, and maintained under the monitored and records represent not only
assets. premise that others will access and maintained legal requirements but also
use them over time primary outcomes of data
management.
Source: https://www.stonybrook.edu/commcms/irpe/about/_files/DataGovFramework.pdf 28
Principles and Values – Example
Brown University
Guiding Principles of Data Governance at Brown
Source: https://www.brown.edu/about/administration/data-governance/introduction-data-governance-brown 29
Connect Data Governance to Mission
30
Activity 3 - Distill university mission
31
Example
Stony Brook’s framework for data governance outlines a set of
principles, structures, roles, and responsibilities to improve the
data infrastructure and to advance institutional goals
32
Structure – Generic Example
Executive Steering Committee
• Authorized to change the organization
• Drives cultural change
• Supports the program enterprise-wide
• Provides funding for the Data Governance Program
Data Governance Board
• Made up of high-ranking representatives of data- owning business
functions who can make decisions about data for the company
• Assign members of the Data Stewardship Council
• Approve decisions of the Data Stewardship Council
• Approve data-related policies
Business Data Stewards
• Experts on use of their data domain data
• Able to reach out to SMEs to gather information and make
decisions
• Typically someone who others come to as the most knowledgeable
about the meaning of the data (and how it is calculated)
• Makes recommendations on data decisions and write data-related
procedures
Plotkin (2014). Data stewardship: An actionable guide to effective data management 33
Structure – University of Wisconsin-Madison
Data Governance Steering Committee
• provides executive level guidance to the program
• promotes Data Governance across UW-Madison
• allows for / facilitates data-driven decision making
• determines priority and budget of major data-
related projects.
34
Structure – Stanford University
BI Competency Ctr. Steering Committee
• Cross-functional oversight & communicates
long-term value of BI program
• Achieves peer buy-in, and effects change in
business process and data quality
• DG adopters and champions
• Ensures alignment of DG with university goals
Data Governance Committee
• Sets & incorporates DG policies, standards,
procedures, roles & responsibilities
• Includes lead steward from each of the data
steward groups, plus reps from additional units
Data Stewardship Groups
• Provide metadata infrastructure to support
improved decision-making university-wide
• Ensure information integrity
• Build data knowledge
• Meet compliance requirements
• SMEs who define reporting terms and gather
metadata associated with their reporting
environment
35
Structure – Stony Brook University
VP Council (Project 50 Forward SteerCo)
• Executive sponsors of project
• Establishes authority and purview of data
VP Council governance system
Human
Finance Student
Resources
Data
Data Stewards Data Stewards
Stewards
36
Policy-Making Body - Data Governance Council
Ultimately is
accountable for Defines data strategy
business data use, Makes strategic and based on business
data quality, and tactical decisions strategy and
prioritization of requirements
issues
38
Data Stewardship Definitions
• Data stewardship is the most common label to describe accountability and
responsibility for data and processes that ensure effective control and use of data
assets. – Knight (2017)
• Data Stewardship is concerned with taking care of data assets that do not belong to
the stewards themselves. Data Stewards represent the concerns of others. Some
may represent the needs of the entire organization. Others may be tasked with
representing a smaller constituency: a business unit, department, or even a set of
data themselves. – Data Governance Institute (n.d.)
39
Types of Data Stewards
Business Data Technical Data Domain Data Project Data Operational Data
Steward Steward Steward Steward Steward
• Accountable for data • Provide expertise on • Business steward for • Represent data • Provide support to
owned by business area applications, ETL, data widely shared data stewardship on projects business data stewards
• Work with stakeholders to stores, and other links in • Work with business • Funded by projects • Recommend changes to
make recommendations on information chain stewards as stakeholders • Work with business data improve data quality
data issues • Assigned by IT leadership to achieve consensus stewards to obtain info • Help enforce business
• Manage metadata for their to support data and make rules for the data they use
data governance recommendations about
• Champion data data stewarded by
stewardship for their areas business stewards
• Notify business data
stewards about data issues
raised by the project
Dyché & Polsky (2014). “Five models for data stewardship” SAS Whitepaper 41
Data Steward Responsibilities
Oversee management of selected data assets
42
Data Stewardship Council/Committee(s)
(Functional)
Set and review
definitions, data Consider and
Coordinate data Ensure dictionary
quality rules, approve changes &
stewards in related standards are
creation/usage rules, additions to code
area followed in area
determines official sets
version of metadata
43
Stony Brook Roles and Responsibilities Matrix
Functional Data
Data Governance Council Data Stewards
Governance Cmtes
Define, Establish, Monitors, Cross functional
Standards and Functional
Audit, Verify, Develop, implementation,
Policies implementation
Revise coordination
Identify,
Prioritize levels Review audit reports,
Adopt enterprise-wide DQ
Data Quality Monitor area Coordinate clean-up,
tool
Identify needs Initial prioritization
Big picture
Review,
Monitor area Monitor
Metrics Identify,
Identify are priorities Remediate
Monitor
B 44
44
Data users
Recognize that
Respect the
institutional data and Include privacy of
information derived
• Often
from it are not considered
potentially in
information data
about governance
individuals
systems
whose
records they may
but should be
Report
complex. Make efforts the data source Ensure that
to understand the • and Example formal responsibilities (Stony
or Brook)
access. data
criteria when passwords
Unauthorized quality
source, meaning and distributing data, other security
proper use of the data
disclosure or issues to
reports and ad misuse of mechanisms
through training appropri
hoc analytics to institutional are used for
sessions, utilizing data ate data
guard against information sensitive data
dictionaries and steward
knowledge of misinterpretations stored on any
of data. device is
supporting system
prohibited
processes.
45
Administrative Office / Positions Supporting Data
Governance
• In general, offices and positions dedicated to supporting data
governance are still emerging in higher education
Chief Data Officer Data Governance Program Manager
Pomerantz, J. (2017) IT leadership in higher education: The chief data officer. Educause.
46
Research Report. Louisville, CO:ECAR.
MATURITY MODELS
47
Assess your current state of data governance
48
Activity 4: Data Governance Maturity Model
Level 1 Level 2 Level 3 Level 4 Level 5
49
Activity 4: Data Governance Maturity Model
Enter rating 1 through 5 based on maturity model rubric
Finance data Student data HR data Research data Facilities data Overall
Data
Governance
Culture
Data Quality
Communication
Roles &
Responsibilities
50
Stony Brook Data Governance Maturity Model
Initial Results – Spring 2016
51
Current BaselineTarget
2017
2015
Dimensions Maturity
Data Governance Integrated & Optimized
Communication Developing
Roles & Informal
Responsibilities
K 52
52
CHANGE MANAGEMENT
IN HIGHER EDUCATION
53
54
Elements to change management
55
Activity 5 – Assemble your group
• Identify
56
Case Study – Stony Brook University
Data
Data quality Communication
governance
57
Charge for data governance (first 9 months)
Examine existing governance Identify and articulate
structures • Roles of cross-functional groups
• active and inactive groups and • Functional roles in business units
lines of responsibility (e.g. data owner, data custodian,
• existing processes, practices and report owner) will also be
procedures that significantly identified and articulated.
impact data management and
stakeholders.
58
Charge for data quality improvement
Examine existing practices for Articulate and publish practices
ensuring data quality within the for developing, maintaining, and
Data Warehouse and may extend to communicating
quality assurance practices in • data definitions (such as
functional systems. robust data dictionaries)
• transparent source
information
• update schedules
• error check practices and
• clean-up procedures
59
Charge for training and communication
Develop a communication plan for
• How new capabilities for business intelligence go beyond initial
reporting functionality.
• Availability
• Use limitations, and opportunities
• including needs identification for documentation, training,
workshops, etc.
60
Example initial process for data collection
list three current data governance list three aspects of data governance
• With
mechanisms at broadly representative
our [INSTITUTION], the planning
that are absentgroup (~20 people),
at [INSTITUTION] or
systems or applications they cover
conduct focus group with neednotecards
to be strengthened
and flipchart
FOCUS GROUP
ACTIVITY
list three roles or structures that should
list three things that data governance be included in [INSTITUTION’S] data
at [INSTITUTION] should accomplish governance system.
61
Activity 6 – Draft input for planning process
62
TECHNOLOGICAL “SOLUTIONS”
63
Technology applications for data governance
Data dictionary management
Technology
can support data Data quality analysis
governance
Master data management
64
Data governance applications / vendors
• Allows management of data definitions
• Manages metadata within reporting environments
• Online service to communicate and define reporting terms
• Allows users to view definitions and terminology in reports
• Full suite of metadata management and data quality tools
• Issue resolution workflow functionality
• Some users report complexity and not making use of full
functionality
• Data quality tool only
• No metadata management
• Metadata management tool only.
• Integration with reporting tools, website search and manage data
definitions.
• Integrated with active directory security
• No data quality validation or profiling tools
65
Other vendors / products
66
Issues to consider when selecting technology
• User community
67
FINAL THOUGHTS
68
Takeaways
• Data governance is more about people than data
• All higher ed change management principals apply
• Process and written documents are essential
• Leadership support
• Broad-based consultation, including faculty
• Opportunity for consultation
• Representation
• Software can help, but it won’t fix broken processes or
organizations
• Starting data governance is hard work; sustaining it is harder
69
Data governance is only one part of a data strategy
Data access
70