This document discusses data governance and provides guidance on getting started with a data governance program. It outlines key building blocks like a data catalog, workflows, and business and technical lineage. It also covers challenges like governing a multi-store data environment and ensuring data quality. The document recommends starting with understanding your data and building out foundational elements like a data catalog before operationalizing governance through workflows.

1. From the Data Governance trenches
A real-life perspective

2. 2
From the Data Governance trenches
19/10/2019
Find
Understand
Trust
How to better
Your Data

3. 3
Agenda
•
•
•
•
•
•
•
•
19/10/2019

4. Why Data Governance?

5. 5
Find and
Understand
Relevant
for me
How to
access
the data
For which
purpose
to use
Who can I
share it
with
Who is
the SME
Who has
used it
before
Which
data is
similar
Linked
business
terms
Trust
Certified?
Quality
Reviews
Historical
usage
Is it governed?
Trusted
source?
Cross industry studies show that, on average, less than half of an organization’s structured data is
actively used in making decisions - HBR
Find, Understand and Trust Find Understand Trust

6. Data Governance Building Blocks

7. 7
Building Blocks
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
DataGovernanceBuildingBlocks

8. 8
Building Blocks - A Glossary Example
DataGovernanceBuildingBlocks

9. 9
Building Blocks - Search
19/10/2019
DataGovernanceBuildingBlocks

10. 10
19/10/2019
Building Blocks - Data Catalog –Search
DataGovernanceBuildingBlocks

11. 11
19/10/2019
Building Blocks - Workflow – Critical to operationalize
DataGovernanceBuildingBlocks

12. 12
Building Blocks - Typical Workflows
19/10/2019
DataGovernanceBuildingBlocks

13. 13
Building Blocks - Business Lineage
19/10/2019
DataGovernanceBuildingBlocks

14. 14
19/10/2019
Building Blocks - Technical Lineage
DataGovernanceBuildingBlocks

15. 15
Building Blocks - End-to-End Lineage – For Compliance
19/10/2019
DataGovernanceBuildingBlocks

16. 16
19/10/2019
Building Blocks –
MDM example - Relation to Business Process and Rules
DataGovernanceBuildingBlocks

17. GDPR As Part Of Your DG

18. 18
GDPR Data Register - Connected & Reusable
GDPR
Data Sets
Processes
Data
Elements
Roles
Systems
Terms and
definitions
Projects …
GDPRAsPartOfYourDG

19. 19
19/10/2019
GDPRAsPartOfYourDG

20. GDPRAsPartOfYourDG

21. Business Relevant Data Quality
Metrics

22. 22Data Quality results
Fine grained measured in a DQ tool and uploaded
19/10/2019
BusinessRelevantDataQualityMetrics

23. 23
Data Quality results – Aggregated to a higher level
19/10/2019
BusinessRelevantDataQualityMetrics

24. 24
Example of DQ issue analysis of a report
19/10/2019
BusinessRelevantDataQualityMetrics

25. 25
Data Quality results – Aggregated from column level to report level
19/10/2019
BusinessRelevantDataQualityMetrics

26. 26
Tags, Ratings, Comments...
19/10/2019
BusinessRelevantDataQualityMetrics

27. Governing A Multi-Store Reality

28. 28
The Multiple Data Store Reality
19/10/2019
Applications BI and visualisation tools Advanced analytics
Structured Data Semi structured and Unstructured Data
SQL NoSQL Real Time Python R….
GoverningAMulti-StoreReality

29. 29
A Popular Data Integration Pattern
Structured Data
MDM
Party Prod
Loc
EDW
DM
Graph
database
Appliance
Semi structured and Unstructured Data
•
•
•
•
•
•
•
GoverningAMulti-StoreReality

30. 30
Logical Data Lake
19/10/2019
Structured Data
MDM
Party Prod
Loc
Semi structured and Unstructured Data
ODS
DW
DM
Staging
Images
Video Sensor
Published
Archived
In
progress
data
text
Data Virtualization services Data Catalog - Glossary
RawUnstructured
lessgoverned
Trusted-governed
Data Consumers
GoverningAMulti-StoreReality

31. 31
Data Catalog – Fundamental Role
19/10/2019
Raw
Data
Clean and
Integrate
service
Trusted Data
Data Catalog
Re-usable Data
Service
Raw
Data
Producers
Clean and
Integrate
service
Publish
Consume
Trusted Data
Reuse data or service Feedback
Consumers
Validation and Certification
GoverningAMulti-StoreReality

32. 32
Feature Promise < > Governance Nightmare
19/10/2019
•
•
GoverningAMulti-StoreReality

33. 33
How to bring in volatile/variety of sources?
ETL ETL ETL
ETL ETL
DMDWH
Staging
Areas
Source
systems
ETL ETL ETL ETL
GoverningAMulti-StoreReality

34. 34
Logical DWH Architecture
ETL ETL ETL
DMDWH
Staging
Areas
Source
systems
DataVirtualizationServer
AbstractionFederationCaching
GoverningAMulti-StoreReality

35. Getting Started

36. 37
Getting Started
•
•
•
•
•
•
•
19/10/2019

37. Q&A
DATALUMEN, VELDKANT 31, 2550 KONTICH, BELGIUM
WWW.DATALUMEN.EU