Cloudera Deployment

Architecture for Pagcor Project

1
Pagcor Enterprise Data Lake Deployment
Using EDH as the Platform

OnPremise Other Cloud

(if any)

AWS Cloud
Structured Data Cloud
Oracle
Sqoop
JDBC / ODBC
MySQL

Semi-Structured Data
HDFS
Commands

Flafka(if
needed) 2
EDH Platform
Fast for Business
More insights for more users, at lower TCO.

PROCESS, ANALYZE, SERVE

In-Memory Data Processing
Apache Spark
BATCH STREAM SQL SEARCH SDK
Spark, Hive, Pig Spark Impala Solr Partners
Partners
MapReduce
MPP Analytic SQL, Built for BI
UNIFIED SERVICES Impala
RESOURCE MANAGEMENT SECURITY DATA
DATA
YARN Sentry,
Sentry, RecordService
RecordService
MANAGEMENT
MANAGEMENT
Cloudera Navigator
Native Search
Cloudera Navigator
FILESYSTEM RELATIONAL NoSQL
NoSQL
Encrypt and KeyTrustee
Encrypt and KeyTrustee
Optimizer
Apache Solr
HDFS Kudu HBase
HBase

STORE Updateable Analytic Storage

BATCH REAL-TIME Kudu
Sqoop Kafka, Flume

INTEGRATE Real-time Serving

HBase

3
EDH Platform
Easy to Manage
Hadoop is complex. We make it simple, so you can focus on results.

PROCESS, ANALYZE, SERVE

BATCH STREAM SQL SEARCH SDK
Powerful Cluster Operations Spark, Hive, Pig
MapReduce Spark Impala Solr Partners
Kite

Cloudera Manager
UNIFIED SERVICES

Hybrid Cloud Operations OPERATIONS

RESOURCE MANAGEMENT
YARN
SECURITY
Sentry,
Sentry, RecordService
RecordService

Cloudera Director across Cloudera Manager

Cloudera Director
Amazon, Google, Microsoft FILESYSTEM RELATIONAL NoSQL
NoSQL
HDFS Kudu HBase
HBase

STORE
Predictive, Proactive Help
Cloudera Support BATCH
STRUCTURED REAL-TIME
UNSTRUCTURED
Sqoop Kafka, Flume

INTEGRATE

4
EDH Platform
Secure without Compromise
Security and Compliance are Not Opt-In Activities

PROCESS, ANALYZE, SERVE Enterprise Encryption

BATCH
Protects everything transparently
STREAM SQL SEARCH SDK
Spark, Hive, Pig Spark Impala Solr Kite
MapReduce
Uniform Access Policy
UNIFIED SERVICES Enforcement
RESOURCE MANAGEMENT SECURITY DATA Full-stack row/column-based RBAC
YARN Sentry, RecordService
OPERATIONS MANAGEMENT and dynamic masking
Cloudera Manager Cloudera Navigator
Cloudera Director Encrypt and KeyTrustee
FILESYSTEM
HDFS
RELATIONAL
Kudu
NoSQL
HBase
Optimizer Automated Data Management
Full-stack audit, lineage, discovery,
STORE and lifecycle
STRUCTURED UNSTRUCTURED
Sqoop Kafka, Flume Secure Operations
INTEGRATE Separation of duties, log data redaction

5
Connecting to Zoomdata
Takes the Question To The Data

Smart Connectors

Cloudera Suite of Connectors

Impala Search
Kudu Spark

6
Data Discovery
Real Time Analytics
Stream Processing Engine

Designed for Business Users

Dashboards Analytics
Visualizations Touch

Data Fusion
Integrated data view

7
 Cloudera/Zoomdata Solution Overview

Connect
Native Source Access
Pre-Built Connectors
Eliminate redundant data
Stream Processing Engine
Supports billions of records
Data DVR/Comparison/Search
Real Time analytics
Visualize
D3.JS Visualizations
Any Device Support
Interactive Experience
Business Value
Search/Filter/Report
Analyze/Trend
Solve Complex Data Problems

8 8
 Solution Integration
Pre-built connectors Key Advantages
Supports data streaming
Supports Cloudera Impala and Search Time To Value
Automates integration, accelerates time to value
Visualize Cloudera
Leveraging Clouderas Innovations
Facets
Search
Micro-query on Impala
Cloudera QuickStart VM
Can be deployed within their Virtual box
AWS Support
Deployed Zoomdata/Cloudera for multiple customers

9 9
Representative Sample Architecture

Enterprise Zoomdata Server

Data Hub

Admin API Executive

Source Data

x Billion Transactions/ All Features/ Smart

Processing Pipeline
Capabilities Connectors Analysts
Day

Analysts
Analytics Fusion Caching

Cloud or On-Premise Cloud or On-Premise

10
Representative Sample Architecture another view
Customer Insights Deployment

CSI/NPS Data Analytic Database Zoomdata Server

Scores & Verbatims
Periodic Updates Impala Improve
Admin API Customer
Network/Log Data Kudu
Satisfaction
Large Volumes
Real Time Navigator Optimizer
Smart Reduce
Navigator Processing Pipeline
Social Media Audit, Lineage
Connectors Churn
Multiple Sources Navigator
Streaming Encryption & Key Trustee
Targeted
Subscription Data
Hive on Spark Campaign
Secure Analytics Fusion Caching
Periodic Updates Basic Hadoop

Cloud or On-Premise Cloud or On-Premise

11