INFRASTRUCTURE LAYER
Database
Analytics
Bigdata
INFORMATION LAYER
MULTI CHANNEL DELIVERY
Dashboard
Laptop
Mobile/Tablet
Email
SMS
Print
ANALYTICS LAYER
Realtime
Near Realtime
Reports + Statistics
Custom Tools
Data Processing
system generated data
dimensional data
de/normalize data
Data Ingestion/Extraction
external data
reference internal data
discovery data
Data Loading
operational data
business information data
Architecture - High Level
5
Big data -ETL+BI
ERP
Flat Files
CRM
Live Stream
RDBMS
Web Services
Extract
Transform
Load
Massive
Parallel
Processing
Distributed System
noSQL DB
warehouse DB(OLAP)
search
engines
Business Intelligence
Web Services
Data
Science
Data Monetization
Data Exploration
Data Visualisation
ETL
BI
Data transaction/history -> Interaction -> Observation -> Trends -> Decisions
capture data -> process/index -> storage-> share -> search -> analytics -> visualise
6
CONSISTENCY
(quorum)
AVAILABILITY
PARTITIONING
RDBMS
HP Vertica(Columnar)
Cassandra (Columnar)
Dynamo (Key-Value)
Couchbase(Document)
Riak (Document)
HDFS
HBase (Columnar)
MongoDB (Document)
Redis (Key-Value)