Big data ecosystem

•

0 j'aime•396 vues

SlideCentral

BigData Ecosystem

Données & analyses

Distributed Filesystem
Apache HDFS
Red Hat GlusterFS
NoSQL Databases
Apache Hbase
Apache Cassandra
Key-Value Data Model
Redis DB
LinkedIN Voldermort
Distributed Filesystem
Apache HDFS
Red Hat GlusterFS
Distributed Programming
Apache MapReduce
Apache Pig
Document Data Model
MongoDB
RethinkDB
Graph Data Model
ArangoDB
TitanDB
Distributed Filesystem
Apache HDFS
Red Hat GlusterFS
Here is a limited list of the BigData Ecosystem
@EdPimentl

Data Ingestion
Apache Flume
Apache Storm
Scheduling
Apache Falcon
Apache Oozie
System Development
Apache Ambari
Cloudera HUE
Apache Mesos
Service Programming
Apache Zookeeper
LinkedIn Norbert
Twitter Elephant Bird
Machine Learning
WEKA
Cloudera Oryx
Apache Mahout
Others
Accumulo
SQL-on-Hadoop
Apache Hive
Apache Drill
Here is a limited list of the BigData Ecosystem
@EdPimentl

What is a Byte, Kilobyte, Megabyte, Gigabyte, Terabyte, Petabyte, and Exabyte?
Bytes(8 bits)
0.1 bytes:A binary decision
Kilobyte (1000 bytes)
2 Kilobytes:A Typewritten page
Megabyte (1 000 000 bytes)
2 Megabytes:A high resolution photograph
Gigabyte (1 000 000 000 bytes)
1 Gigabyte:A pickup truck ﬁlled with paper OR A symphony in high-ﬁdelity sound OR A movie at TV quality
Terabyte (1 000 000 000 000 bytes)
10 Terabytes:The printed collection of the US Library of Congress
Petabyte (1 000 000 000 000 000 bytes)
2 Petabytes:All US academic research libraries
20 Petabytes: Production of hard-disk drives in 1995
Exabyte (1 000 000 000 000 000 000 bytes)
5 Exabytes:All words ever spoken by human beings
Nice description by Julian Bunn

Related Links
Open Data will hit every industry sector within 10 years https://lnkd.in/eBbzTY7
http://blog.knuthaugen.no/2010/03/a-brief-history-of-nosql.html
http://www.zdnet.com/article/traditional-databases-vs-the-threat-from-in-memory-nosql/?_escaped_fragment_=#!
http://arstechnica.com/information-technology/2013/07/the-hot-new-technology-in-big-data-is-decades-old-sql/
@EdPimentl

Recommandé

Frequent itemset mining_on_hadoopSWAMI06

A Hadoop Primersogrady

Big Data Ecosystem - 1000 Simulated DronesEspeo Software

Big Data Processing with Hadoop-MapReduce in Cloud SystemsIntellipaat

2014 moore-dddc.titus.brown

Intro to cassandra + hadoopJeremy Hanna

SparkR: The Past, the Present and the Future-(Shivaram Venkataraman and Rui S...Spark Summit

Big Dataipower softwares

Recommandé

Frequent itemset mining_on_hadoopSWAMI06

A Hadoop Primersogrady

Big Data Ecosystem - 1000 Simulated DronesEspeo Software

Big Data Processing with Hadoop-MapReduce in Cloud SystemsIntellipaat

2014 moore-dddc.titus.brown

Intro to cassandra + hadoopJeremy Hanna

SparkR: The Past, the Present and the Future-(Shivaram Venkataraman and Rui S...Spark Summit

Big Dataipower softwares

Spark's Role in the Big Data Ecosystem (Spark Summit 2014)Databricks

Low latency access of bigdata using spark and sharkPradeep Kumar G.S

Insight_150115_DemoMatt Rubashkin

Fault Tolerance in HDFSEmad Soltani

Big Data Programming Using Hadoop WorkshopIMC Institute

Cassandra euJeremy Hanna

Genome-scale Big Data PipelinesLynn Langit

Bioinformatics Data Pipelines built by CSIRO on AWSLynn Langit

Hadoop admiin demosparrowAnalytics.com

ESIP 2018 - The Case for Archives of ConvenienceDan Pilone

Big Data & Hadoop Data AnalysisKoushik Mondal

FAST DATA PROCESSING WITH APACHE SPARKKamal Pradhan

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...kristgen

Genomic Scale Big Data PipelinesLynn Langit

Building Open Data Lakes on AWS with Debezium and Apache HudiGary Stafford

Spark what's new what's comingDatabricks

DataStructure Concepts-HEAP,HASH,GraphDurgadevi palani

Apache Con Eu2008 Hadoop Tour Tom Whitetomwhite

Introduction to Spark R with R studio - Mr. Pragith Sigmoid

Hadoop vs Spark | Which One to Choose? | Hadoop Training | Spark Training | E...Edureka!

Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Perficient, Inc.

Introducing the Big Data Ecosystem with Caserta Concepts & TalendCaserta

Contenu connexe

Tendances

Spark's Role in the Big Data Ecosystem (Spark Summit 2014)Databricks

Low latency access of bigdata using spark and sharkPradeep Kumar G.S

Insight_150115_DemoMatt Rubashkin

Fault Tolerance in HDFSEmad Soltani

Big Data Programming Using Hadoop WorkshopIMC Institute

Cassandra euJeremy Hanna

Genome-scale Big Data PipelinesLynn Langit

Bioinformatics Data Pipelines built by CSIRO on AWSLynn Langit

Hadoop admiin demosparrowAnalytics.com

ESIP 2018 - The Case for Archives of ConvenienceDan Pilone

Big Data & Hadoop Data AnalysisKoushik Mondal

FAST DATA PROCESSING WITH APACHE SPARKKamal Pradhan

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...kristgen

Genomic Scale Big Data PipelinesLynn Langit

Building Open Data Lakes on AWS with Debezium and Apache HudiGary Stafford

Spark what's new what's comingDatabricks

DataStructure Concepts-HEAP,HASH,GraphDurgadevi palani

Apache Con Eu2008 Hadoop Tour Tom Whitetomwhite

Introduction to Spark R with R studio - Mr. Pragith Sigmoid

Hadoop vs Spark | Which One to Choose? | Hadoop Training | Spark Training | E...Edureka!

Tendances (20)

Spark's Role in the Big Data Ecosystem (Spark Summit 2014)

Low latency access of bigdata using spark and shark

Insight_150115_Demo

Fault Tolerance in HDFS

Big Data Programming Using Hadoop Workshop

Cassandra eu

Genome-scale Big Data Pipelines

Bioinformatics Data Pipelines built by CSIRO on AWS

Hadoop admiin demo

ESIP 2018 - The Case for Archives of Convenience

Big Data & Hadoop Data Analysis

FAST DATA PROCESSING WITH APACHE SPARK

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Genomic Scale Big Data Pipelines

Building Open Data Lakes on AWS with Debezium and Apache Hudi

Spark what's new what's coming

DataStructure Concepts-HEAP,HASH,Graph

Apache Con Eu2008 Hadoop Tour Tom White

Introduction to Spark R with R studio - Mr. Pragith

Hadoop vs Spark | Which One to Choose? | Hadoop Training | Spark Training | E...

En vedette

Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Perficient, Inc.

Introducing the Big Data Ecosystem with Caserta Concepts & TalendCaserta

Evaluating Software Architecturesjew Kevin

Talend AS A ProductAbdul Manaf

Sybase To Oracle Migration for DBAsClearwater Technical Group Inc

Application retirement road_map_for_legacy_applicationsFrank Morris

Towards Neuro–Information Sciencejacekg

KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...Dr. Raju M. Mathew

Big Data and Hadoop - key drivers, ecosystem and use casesJeff Kelly

Simplifying Big Data ETL with TalendEdureka!

Big data + data science startup focus pointsTom Zorde

How to create intelligent Business Processes thanks to Big Data (BPM, Apache ...Kai Wähner

Sharing & Sustaining Ecosystem DataTERN Australia

Semiotics and Information ScienceFlorence Paisey

Talend Introduction by TSIRemain Software

Real time data servicesRelevate

Real Time Big DataInfoFarm

Big data ecosystemmagda3695

Talend Big Data Capabilities OverviewRajan Kanitkar

Big Data EcosystemIvo Vachkov

En vedette (20)

Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...

Introducing the Big Data Ecosystem with Caserta Concepts & Talend

Evaluating Software Architectures

Talend AS A Product

Sybase To Oracle Migration for DBAs

Application retirement road_map_for_legacy_applications

Towards Neuro–Information Science

KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...

Big Data and Hadoop - key drivers, ecosystem and use cases

Simplifying Big Data ETL with Talend

Big data + data science startup focus points

How to create intelligent Business Processes thanks to Big Data (BPM, Apache ...

Sharing & Sustaining Ecosystem Data

Semiotics and Information Science

Talend Introduction by TSI

Real time data services

Real Time Big Data

Big data ecosystem

Talend Big Data Capabilities Overview

Big Data Ecosystem

Similaire à Big data ecosystem

Big Data A La Carte MenuVenkatesh Balakumar

Hadoop: Distributed Data ProcessingCloudera, Inc.

Big Data Analytics with Hadoop, MongoDB and SQL ServerMark Kromer

Eric Baldeschwieler Keynote from Storage Developers ConferenceHortonworks

Hadoop training by keylabsSiva Sankar

Hands on Hadoop and pigSudar Muthu

Handling not so big dataSATOSHI TAGOMORI

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune amrutupre

Hadoop: An Industry PerspectiveCloudera, Inc.

Hadoop_arunam_pptjerrin joseph

Hadoop basicsLaxmi Rauth

Big Data and HadoopFlavio Vit

Big Data & Analytics (CSE6005) L6.pptxAnonymous9etQKwW

Hadoop and big data trainingagiamas

How Hadoop Revolutionized Data Warehousing at Yahoo and FacebookAmr Awadallah

Hadoop DeveloperEdureka!

hadoop_moduleArmy Public School and College -Faisal

Overview of big data & hadoop version 1 - Tony NguyenThanh Nguyen

Overview of Big data, Hadoop and Microsoft BI - version1Thanh Nguyen

Hadoop ecosystem framework n hadoop in live environmentDelhi/NCR HUG

Similaire à Big data ecosystem (20)

Big Data A La Carte Menu

Hadoop: Distributed Data Processing

Big Data Analytics with Hadoop, MongoDB and SQL Server

Eric Baldeschwieler Keynote from Storage Developers Conference

Hadoop training by keylabs

Hands on Hadoop and pig

Handling not so big data

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Hadoop: An Industry Perspective

Hadoop_arunam_ppt

Hadoop basics

Big Data and Hadoop

Big Data & Analytics (CSE6005) L6.pptx

Hadoop and big data training

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

Hadoop Developer

hadoop_module

Overview of big data & hadoop version 1 - Tony Nguyen

Overview of Big data, Hadoop and Microsoft BI - version1

Hadoop ecosystem framework n hadoop in live environment

Plus de SlideCentral

AgileCO Labs Blockchain Consortium-2018-4.1SlideCentral

AgileCO Labs Blockchain Consortium2018_1SlideCentral

AgileCO Labs - Blockchain Consortium 2018SlideCentral

Blockchain 2Gether - EthEDU Training & EducationSlideCentral

Blockchain Chamber of CommerceSlideCentral

AgileCO-Labs WhiteLabel ICO-Services Blockchain-SolutionsSlideCentral

Plus de SlideCentral (6)

AgileCO Labs Blockchain Consortium-2018-4.1

AgileCO Labs Blockchain Consortium2018_1

AgileCO Labs - Blockchain Consortium 2018

Blockchain 2Gether - EthEDU Training & Education

Blockchain Chamber of Commerce

AgileCO-Labs WhiteLabel ICO-Services Blockchain-Solutions

Dernier

Principles and Practices of Data VisualizationKianJazayeri1

Real-Time AI Streaming - AI Max PrincetonTimothy Spann

Digital Marketing Plan, how digital marketing worksdeepakthakur548787

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics

Insurance Churn Prediction Data Analysis ProjectBoston Institute of Analytics

Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Boston Institute of Analytics

modul pembelajaran robotic Workshop _ by Slidesgo.pptxaleedritatuxx

Semantic Shed - Squashing and Squeezing.pptxMike Bennett

convolutional neural network and its applications.pdfSubhamKumar3239

English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml

Data Factory in Microsoft Fabric (MsBIP #82)Cathrine Wilhelmsen

Student Profile Sample report on improving academic performance by uniting gr...Seán Kennedy

Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ

NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...Amil Baba Dawood bangali

SMOTE and K-Fold Cross Validation-Presentation.pptxHaritikaChhatwal1

Student profile product demonstration on grades, ability, well-being and mind...Seán Kennedy

Decoding Patterns: Customer Churn Prediction Data Analysis ProjectBoston Institute of Analytics

What To Do For World Nature Conservation Day by Slidesgo.pptxSimranPal17

INTRODUCTION TO Natural language processingsocarem879

Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics

Dernier (20)

Principles and Practices of Data Visualization

Real-Time AI Streaming - AI Max Princeton

Digital Marketing Plan, how digital marketing works

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...

Insurance Churn Prediction Data Analysis Project

Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...

modul pembelajaran robotic Workshop _ by Slidesgo.pptx

Semantic Shed - Squashing and Squeezing.pptx

convolutional neural network and its applications.pdf

English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf

Data Factory in Microsoft Fabric (MsBIP #82)

Student Profile Sample report on improving academic performance by uniting gr...

Advanced Machine Learning for Business Professionals

NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...

SMOTE and K-Fold Cross Validation-Presentation.pptx

Student profile product demonstration on grades, ability, well-being and mind...

Decoding Patterns: Customer Churn Prediction Data Analysis Project

What To Do For World Nature Conservation Day by Slidesgo.pptx

INTRODUCTION TO Natural language processing

Bank Loan Approval Analysis: A Comprehensive Data Analysis Project

Big data ecosystem

1. BigDATA EcoSystem @EdPimentl

2. Distributed Filesystem Apache HDFS Red Hat GlusterFS NoSQL Databases Apache Hbase Apache Cassandra Key-Value Data Model Redis DB LinkedIN Voldermort Distributed Filesystem Apache HDFS Red Hat GlusterFS Distributed Programming Apache MapReduce Apache Pig Document Data Model MongoDB RethinkDB Graph Data Model ArangoDB TitanDB Distributed Filesystem Apache HDFS Red Hat GlusterFS Here is a limited list of the BigData Ecosystem @EdPimentl

3. Data Ingestion Apache Flume Apache Storm Scheduling Apache Falcon Apache Oozie System Development Apache Ambari Cloudera HUE Apache Mesos Service Programming Apache Zookeeper LinkedIn Norbert Twitter Elephant Bird Machine Learning WEKA Cloudera Oryx Apache Mahout Others Accumulo SQL-on-Hadoop Apache Hive Apache Drill Here is a limited list of the BigData Ecosystem @EdPimentl

4. What is a Byte, Kilobyte, Megabyte, Gigabyte, Terabyte, Petabyte, and Exabyte? Bytes(8 bits) 0.1 bytes:A binary decision Kilobyte (1000 bytes) 2 Kilobytes:A Typewritten page Megabyte (1 000 000 bytes) 2 Megabytes:A high resolution photograph Gigabyte (1 000 000 000 bytes) 1 Gigabyte:A pickup truck ﬁlled with paper OR A symphony in high-ﬁdelity sound OR A movie at TV quality Terabyte (1 000 000 000 000 bytes) 10 Terabytes:The printed collection of the US Library of Congress Petabyte (1 000 000 000 000 000 bytes) 2 Petabytes:All US academic research libraries 20 Petabytes: Production of hard-disk drives in 1995 Exabyte (1 000 000 000 000 000 000 bytes) 5 Exabytes:All words ever spoken by human beings Nice description by Julian Bunn

5. Related Links Open Data will hit every industry sector within 10 years https://lnkd.in/eBbzTY7 http://blog.knuthaugen.no/2010/03/a-brief-history-of-nosql.html http://www.zdnet.com/article/traditional-databases-vs-the-threat-from-in-memory-nosql/?_escaped_fragment_=#! http://arstechnica.com/information-technology/2013/07/the-hot-new-technology-in-big-data-is-decades-old-sql/ @EdPimentl