SlideShare une entreprise Scribd logo
1  sur  54
Télécharger pour lire hors ligne
1
Realtime Big Data at Facebook
with Hadoop and HBase


Jonathan Gray
July ,
Tokyo HBase Meetup



                                2
3
▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪




        4
5
6
6
▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪

    ▪




        7
▪

    ▪



▪

    ▪


▪

    ▪


▪




        8
▪

    ▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪




        9
▪

    ▪




▪

    ▪

    ▪

        ▪

        ▪

        ▪

        ▪




            10
11
▪

    ▪


▪

    ▪


▪

    ▪


    ▪




        12
▪

    ▪


▪

    ▪


    ▪


▪

    ▪




        13
▪

    ▪




▪

    ▪

    ▪

    ▪




▪




        14
15
▪

▪


▪


▪


▪




    16
17
17
17
17
18
18
18
18
19
19
19
19
20
20
20
▪

▪

▪

▪

▪




    21
22
23
24
▪

        ▪

        ▪

            ▪




▪

    ▪

    ▪

    ▪



                25
▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪

    ▪




        26
▪


▪

▪




    27
28
29
30
▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪

    ▪



        31
▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪

    ▪



        32
▪

    ▪

    ▪



    ▪

    ▪




▪

    ▪

    ▪


        33
34
35
36
▪

    ▪

    ▪

    ▪

        ▪

        ▪




▪

    ▪

    ▪


            37
38
39
▪

    ▪

    ▪

    ▪




▪

    ▪

    ▪

    ▪



        40
▪

    ▪


    ▪




▪



    ▪

    ▪

    ▪




        41
42

Contenu connexe

En vedette

HBase活用事例 #hbase_ca
HBase活用事例 #hbase_caHBase活用事例 #hbase_ca
HBase活用事例 #hbase_caCloudera Japan
 
Apache HBase - Introduction & Use Cases
Apache HBase - Introduction & Use CasesApache HBase - Introduction & Use Cases
Apache HBase - Introduction & Use CasesData Con LA
 
Apache HBase for Architects
Apache HBase for ArchitectsApache HBase for Architects
Apache HBase for ArchitectsNick Dimiduk
 
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL databaseHBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL databaseEdureka!
 
Integration of Hive and HBase
Integration of Hive and HBaseIntegration of Hive and HBase
Integration of Hive and HBaseHortonworks
 
Cassandraとh baseの比較して入門するno sql
Cassandraとh baseの比較して入門するno sqlCassandraとh baseの比較して入門するno sql
Cassandraとh baseの比較して入門するno sqlYutuki r
 
HBaseCon 2012 | HBase Schema Design - Ian Varley, Salesforce
HBaseCon 2012 | HBase Schema Design - Ian Varley, SalesforceHBaseCon 2012 | HBase Schema Design - Ian Varley, Salesforce
HBaseCon 2012 | HBase Schema Design - Ian Varley, SalesforceCloudera, Inc.
 
H-Base in Data Base Mangement System
H-Base in Data Base Mangement SystemH-Base in Data Base Mangement System
H-Base in Data Base Mangement SystemPreetham Devisetty
 
Python meetup: coroutines, event loops, and non-blocking I/O
Python meetup: coroutines, event loops, and non-blocking I/OPython meetup: coroutines, event loops, and non-blocking I/O
Python meetup: coroutines, event loops, and non-blocking I/OBuzzcapture
 
まだ間に合う HBaseCon2016
まだ間に合う HBaseCon2016まだ間に合う HBaseCon2016
まだ間に合う HBaseCon2016Hirotaka Kakishima
 
Qml 培訓課程 multi media
Qml 培訓課程   multi mediaQml 培訓課程   multi media
Qml 培訓課程 multi mediadiro fan
 
Web intelligence and big data
Web intelligence and big dataWeb intelligence and big data
Web intelligence and big dataRafael Mendes
 
Protocol libraries the right way
Protocol libraries the right wayProtocol libraries the right way
Protocol libraries the right wayLeo Zhou
 
如何提高研发效率
如何提高研发效率如何提高研发效率
如何提高研发效率Leo Zhou
 
Elastic HBase on Mesos - HBaseCon 2015
Elastic HBase on Mesos - HBaseCon 2015Elastic HBase on Mesos - HBaseCon 2015
Elastic HBase on Mesos - HBaseCon 2015Cosmin Lehene
 
Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data Cloude...
Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data  Cloude...Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data  Cloude...
Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data Cloude...Flavio Fonte, PMP, ITIL
 
HBase @ Twitter
HBase @ TwitterHBase @ Twitter
HBase @ Twitterctrezzo
 
A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook
A Survey of Petabyte Scale Databases and Storage Systems Deployed at FacebookA Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook
A Survey of Petabyte Scale Databases and Storage Systems Deployed at FacebookBigDataCloud
 

En vedette (20)

HBase活用事例 #hbase_ca
HBase活用事例 #hbase_caHBase活用事例 #hbase_ca
HBase活用事例 #hbase_ca
 
Apache HBase - Introduction & Use Cases
Apache HBase - Introduction & Use CasesApache HBase - Introduction & Use Cases
Apache HBase - Introduction & Use Cases
 
Apache HBase for Architects
Apache HBase for ArchitectsApache HBase for Architects
Apache HBase for Architects
 
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL databaseHBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
 
Integration of Hive and HBase
Integration of Hive and HBaseIntegration of Hive and HBase
Integration of Hive and HBase
 
Cassandraとh baseの比較して入門するno sql
Cassandraとh baseの比較して入門するno sqlCassandraとh baseの比較して入門するno sql
Cassandraとh baseの比較して入門するno sql
 
HBaseCon 2012 | HBase Schema Design - Ian Varley, Salesforce
HBaseCon 2012 | HBase Schema Design - Ian Varley, SalesforceHBaseCon 2012 | HBase Schema Design - Ian Varley, Salesforce
HBaseCon 2012 | HBase Schema Design - Ian Varley, Salesforce
 
20120423 hbase勉強会
20120423 hbase勉強会20120423 hbase勉強会
20120423 hbase勉強会
 
H-Base in Data Base Mangement System
H-Base in Data Base Mangement SystemH-Base in Data Base Mangement System
H-Base in Data Base Mangement System
 
Python meetup: coroutines, event loops, and non-blocking I/O
Python meetup: coroutines, event loops, and non-blocking I/OPython meetup: coroutines, event loops, and non-blocking I/O
Python meetup: coroutines, event loops, and non-blocking I/O
 
まだ間に合う HBaseCon2016
まだ間に合う HBaseCon2016まだ間に合う HBaseCon2016
まだ間に合う HBaseCon2016
 
Qml 培訓課程 multi media
Qml 培訓課程   multi mediaQml 培訓課程   multi media
Qml 培訓課程 multi media
 
The analytics edge
The analytics edgeThe analytics edge
The analytics edge
 
Web intelligence and big data
Web intelligence and big dataWeb intelligence and big data
Web intelligence and big data
 
Protocol libraries the right way
Protocol libraries the right wayProtocol libraries the right way
Protocol libraries the right way
 
如何提高研发效率
如何提高研发效率如何提高研发效率
如何提高研发效率
 
Elastic HBase on Mesos - HBaseCon 2015
Elastic HBase on Mesos - HBaseCon 2015Elastic HBase on Mesos - HBaseCon 2015
Elastic HBase on Mesos - HBaseCon 2015
 
Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data Cloude...
Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data  Cloude...Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data  Cloude...
Big Data – HBase, integrando hadoop, bi e dw; Montando o seu big data Cloude...
 
HBase @ Twitter
HBase @ TwitterHBase @ Twitter
HBase @ Twitter
 
A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook
A Survey of Petabyte Scale Databases and Storage Systems Deployed at FacebookA Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook
A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook
 

Plus de tatsuya6502

Introduction to Ceph (Japanese) 0908 2011
Introduction to Ceph (Japanese) 0908 2011Introduction to Ceph (Japanese) 0908 2011
Introduction to Ceph (Japanese) 0908 2011tatsuya6502
 
Hibari NOSQL at dist_study Tokyo 20110708
Hibari NOSQL at dist_study Tokyo 20110708Hibari NOSQL at dist_study Tokyo 20110708
Hibari NOSQL at dist_study Tokyo 20110708tatsuya6502
 
HBase Workshop in Tokyo #001
HBase Workshop in Tokyo #001HBase Workshop in Tokyo #001
HBase Workshop in Tokyo #001tatsuya6502
 
Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)tatsuya6502
 
Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)tatsuya6502
 
Apache HBase 入門 (第2回) ドラフト第1版
Apache HBase 入門 (第2回) ドラフト第1版Apache HBase 入門 (第2回) ドラフト第1版
Apache HBase 入門 (第2回) ドラフト第1版tatsuya6502
 
Apache HBase 入門 (第1回)
Apache HBase 入門 (第1回)Apache HBase 入門 (第1回)
Apache HBase 入門 (第1回)tatsuya6502
 

Plus de tatsuya6502 (7)

Introduction to Ceph (Japanese) 0908 2011
Introduction to Ceph (Japanese) 0908 2011Introduction to Ceph (Japanese) 0908 2011
Introduction to Ceph (Japanese) 0908 2011
 
Hibari NOSQL at dist_study Tokyo 20110708
Hibari NOSQL at dist_study Tokyo 20110708Hibari NOSQL at dist_study Tokyo 20110708
Hibari NOSQL at dist_study Tokyo 20110708
 
HBase Workshop in Tokyo #001
HBase Workshop in Tokyo #001HBase Workshop in Tokyo #001
HBase Workshop in Tokyo #001
 
Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)
 
Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)Apache HBase 入門 (第2回)
Apache HBase 入門 (第2回)
 
Apache HBase 入門 (第2回) ドラフト第1版
Apache HBase 入門 (第2回) ドラフト第1版Apache HBase 入門 (第2回) ドラフト第1版
Apache HBase 入門 (第2回) ドラフト第1版
 
Apache HBase 入門 (第1回)
Apache HBase 入門 (第1回)Apache HBase 入門 (第1回)
Apache HBase 入門 (第1回)
 

Tokyo HBase Meetup - Realtime Big Data at Facebook with Hadoop and HBase (ja)