「RDB技術者のためのNoSQLガイド」出版記念セミナー http://nosqlguid.connpass.com/event/27331/ LT発表資料

1. Voldemort
@
HBase

2. •
IT
•
• LinkedIn Kafka Pinot
•
• Netflix github Web

3. Voldemort
• P2P Key-Value Store
• Inspired by Amazon Dynamo
• (A) (P) / Cassandra
• LinkedIn (OSS; Apache 2.0 license)
• : Jive, Mendeley, eBay, Ameba,

4. Voldemort

5. Voldemort

6. Voldemort API
• value = store.get(key)
• store.put(key, value)
• store.delete(key)
Y^Y^Y^Y^Y
Simple TCP Socket
HTTP REST

7. Voldemort
http://www.project-voldemort.com/voldemort/design.html
•
•
•
•

8. <key-serializer>
<type>avro-generic-versioned</type>
<schema-info version="0">{ "name": "key", "type": “record",
“fields": [{ "name": "user_id", "type": "int" }] }</schema-info>
</key-serializer>
<value-serializer>
<type>avro-generic-versioned</type>
<schema-info version="0">
{
"name": "value",
"type": "record",
"fields": [{
"name": "user_id",
"type": "int"
}, {
"name": "gender",
"type": "string"
}, {
"name": "age",
"type": "int",
"optional": true
}]
put '{"user_id": "123"}' "{}"
Unexpected error:
org.apache.avro.AvroTypeException: Expected int. Got VALUE_STRING
put '{"user_id": 123}' '{"gender":"man", "age": 20}'
Unexpected error:
org.apache.avro.AvroTypeException: Expected field name user_id got gender

9. :
•
• JSON ( ), , , Java
, ProtocolBuffers, Thrift, AVRO,
•
• MySQL, Krati, BerkeleyDB, HDFS (Read-only),
( ; ),

10. :
• Solving Big Data Challenges for Enterprise
Application Performance Management,
VLDB2012
R=READ95%, RW=50%, W=WRITE99%
http://vldb.org/pvldb/vol5/p1724_tilmannrabl_vldb2012.pdf

11. • 6 NoSQL+RDB Read/Write

12. Voldemort
• (Build-and-Push)
•
• Serving Large-scale Batch Computed Data
with Project Voldemort, FAST2012
http://static.usenix.org/events/fast12/tech/
full_papers/Sumbaly.pdf

13. Voldemort
• (Build-and-Push)
•
• Serving Large-scale Batch Computed Data
with Project Voldemort, FAST2012
http://static.usenix.org/events/fast12/tech/
full_papers/Sumbaly.pdf

14. • Voldemort (≒ 1ms; HBase Cassandra )
• Cassandra
•
•
• Sqoop (export)
• HBase