Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Upcoming SlideShare
#rtgeo (Where 2.0 2011)
Next

Share

Twitter by the Numbers (Columbia University)

The version of "Twitter by the Numbers" that I delivered at Columbia University for @TwitterU. 22 Feb 2011.

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Twitter by the Numbers (Columbia University)

  1. 1. by the #s with @raffi
  2. 2. Giv ing a @twitter t alk at Columbia Uni versity talking a bout Twitter’s Numbers! 22 Feb via Twitter for iPhone ty from Mudd Building at Columbia Universi 500 West 120th Street New York, New York View Tweets at this place
  3. 3. http://twitter.com/#!/toptweets/status/12483108178
  4. 4. http://twitter.com/#!/Emergency_In_SF/status/29440739442
  5. 5. http://twitter.com/#!/i80chains/status/9726084734
  6. 6. http://twitter.com/#!/remedyoakland/status/29002198672
  7. 7. http://twitter.com/#!/AlbionsOven/status/10015063036
  8. 8. What’s a Tweet? It’s a short message that's sent through 140 characters
  9. 9. How many are there?
  10. 10. How many are there? 110M!
  11. 11. 110M tweets 1200 tweets per day ≈ per second
  12. 12. How big are they? 1 tweet text = 140 characters ≈ 200 bytes
  13. 13. 1200 tweets per ≈ 230 KB/sec second ≈ 14 MB/min ≈ 19 GB/day Just tweet text!
  14. 14. MySQL Can’t generate IDs fast enough Centralized and a single point of failure snowflake Highly available and uncoordinated (10kqps) Compatible with the ecosystem http://github.com/twitter/snowflake
  15. 15. ampura mons from ch used under Creative Com Photo 1 TB generated 10 TB generated per day per day
  16. 16. 10 TB per day in total ≈ 120 MB per sec 80 MB = per sec Photo used u n der Creative C ommons from Mac Users G uide
  17. 17. Where do they go? Followed by Following Asymmetric Digraph
  18. 18. 1 Digraph 2 Need to represent this 4 1 2 3 4 3 1 Matrix 2 Naïve implementation is not scalable 3 4
  19. 19. 200M registered users 2006 2008 2010 2011
  20. 20. Photo used under Creative Commons from jurvetson Distributed graph database flockdb High rate of CRUD operations Complex set arithmetic queries http://github.com/twitter/flockdb
  21. 21. @ladygaga mother mons†er 8.3 million followers @justinbieber Justin Bieber 7.5 million followers @BarakObama 44th President of the United States 6.7 million followers @raffi me! 0.007 million followers
  22. 22. How do they get out? 10B API calls 100,000 calls per day ≈ per second
  23. 23. REST API XML/JSON API over HTTP Poll-based system / pseudo real-time hosebird Streaming API Long poll HTTP Near real-time delivery of Tweets
  24. 24. Latency 200ms 100ms 0ms
  25. 25. 752% in 2008
  26. 26. 1358% in 2009
  27. 27. Where do we want to be? Today - 200M people generate ~1200 TPS Tomorrow - we want to support half the world and all its devices (5B phones and 6B people)
  28. 28. Real challenges in front of us Real time Indexing, search, and analytics Relevance systems Graph databases Storage Scalability and efficiency
  29. 29. Follow me at Questions? twitter.com/raffi
  • adamburan

    Jul. 1, 2013
  • sknight

    Mar. 12, 2012
  • elmblog

    Oct. 9, 2011
  • withoutayard

    May. 11, 2011
  • dhalvorson1

    Apr. 29, 2011
  • thetechnicalweb

    Apr. 17, 2011
  • turtemuulen

    Apr. 17, 2011
  • mbjorn

    Apr. 17, 2011
  • sionowen

    Apr. 9, 2011
  • Venkat101

    Apr. 6, 2011
  • legstump

    Mar. 27, 2011
  • morenobryan

    Mar. 24, 2011
  • dimflo

    Mar. 18, 2011
  • clarkbrian

    Mar. 17, 2011
  • tjerkeilander

    Mar. 17, 2011
  • t2omedia

    Mar. 17, 2011
  • areway

    Mar. 17, 2011
  • marketingfacts

    Mar. 17, 2011
  • ikender

    Mar. 16, 2011
  • waqueau

    Mar. 16, 2011

The version of "Twitter by the Numbers" that I delivered at Columbia University for @TwitterU. 22 Feb 2011.

Views

Total views

18,914

On Slideshare

0

From embeds

0

Number of embeds

8,933

Actions

Downloads

0

Shares

0

Comments

0

Likes

23

×