timelines twitter
play

Timelines @ Twitter QCon London 2012 Arya Asemanfar Thursday, - PowerPoint PPT Presentation

Timelines @ Twitter QCon London 2012 Arya Asemanfar Thursday, March 8, 2012 Poll-based Timeline Thursday, March 8, 2012 Poll-based Timeline Thursday, March 8, 2012 Search Thursday, March 8, 2012 Streaming (aka Push) Thursday, March 8,


  1. New Tweet search search search search search search search search search search search search search search search search search search search search index index index index index index index index index index index index index index index index index index index index Thursday, March 8, 2012

  2. search blender search search search search search search search search search search search search search search search search search search search search index index index index index index index index index index index index index index index index index index index index Thursday, March 8, 2012

  3. search search search search blender blender blender blender search search search search search search search search search search search search search search search search search search search search index index index index index index index index index index index index index index index index index index index index Thursday, March 8, 2012

  4. search search search search blender blender blender blender search search search search index index index index Thursday, March 8, 2012

  5. search search search search blender blender blender blender search search search search index index index index Thursday, March 8, 2012

  6. search search search search search index index search search index index index API blender ingester HTTP tweet queue Proxy API tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache redis redis redis redis Thursday, March 8, 2012

  7. search search search search search index index search search index index index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache redis redis redis redis Thursday, March 8, 2012

  8. search search search search search index index search search index index Geo index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache redis redis redis redis Thursday, March 8, 2012

  9. search search search search search index index search search index index Geo index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache URL expansion redis redis redis redis Thursday, March 8, 2012

  10. search search search search search index index search search index index Geo index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache URL expansion redis redis redis redis Thursday, March 8, 2012

  11. search search search search search index index search search index index Geo index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache URL expansion redis redis redis redis Thursday, March 8, 2012

  12. search search search search search index index search search index index Geo index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache URL expansion redis redis redis redis Thursday, March 8, 2012

  13. search search search search search index index search search index index Geo index API blender ingester HTTP tweet Durable queue Proxy API Stores tweet daemon timeline timeline API service fanout user tweet timeline service service delivery cache URL expansion redis redis redis redis Thursday, March 8, 2012

  14. HTTP timeline Proxy API Thursday, March 8, 2012

  15. Finagle - JVM RPC Library open source: http://github.com/twitter/finagle Thursday, March 8, 2012

  16. Finagle – RPC Common Library Components ⇢ connection management ⇢ protocol codecs HTTP timeline Proxy API ⇢ transient error handling ⇢ distributed tracing ⇢ service discovery ⇢ observability Thursday, March 8, 2012

  17. Finagle – RPC Common Library Components ⇢ connection management ⇢ protocol codecs HTTP timeline Proxy API ⇢ transient error handling ⇢ distributed tracing ⇢ service discovery ⇢ observability Thursday, March 8, 2012

  18. Building a client ClientBuilder() .cluster(TimelineServiceCluster) .hostConnectionCoresize(5) .hostConnectionLimit(10) .hostConnectionIdleTime(5.seconds) .failureAccrualParams(5, 10.seconds) .retries(3) .timeout(500.milliseconds) Thursday, March 8, 2012

  19. Building a client ClientBuilder() .cluster(TimelineServiceCluster) .hostConnectionCoresize(5) .hostConnectionLimit(10) .hostConnectionIdleTime(5.seconds) .failureAccrualParams(5, 10.seconds) .retries(3) .timeout(500.milliseconds) Thursday, March 8, 2012

  20. Building a client ClientBuilder() .cluster(TimelineServiceCluster) .hostConnectionCoresize(5) .hostConnectionLimit(10) .hostConnectionIdleTime(5.seconds) .failureAccrualParams(5, 10.seconds) .retries(3) .timeout(500.milliseconds) Thursday, March 8, 2012

  21. Building a client ClientBuilder() .cluster(TimelineServiceCluster) .hostConnectionCoresize(5) .hostConnectionLimit(10) .hostConnectionIdleTime(5.seconds) .failureAccrualParams(5, 10.seconds) .retries(3) .timeout(500.milliseconds) Thursday, March 8, 2012

  22. Building a client ClientBuilder() .cluster(TimelineServiceCluster) .hostConnectionCoresize(5) .hostConnectionLimit(10) .hostConnectionIdleTime(5.seconds) .failureAccrualParams(5, 10.seconds) .retries(3) .timeout(500.milliseconds) Thursday, March 8, 2012

  23. Building a client ClientBuilder() .cluster(TimelineServiceCluster) .hostConnectionCoresize(5) .hostConnectionLimit(10) .hostConnectionIdleTime(5.seconds) .failureAccrualParams(5, 10.seconds) .retries(3) .timeout(500.milliseconds) Thursday, March 8, 2012

Recommend


More recommend