#mesoscon14 has ended
Back To Schedule
Thursday, August 21 • 2:00pm - 2:20pm
Improving Operational Insights with Reactive Stream Processing using Apache Mesos - Justin Becker & Sharma Podila, Netflix

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Netflix customers stream more than one billion hours of content each month, accounting for over a third of downstream Internet traffic. At this scale, a lot can go wrong. Justin Becker and Sharma Podila will present how Netflix is building the next generation insight capabilities to help continuously improve the experience for streaming customers. Specifically, the talk will focus on a reactive stream processing system, built using Apache Mesos. The talk will provide the justification for building a new framework. Provide some insight into the scheduling algorithm; a brief overview of optimizations for “stream locality” and auto-scaling. The presentation will also include an overview of the executor; approaches to horizontal and vertical scaling. Then, finish with future directions and collaboration opportunities within the Mesos community.

The audience is anyone interested in building a custom Framework using Mesos. Specifically, those interested in building and deploying Mesos within the Amazon Web Service (AWS) Cloud Environment. The talk will also include detailed information about approaches to scheduling in a distributed, auto-scaling, environment.

The presentation will provide new framework developers with a real world Mesos case study, operating at web scale. Justin and Sharma also plan to discuss future collaboration opportunities within the Mesos community. Topics include: auto-scaling, fault tolerance, core scheduling behavior.  

Survey this Session


Justin Becker

Justin Becker and Sharma Podila are Senior Software Engineers working for the Edge Engineering team at Netflix. Justin Becker has experience building distributed systems for machine learning applications. Sharma Podila has a strong background in scheduling algorithms for distributed... Read More →
avatar for Sharma Podila

Sharma Podila

Senior Software Engineer, Netflix
Sharma Podila is a Senior Software Enginner in the Edge Engineering team at Netflix, Inc. His current work includes Fenzo, an open source generic scheduler with plugin based optimizations, developing cloud native Mesos frameworks, and evolving the microservices platform at Netfli... Read More →

Thursday August 21, 2014 2:00pm - 2:20pm CDT
Sheraton Ballroom IV

Attendees (0)