Netflix customers stream more than one billion hours of content each month, accounting for over a third of downstream Internet traffic. At this scale, a lot can go wrong. Justin Becker and Sharma Podila will present how Netflix is building the next generation insight capabilities to help continuously improve the experience for streaming customers. Specifically, the talk will focus on a reactive stream processing system, built using Apache Mesos. The talk will provide the justification for building a new framework. Provide some insight into the scheduling algorithm; a brief overview of optimizations for “stream locality” and auto-scaling. The presentation will also include an overview of the executor; approaches to horizontal and vertical scaling. Then, finish with future directions and collaboration opportunities within the Mesos community.
The audience is anyone interested in building a custom Framework using Mesos. Specifically, those interested in building and deploying Mesos within the Amazon Web Service (AWS) Cloud Environment. The talk will also include detailed information about approaches to scheduling in a distributed, auto-scaling, environment.
The presentation will provide new framework developers with a real world Mesos case study, operating at web scale. Justin and Sharma also plan to discuss future collaboration opportunities within the Mesos community. Topics include: auto-scaling, fault tolerance, core scheduling behavior.
Survey this Session
