Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, August 21 • 2:00pm - 2:20pm
Improving Operational Insights with Reactive Stream Processing using Apache Mesos - Justin Becker & Sharma Podila, Netflix

Sign up or log in to save this to your schedule and see who's attending!

Netflix customers stream more than one billion hours of content each month, accounting for over a third of downstream Internet traffic. At this scale, a lot can go wrong. Justin Becker and Sharma Podila will present how Netflix is building the next generation insight capabilities to help continuously improve the experience for streaming customers. Specifically, the talk will focus on a reactive stream processing system, built using Apache Mesos. The talk will provide the justification for building a new framework. Provide some insight into the scheduling algorithm; a brief overview of optimizations for “stream locality” and auto-scaling. The presentation will also include an overview of the executor; approaches to horizontal and vertical scaling. Then, finish with future directions and collaboration opportunities within the Mesos community.

The audience is anyone interested in building a custom Framework using Mesos. Specifically, those interested in building and deploying Mesos within the Amazon Web Service (AWS) Cloud Environment. The talk will also include detailed information about approaches to scheduling in a distributed, auto-scaling, environment.

The presentation will provide new framework developers with a real world Mesos case study, operating at web scale. Justin and Sharma also plan to discuss future collaboration opportunities within the Mesos community. Topics include: auto-scaling, fault tolerance, core scheduling behavior.  

Survey this Session


Speakers
JB

Justin Becker

Justin Becker and Sharma Podila are Senior Software Engineers working for the Edge Engineering team at Netflix. Justin Becker has experience building distributed systems for machine learning applications. Sharma Podila has a strong background in scheduling algorithms for distributed systems.
avatar for Sharma Podila

Sharma Podila

Senior Software Engineer, Netflix
Sharma Podila is a Senior Software Engineer at Netflix, Inc. He is the author of open source Fenzo scheduling library for Mesos frameworks. His current work includes developing cloud native Mesos frameworks for Netflix project Titus, a Docker based application deployment platform, and project Mantis, a reactive stream processing platform. Sharma is looking forward to chatting about and collaborating on Mesos frameworks and schedulers.


Thursday August 21, 2014 2:00pm - 2:20pm
Sheraton Ballroom IV

Attendees (23)