This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, June 2 • 12:00pm - 12:50pm
How We Built a Chargeback System for Twitter’s Compute Platform (Mesos/Aurora) That Incentives Higher Resource Utilization - Micheal Benedict & Jeyappragash Jeyakeerthi, Twitter

Sign up or log in to save this to your schedule and see who's attending!

Twitter’s compute platform manages hundreds and thousands of containers across tens and thousands of hosts. At that scale, problems we have observed are:
1. Containers are not often sized appropriately in a way to utilize underlying hardware resources efficiently
2. Lack of visibility into who owns what containers (and services)
3. Identifying and tracking the utilization of resources by individual containers to the org structure

We built a Chargeback system for Mesos that provides visibility into who owns what and how much resources they use. It also generates a "bill" based on usage data. The goal here is to incentivize users of Mesos through visibility into what they use & effectively right size their containers to use the underlying resources in a cost-effective way. In this talk, we describe how we built the chargeback service that
1. Ingests utilization and quota data from Mesos master & container stats
2. process around figuring out resources to charge on (ex, cpu cores used per day)
3. ownership mapping i.e how we built a identity service that ties ldap roles with organizational teams (takes a more project/team centric view)

Towards the end of the talk, we will share a case study of how chargeback at Twitter helped improve resource utilization (cores in this case) by over 30% and save millions in $ prior to implementing something like Chargeback.

avatar for Micheal Benedict

Micheal Benedict

Product Manager, Twitter
Micheal Benedict leads Product Management for Twitter's Cloud Platform. He and his team are building the next generation compute infrastructure that spans private and public clouds. Previously, he was a Software Engineer at Twitter building Observability. Before joining Twitter, Micheal was a Research Assistant at University at Buffalo’s Blue Labs and built PhoneLab: World’s Largest Smartphone Experimentation Test Bed. Micheal has a M.S in... Read More →
avatar for Jeyappragash Jeyakeerthi

Jeyappragash Jeyakeerthi

Engineering Manager, Twitter
Jeyappragash leads Twitter’s Cloud Infrastructure Management Platform. This hybrid cloud platform helps developers manage and launch their services providing detailed visibility about resource usage and for infrastructure owners, to offer their infrastructure or platform as a true multi-tenant offering. Previously he worked as a Distinguished Engineer at Motorola, leading efforts to build their Notification Infrastructure, their Software... Read More →

Thursday June 2, 2016 12:00pm - 12:50pm
Grand Mesa F