Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Wednesday, June 1 • 12:00pm - 12:50pm
Optimistic Offer - What Does it Mean to Apache Mesos Framework - Yong Feng, IBM Canada Ltd.

Sign up or log in to save this to your schedule and see who's attending!

Mesos enables two layer scheduling by employing an offer-based resource negotiation protocol between the Mesos master and the Framework scheduler. Currently, Mesos only supports the Pessimistic Offer model. With the Pessimistic Offer model, if a resource has been offered to a framework, this same resource will not be offered to another framework until the previous offer times out. When Framework schedulers receive an offer, they will either cache unused offers, or block the offer and then trigger Mesos to resend the offer through the revive API when the Framework has a new workload request. This current method of handling offers, generally leads to tradeoffs among framework performance, resource utilization and allocation fairness.

This talk will introduce an alternative - the Optimistic Offer model - that can reduce the need for such tradeoffs leading to improved scheduling of resources. With the Optimistic Offer model, the same offer will be made available to all frameworks, which provides each framework with an equal opportunity to view for available resources in the cluster. This presentation will cover the proposed Mesos Optimistic Offer development plan, the current development status of the Mesos Optimistic Offer, the process for developing frameworks to utilize the Optimistic Offer model, as well as an evaluation of running existing Mesos frameworks with Optimistic Offer.

Speakers
YF

Yong Feng

Senior Software Architect, IBM Canada Ltd.
Yong Feng is a Senior Software Architect at IBM Platform. He has more than 10 years of experience in design, and implements cluster, grid and cloud computing systems with a focus on scheduling, resource and workload management. He has a deep knowledge on related open-source projects such as OpenStack, Mesos, Swarm, Kubernetes, Spark, etc. and leads the IBM teams who work on them. Yong holds a Ph.D from Northwestern Polytechnical University of... Read More →



Wednesday June 1, 2016 12:00pm - 12:50pm
Chasm Creek

Attendees (30)