MesosCon NA 2016: Full Schedule

June 1 & 2 - Denver, CO
Register Now for MesosCon North America 2016

4:00pm PDT

Early Registration

Avoid the Wednesday morning rush and pick-up your badge early!

Tuesday May 31, 2016 4:00pm - 7:00pm PDT
Grand Mesa Foyer

Breaks

7:30am PDT

Registration, Continental Breakfast, and Sponsor Showcase

Wednesday June 1, 2016 7:30am - 9:00am PDT
Grand Mesa Foyer

Breaks

9:00am PDT

Keynote: Welcome Address - Benjamin Hindman, Founder and Chief Architect, Mesosphere

Speakers

Ben Hindman

Mesosphere Founder - Apache Mesos Co-Creator, Mesosphere

Ben is one of the creators of Apache Mesos, a platform for building and running resource-efficient distributed systems at scale. Ben started working on Mesos as a PhD student at Berkeley before he brought it to Twitter where it runs on thousands of machines. An academic at heart... Read More →

Wednesday June 1, 2016 9:00am - 9:30am PDT
Grand Mesa A-F

Keynote

9:30am PDT

Keynote: The New Open Source Data Center - Joshua Bernstein, Vice President of Technology, EMC {code}

In today’s ever shifting world the most accomplished CIO’s know that adaptability is crucial for their organizations success. For the past 20 years some of the most successful organizations in the world have been using open source platforms and tools to break the status quo and disrupt industries. EMC {codes}’s Josh Bernstein will share his personal experiences doing just that from his days running the Siri Deployment and Infrastructure Architecture team at Apple. By embracing open source and DevOps tools and methodologies, Josh’s team was able to take Siri from launch to tens of thousands of servers, deployed in more than a dozen locations, in under 5 years. Join us to find out why building open source data centers is the key to the modern data center and how the world’s largest organizations are taking advantage of this knowledge.

Speakers

Josh Bernstein

Vice President of Technology, EMC {code}

Joshua Bernstein recently joined EMC as the new VP of Technology for the Emerging Technologies Division. Prior to EMC, Joshua ran the Siri Deployment and Infrastructure Architecture team at Apple for 4 1/2 years. As a member of the small team, Joshua and his colleagues successfully... Read More →

The New Open Data Center pdf

Wednesday June 1, 2016 9:30am - 9:40am PDT
Grand Mesa A-F

Keynote

9:45am PDT

Keynote: A Real-Time Cloud for the Internet of Things - Professor Ken Birman, Cornell University

We’ve all read the hype about the Internet of Things: a technology trend that seems endlessly about to happen, yet has been stubbornly hard to integrate with cloud computing. In this talk I want to ask why this has been so, and how we can fix it.

I’ll start by describing work Cornell has done over the past few years on creating a cloud platform to host “smart power grid” applications. This involves (1) new rack-scale management solutions aimed at applications that need to run 24x7, (2) replication with ultra-fast updates for scalable real-time responsiveness, and (3) new real-time storage solutions, to enable a new kind of big-data temporal computing. But new models also create huge performance puzzles. For our work, these center on how to overcome Brewer’s CAP principle. CAP was about performance tradeoffs, and the key to conquering CAP is to leverage RDMA and NVRAM hardware, which offer amazing speedups for critical data paths. By working from the ground up, and using RDMA and NVRAM as accelerators for data replication, storage and management solutions, we can get huge speedups compared to older styles of cloud computing, even when consistency and fault-tolerance are required.

This work is all open-source, and should be of special interest to the Apache Mesos community because container models turn out to be one of the key enablers for pulling off these tricks. With older styles of cloud virtualization, it can be incredibly hard to offer scheduling guarantees, and technologies like RDMA and NVRAM are very hard to virtualize. Containers eliminate both of those obstacles.

Speakers

Prof. Ken Birman

N. Rama Rao Professor of Computer Science, Cornell University

Ken is a serial entrepreneur and a professor of computer science at Cornell University, where he has worked since getting his PhD at UC Berkeley in 1981. His research has always focused on reliable distributed computing. Back in the 1990’s he developed core parts of the French... Read More →

Ken Birman pdf

Wednesday June 1, 2016 9:45am - 10:15am PDT
Grand Mesa A-F

Keynote

10:15am PDT

Keynote: Verizon Calls Mesos - Larry Rau, Director of Architecture and Infrastructure, Verizon Labs

As data services change the way the world does business, Verizon Labs has built a platform designed around the Mesos open source system that enables the robust development of micro services for a variety of products and services. This presentation will use a real world example of how Verizon Lab's Mesos-based platform integrates with America's most reliable wireless network to transform how Verizon builds and delivers new services.

Speakers

Larry Rau

Director, Architecture and Infrastructure, Verizon Labs

Larry leads development teams working on the advancement and use of cluster computing at Verizon Labs. Much of that time spent on developing solutions targeting the Internet of Things. Prior to joining Verizon Labs Larry was the CTO of Consumer Solutions in Embedded Java unit... Read More →

Wednesday June 1, 2016 10:15am - 10:25am PDT
Grand Mesa A-F

Keynote

10:30am PDT

Coffee Break and Sponsor Showcase

Wednesday June 1, 2016 10:30am - 11:00am PDT
Grand Mesa Foyer

Breaks

11:00am PDT

Containers in Apache Mesos: Present and Future - Jie Yu & Tim Chen, Mesosphere

Mesos currently supports two types of container runtimes: one is Mesos’ own pluggable runtime which uses OS primitives directly (a.k.a. the Mesos containerizer); the other is to delegate the entire container management to Docker engine (a.k.a. the Docker containerizer). Recently, we added container image support to Mesos containerizer, which allows it to launch off-the-shelf Docker or Appc containers without depending on Docker daemon or rkt. In this talk, we are going to discuss the motivation of why we want to unify the containerizers in Mesos and how this benefits the Mesos maintainers and our users. We will then talk about the current status of this work, and show what can be built on top of this pluggable architecture. Finally, we will share our vision on the near future for the Mesos containerizer and how it’s going to enable more innovation in the Mesos ecosystem.

Speakers

Tim Chen

Distributed Systems Engineer, Mesosphere

Tim Chen is on the Mesosphere core team and focuses on containerization and big data frameworks. He is also a PMC/committer on Apache Drill and Apache Mesos, and contributed to other open source projects such as Spark, Kafka, Hive. Before joining Mesosphere, Tim past experiences includes... Read More →

Jie Yu

Senior Software Engineer, Mesosphere

Jie Yu is a Software Engineer at Mesosphere, Inc, focused on Mesos development. He has worked on several key components in Mesos including containerization, persistence primitives and replicated logs. Before joining Mesosphere, he was a software engineer at Twitter. Jie obtained his... Read More →

MesosCon'16 Container in Mesos Present and Future. pdf

Wednesday June 1, 2016 11:00am - 11:50am PDT
Grand Mesa DE

Developer, Intermediate

11:00am PDT

Contributing to Apache Mesos: Where to Begin - Joris Van Remoortere & Michael Park, Mesosphere

Have you found a bug in Mesos that you would like to fix yourself? Have you got a feature that you would like to introduce to Mesos? Are you already a contributor, but finding it difficult to maneuver the codebase and getting your patches committed?

This talk is intended for those who would like to contribute to Mesos. Contributing to any open source project can be intimidating and trying to seek information remotely can be frustrating and demotivating. We aim to provide information that will help contributors, and will cover topics such as the project management process (JIRA, shepherds), coding standards, developer documentation, developer tools, debugging tools and techniques, running tests, and submitting patches.

Speakers

Michael Park

Software Engineer, Mesosphere

Michael Park is an Apache Mesos committer working at Mesosphere. He loves language design, compiler construction and distributed systems. He takes a special interest in C++, and is a member of the ISO C++ Standards Committee. He started to work on Apache Mesos in late 2014 and contributed... Read More →

Joris Van Remoortere

Distributed System Engineer, Mesosphere

Joris Van Remoortere is an Apache Mesos committer at Mesosphere. Joris has been contributing to Mesos since 2014 and previously worked on low latency distributed graph databases. He studied Computing & Financial Management at the University of Waterloo.

Wednesday June 1, 2016 11:00am - 11:50am PDT
Grand Mesa ABC

Developer, Beginner

11:00am PDT

Building Highly Available Mesos Frameworks - Neil Conway, Mesosphere

Production-quality Mesos frameworks must be able to continue managing tasks despite unreliable networks and faulty computers. Mesos provides tools to help developers do fault-tolerant task management, but putting these tools together effectively remains something of a black art. This talk will offer practical guidance to current and prospective framework developers to help them understand how Mesos deals with failures and the tools it provides to enable fault tolerant frameworks. Mesos operators will also benefit from a discussion of exactly how Mesos behaves during network partitions and other failure scenarios.

This talk will cover the following specific topics:
* fault tolerance in Mesos itself: how Mesos masters and agents behave in the face of process crashes and network partitions
* the tools that Mesos provides to help framework authors write reliable systems (e.g., task state reconciliation, the state abstraction, and the MasterDetector interface)
* the lifecycle of a Mesos task
* a collection of recommendations for how framework developers should build highly available framework schedulers and executors

Speakers

Neil Conway

Distributed Systems Engineer, Mesosphere

Neil Conway is a Distributed Systems Engineer at Mesosphere, where he works on the Apache Mesos project. Before Mesosphere, Neil built automated trading systems at a quantitative hedge fund, completed a PhD in distributed systems at UC Berkeley, was a principal engineer at a stream... Read More →

Wednesday June 1, 2016 11:00am - 11:50am PDT
Chasm Creek

Frameworks, Intermediate

11:00am PDT

Federated Mesos Clusters for Global Data Center Designs - Krishna Kumar, Huawei

Multi region global Data centers can be setup by using Mesos as the Kernel for all resource management. This presentation will cover one of the designs for federated mesos clusters to enable uniform data center resource orchestration across the globe. We will also compare and contrast various design approaches that has been considered for this project including some industry’s competitive models. The Model we propose is not only distributed by nature, it can also tolerate dynamic addition/deletions/modifications of masters in the federation. We will also explain how a framework can participate in such a design without having to change its core functionality.

A policy engine is integrated with this cluster federation model to control the nature of the scheduler. This federation work will not only handle the IaaS layer resource requirements but also extended to deal with PaaS layer application resources. So in the container world, Mesos can play a big role directly handling the applications which could avoid other PaaS resource schedulers by using custom frameworks. Various optimum schedulers can be pluggable to this model and health of the overall system is taken care by inter cluster communication in HA mode. Finally we will show a POC demo developed within our lab and probably the ongoing implementation details in our cloud.

Speakers

Krishna Kumar

CNCF Ambassador & Architect Cloud, Huawei Technologies

Krishna Kumar is a CNCF Ambassador & Architect for Huawei Cloud. A Technology Leader in Cloud / Data Centers with 20 years experience @US, Asia-Pacific & India. He is leading a team developing cloud platforms and solutions specializing in IaaS, PaaS, OpenStack, Docker, Kubernetes... Read More →

Federated Mesos Clusters for Global Data Center Designs MesosCon2016 Krishna Kumar pdf

Wednesday June 1, 2016 11:00am - 11:50am PDT
Grand Mesa F

Operations, Beginner

12:00pm PDT

Apache Mesos 1.0 - Vinod Kone & Anand Mazumdar, Mesosphere

Mesos will soon reach the 1.0 milestone. In addition to new features, this would mean a more stable user-facing API and stricter support/release guarantees for operators/framework developers. The aim of this talk is to apprise the operators/framework developers/users about the new API and also discuss the support/compatibility guarantees offered by Mesos going forward.

This talk is a sequel to the last year’s MesosCon Seattle talk on “Mesos HTTP API” and continues from where it left off.

This talk will cover the following specific topics:
- Discuss the newly introduced Operator APl.
- Update on the recent improvements to the Framework API.
- Update on client libraries for the new Framework API.
- Release cadence for Mesos going forward.
- Support/Compatibility guarantees for operators/framework developers e.g., backporting of patches etc.
- Master->Agent renaming in the 1.0 API.

Speakers

Vinod Kone

Apache Mesos PMC, Mesosphere

Vinod Kone is a committer and PMC member of the Apache Mesos project. He is currently a Tech Lead and Engineering Manager @ Mesosphere. Previously, he was a Tech Lead and Manager of the Mesos team @Twitter. Vinod completed his PhD in Computer Science from UC Santa Barbara.

Anand Mazumdar

Distributed System Engineer, Mesosphere

Anand Mazumdar is a software engineer at Mesosphere where he works on the Apache Mesos project. Prior to that, he used to work at a Quantitative Hedge Fund and Amazon Web Services on scalable data stream processing. He holds a Masters in Computer Science from The University of Texas... Read More →

Mesos 1.0 pdf

Wednesday June 1, 2016 12:00pm - 12:50pm PDT
Grand Mesa DE

Developer, Intermediate

12:00pm PDT

Apache Mesos on Windows: Status and the Roadmap - Alex Clemmer & Daniel Pravat, Microsoft

Windows Server 2016 is expected to be made generally available sometime in Q3 2016, and with it, the Windows Containers API.

Supporting Windows Containers natively is a major growth opportunity for the Mesos community -- by enabling users to operate clusters containing a mix of Unix and Windows hosts, it is possible to significantly reduce administrative overhead and increase resource utilization in data centers.

In this talk we will provide a ground-up view of the work we have done over the last year to make the Windows agent a reality.

We’ll cover the changes made to Mesos core so far, discussing in detail how the Mesos agent works on Windows. We will then discuss the implications of these changes at the service level, covering how to operate clusters with a mix of Windows and Unix nodes in practice.

Finally, we will present a demo running on such a cluster, and a roadmap for future plans.

Speakers

Alex Clemmer

Software Engineer, Microsoft

Alex Clemmer is a software engineer at Microsoft. He started the initiative to add Windows support to Mesos. Prior to this, he was a student. Alex is mostly known for turning Snapchat into a remote filesystem: http://www.nullspace.io/#snapchat-fs and porting lisp to the Apple //e... Read More →

Daniel Pravat

Engineering Manager, Microsoft

Daniel Pravat is an Engineering Manager with Microsoft Corporation where he delivered several infrastructure components in Windows and added many cutting edge cellular features to Windows Phone. In the current role in Windows Server he is focused to to bring Mesos framework features... Read More →

Wednesday June 1, 2016 12:00pm - 12:50pm PDT
Grand Mesa ABC

Developer, Beginner

12:00pm PDT

Optimistic Offer - What Does it Mean to Apache Mesos Framework - Yong Feng, IBM Canada Ltd.

Mesos enables two layer scheduling by employing an offer-based resource negotiation protocol between the Mesos master and the Framework scheduler. Currently, Mesos only supports the Pessimistic Offer model. With the Pessimistic Offer model, if a resource has been offered to a framework, this same resource will not be offered to another framework until the previous offer times out. When Framework schedulers receive an offer, they will either cache unused offers, or block the offer and then trigger Mesos to resend the offer through the revive API when the Framework has a new workload request. This current method of handling offers, generally leads to tradeoffs among framework performance, resource utilization and allocation fairness.

This talk will introduce an alternative - the Optimistic Offer model - that can reduce the need for such tradeoffs leading to improved scheduling of resources. With the Optimistic Offer model, the same offer will be made available to all frameworks, which provides each framework with an equal opportunity to view for available resources in the cluster. This presentation will cover the proposed Mesos Optimistic Offer development plan, the current development status of the Mesos Optimistic Offer, the process for developing frameworks to utilize the Optimistic Offer model, as well as an evaluation of running existing Mesos frameworks with Optimistic Offer.

Speakers

Yong Feng

Senior Software Architect, IBM Canada Ltd.

Yong Feng is a Senior Software Architect at IBM Platform. He has more than 10 years of experience in design, and implements cluster, grid and cloud computing systems with a focus on scheduling, resource and workload management. He has a deep knowledge on related open-source projects... Read More →

MesosCon 2016 OptimisticOffer pdf

Wednesday June 1, 2016 12:00pm - 12:50pm PDT
Chasm Creek

Frameworks, Intermediate

12:00pm PDT

Lessons from Netflix Mesos Clusters - Sharma Podila, Netflix

Netflix customers worldwide streamed over Forty Two Billion hours of content last year. Service style applications, batch jobs, and stream processing alike, from a variety of use cases across Netflix rely on executing container based applications in multi-tenant clusters powered by Mesos and Fenzo. This talk will show you how disparate use cases call for a separation of job management concerns from resource scheduling, as well as a polymorphic job API. Based on the experiences from Netflix projects Mantis and Titus, the talk will highlight results and lessons learned in running Docker and Cgroups based containers in a cloud native environment.

Speakers

Sharma Podila

Senior Software Engineer, Netflix

Sharma Podila is a Senior Software Enginner in the Edge Engineering team at Netflix, Inc. His current work includes Fenzo, an open source generic scheduler with plugin based optimizations, developing cloud native Mesos frameworks, and evolving the microservices platform at Netfli... Read More →

MesosCon Jun 2016 Final pdf

Wednesday June 1, 2016 12:00pm - 12:50pm PDT
Grand Mesa F

Operations, Any

12:50pm PDT

Lunch and Sponsor Showcase

Wednesday June 1, 2016 12:50pm - 2:00pm PDT
Grand Mesa Foyer

Breaks

1:10pm PDT

Lightning Talk: Welcome/Intro - Alex Williams, The New Stack

Speakers

Alex Williams

Wednesday June 1, 2016 1:10pm - 1:15pm PDT
Grand Mesa A-F

Lightning Talks

1:15pm PDT

Lightning Talk: Raspberry Pi's run containers using Apache Mesos - Sharma Podila, Netflix

This talk will highlight Mesos running Docker containers on ARM processor based Raspberry Pi 3's. I will share the steps taken to compile and then run Mesos agents on the Pi's, along side other x86 based agents. Time and logistics permitting, I will demo a rack of Pi's running the Mesos cluster.

Wednesday June 1, 2016 1:15pm - 1:20pm PDT
Grand Mesa A-F

Lightning Talks

1:20pm PDT

Lightning Talk: An off-the-network approach to monitoring microservices - Sahil Bansal, Netsil

The increased adoption of microservices has necessitated a rethink in the way application performance monitoring works for distributed systems. We propose an off-the-network, stream processing approach to create a real-time copy of application chatter and use this copy as the “source of truth” to create a topology map of services. This topology map helps SREs to visually identify choke-points and hotspots and identifying API end-points makes it a completely framework agnostic approach reducing the overall time to value for performance monitoring and addressing SLA issues.

Wednesday June 1, 2016 1:20pm - 1:25pm PDT
Grand Mesa A-F

Lightning Talks

1:25pm PDT

Lightning Talk: Mesos Integration for Detector-Based Alerting - Janet Yu, SignalFx

For anyone who wants to interact with Mesos’s observability metrics - hear about how we set up a Mesos cluster using Docker containers, integrated with it using a collectd plugin, then created dashboards for monitoring and detector-based alerting.

Wednesday June 1, 2016 1:25pm - 1:30pm PDT
Grand Mesa A-F

Lightning Talks

1:30pm PDT

Lightning Talk: Introducing Blazar: an out-of-this-world CI environment built on Mesos - Tom Petr, HubSpot

This lightning talk will introduce Blazar, HubSpot's Mesos-based CI environment built from scratch. We'll quickly run though how it works, benefits seen, and lessons learned.

Wednesday June 1, 2016 1:30pm - 1:35pm PDT
Grand Mesa A-F

Lightning Talks

1:35pm PDT

Lightning Talk: Enabling Docker apps to use platform security features using Mesos and Marathon - Dr. Abhishek Gupta, Intel

In this talk (and quick demo), I will show how Mesos attributes combined with Marathon constraints can be used to a) expose H/W as well as S/W features such as security and acceleration capabilities to Mesos master and b) enable application frameworks to land up on the matching Mesos slaves to get the best benefits and utilization in a Mesos enabled data center. The seamless integration with Mesos and Marathon enables Docker applications with significantly different needs. e.g. key security, batch, analytics, etc to be intelligently mapped in a heterogeneous Mesos data center.

Wednesday June 1, 2016 1:35pm - 1:40pm PDT
Grand Mesa A-F

Lightning Talks

2:00pm PDT

minimesos - The Experimentation and Testing Tool for Apache Mesos - Frank Scholten, Container Solutions

The Apache Mesos project allows a developer to orchestrate and utilize a cluster of machines as if it were a single pool of resources. Engineers from multiple disciplines are writing “frameworks” to take advantage of the redundancy and scalability that Mesos provides. During the development of the ELK stack on Mesos (Elasticsearch, Logstash and Kibana) we found that the Mesos and Docker community is sorely missing tools to enable integration tests and projects to reduce boilerplate code. We decided to create our own tool for experimenting with Mesos and testing frameworks: minimesos, available at

https://www.minimesos.org

Minimesos is an experimentation and testing tool which can be used as a standalone cli application or from within a JUnit test. Start a containerized Mesos cluster, start the scheduler of your framework and perform assertions. At the end of the test the cluster is destroyed. In this talk I will introduce minimesos, it's features, design and implementation and what is on the horizon.

Speakers

Frank Scholten

Senior Software Engineer, Container Solutions

Frank is a senior software engineer at Container Solutions. He is been contributing to various Apache projects in the past such as Apache Mahout and Apache Whirr and has spoken on these topics at conferences. Recently he has been involved in the development of the Mesos Elasticsearch... Read More →

Wednesday June 1, 2016 2:00pm - 2:50pm PDT
Grand Mesa ABC

Developer, Beginner

2:00pm PDT

Upgrading a Mesos Cluster - Greg Mann, Mesosphere

Upgrading a running cluster can be a daunting task, but do not fear: Mesos masters and agents intelligently persist their state to allow recovery after restart, which enables upgrades with zero downtime! In this talk, we’ll cover the best practices and potential pitfalls you should be aware of before performing a live upgrade of a Mesos cluster: how to properly kill and restart Mesos master/agent processes, how and when to recompile Mesos schedulers and modules, and what to do when things go wrong.

Speakers

Greg Mann

Software Engineer, Mesosphere

Greg Mann is a distributed systems engineer at Mesosphere and an Apache Mesos contributor. He came to distributed systems by way of high performance computing, performing computational studies of solid state material properties during his time in the physical chemistry PhD program... Read More →

Upgrading a Mesos Cluster pdf

Wednesday June 1, 2016 2:00pm - 2:50pm PDT
Grand Mesa DE

Developer, Intermediate

2:00pm PDT

Redis on Apache Mesos, A New Framework - by Huawei - Dhilip Kumar S, Huawei Technologies

Among all the in-memory cache stores available the popular one is Redis.
Though Redis is extremely simple to install for standalone KV store, but to host redis-as-a-service in your cloud it becomes complex.
Creating, administering , monitoring, clustering and metering 1000s of instance of redis server is extremely complex
Along with Mesos, a thin high performing framework exclusively written for redis will not only retain the redis’s inherent performance but also simplifies these problems to a large extent.
Huawei in collaboration with the community recently open sourced a framework for Redis on Mesos which is available on github https://github.com/mesos/mr-redis
This presentation will focus on that framework and a detailed discussion on framework’s design & its future plans.
A demo will also be shown by using this framework how easy to create 1000s of redis service instances in less than a minute by using Mesos. The presentation will also briefly touch on the cloudfoundry framework for mesos.

Speakers

Dhilip Kumar Shankaranarayanan

System Architect, huawei

Engineer@Huawei PaaS teamCreator and Maintainer of the redis framework Spoke at MesosCon 2016 NASpoke at Shanghai Cloud Foundry Summit 2015

MrRedis MesosCon2016 Dhilip Kumar pdf

Wednesday June 1, 2016 2:00pm - 2:50pm PDT
Chasm Creek

Frameworks, Any

2:00pm PDT

Throw Away Your Firewalls and Make Your Applications More Secure - Casey Davenport, Project Calico

Count the number of data breaches in 2015 and it's clear that enterprise security is splitting at the seams. The old model of trying to secure large applications using firewall appliances between each application “tier” just isn't working. As we move into the cloud-native era and break applications into smaller more easily understandable micro-services, there is a huge opportunity to revolutionize security by rendering developer intent directly into the network fabric to create networks that are more secure and more dynamic than ever before. Casey will discuss how evolving micro-services architectures allow you to throw away your traditional firewalls, and transition data center networks from statically configured, application-specific monoliths to highly dynamic, scalable, and secure systems.

Speakers

Casey Davenport

Senior Software Engineer, Tigera

Casey Davenport is one of the lead maintainers for Project Calico and has worked on software defined networking solutions since 2012. He is an active Kubernetes community member and currently co-leads the Kubernetes networking special interest group (k8s-sig-network).

MesosCon2016Slides pdf

Wednesday June 1, 2016 2:00pm - 2:50pm PDT
Grand Mesa F

Operations, Intermediate

3:00pm PDT

A Novel Approach for Distributing and Managing Container Images: Integrating CernVM File System and Mesos - Jakob Blomer, CERN; Jie Yu & Artem Harutyunyan, Mesosphere

CERN developed and is using CernVM File System (CVMFS) to distribute terabytes of software to hundreds of thousands of nodes across hundreds of datacenters. CVMFS uses a combination of lazy loading, extensive indexing, deduplication, caching and geographic distribution. This help to significantly reduce the network load and speed-up the distribution.
All these features make CVMFS a very attractive candidate for solving container-image management and distribution problem in Mesos.
In this talk we are going to present our work on integrating CVMFS client with Mesos agents as well as show how CVMFS backend can be used as a secure and scalable container image registry. We will also run a demo in which we will show how can one launch a container running a popular Linux distribution (image size is about ~300MB) by only downloading a tiny fraction of the image (~6MB).

Speakers

Jakob Blomer

Computer Scientist, CERN

Jakob Blomer is a computer scientist in the scientific software group at CERN in Geneva. He is the lead developer of the CernVM File System and the CernVM virtual appliance. Blomer received a PhD in computer science from the Technical University of Munich in 2012 and he was a visiting... Read More →

Artem Harutyunyan

Director of Engineering, Mesosphere

Artem Harutyunyan is a Director of Engineering at Mesosphere where he works on Apache Mesos and Marathon projects. Prior to joining Mesosphere he spent several years at Qualys where he led the design and development of a distributed system for storing and analyzing large volumes of... Read More →

Jie Yu

Senior Software Engineer, Mesosphere

Mesos CVMFS Mesoscon 2016 pdf

Wednesday June 1, 2016 3:00pm - 3:50pm PDT
Grand Mesa DE

Developer, Intermediate

3:00pm PDT

Running Cassandra on Apache Mesos Across Multiple Datacenters at Uber - Abhishek Verma & Matthias Eichstaedt & Teng Xu, Uber

Traditionally, machines were statically partitioned across the different services at Uber. In an effort to increase the machine utilization, Uber has recently started transitioning most of its services, including the storage services, to run on top of Mesos. This presentation will describe the initial experience building and operating a framework for running Cassandra on top of Mesos running across multiple datacenters at Uber. This framework automates several Cassandra operations such as node repairs, addition of new nodes and backup/restore. It improves efficiency by co-locating CPU-intensive services as well as multiple Cassandra nodes on the same Mesos agent. It handles failure and restart of Mesos agents by using persistent volumes and dynamic reservations. This talk includes statistics about the number of Cassandra clusters in production, time taken to start a new cluster, add a new node, detect a node failure; and the observed Cassandra query throughput and latency.

Speakers

Matthias Eichstaedt

Sr. Engineering Manager, Uber

Abhishek Verma

Software Engineer, Uber

Dr. Abhishek Verma is currently working on running Cassandra on top of Mesos at Uber. Prior to this, he worked on BorgMaster at Google and was the first author of the Borg paper published in Eurosys 2015. He received an MS in 2010 and a PhD in 2012 in Computer Science from the University... Read More →

Teng Xu

sr software engineer, uber

I am software engineer working in storage platform team at uber. Currently, I am working on a project to launch cassandra as service for uber internal users and we run cassandra on Mesos.

mesoscon uber pdf

Wednesday June 1, 2016 3:00pm - 3:50pm PDT
Grand Mesa ABC

Developer, Any

3:00pm PDT

Managing Large SQL Database Clusters with the Apache Mesos Crate Framework - Aslan Bakirov & Christian Lutz, Crate.IO

The reliable and scalable access to databases with a standardized interface like SQL or an ORM remains a real challenge. Crate is an open source, highly scalable, shared-nothing distributed SQL database. It offers the scalability and performance of a modern NoSQL database with the power of SQL. Still, the nodes forming such a cluster need to be orchestrated.

With the introduction of persistent volumes in Mesos 0.23, reliability of stateful services improved. After a task failure or a Mesos agent restart, the stateful framework guarantees the availability of stateful data. As such it is a natural fit for a clustered database like Crate.

The Crate Mesos Framework, developed as an open source project, integrates the data storage layer with Mesos. It is a good fit for stateful services that run on top of Mesos. It avoids operations teams to manually install Crate on their cluster with resources, such as disk space, statically partitioned. Instead, it scales infinitely due to its shared-nothing architecture. The framework is highly fault tolerant: If a node or task fails, Mesos reschedules Crate instances and attaches them to the existing Crate cluster. The framework makes use of Mesos-DNS for data rebalance operations and service discovery.

The Crate Mesos Framework API simplifies managing the cluster. Using the framework API, system managers scale the cluster simply by changing the number of instances. Scaling out is easy: By using constraint rules, the Mesos framework enforces only one Crate instance to run on each host in our configuration. Scaling back by gracefully removing nodes from the cluster, is a challenge, though. The Crate Mesos framework API takes care of this task, taing into account a number of corner cases.

Speakers

Aslan Bakirov

Software Engineer, Crate.IO

Aslan Bakirov is a Software Engineer and working at Crate.IO. He focused on big data research, worked with Mesosphere and recently joined the integrations team at Crate.IO. Before he became a Developer, he pursued a career as junior boxing champion.

Christian Lutz

CEO, Crate.io

Christian is a successful builder of software companies, including enterprise delivery platforms and big consumer portals. Previous to Crate he was co-founder of the Impossible Project (Polaroid Film Production), Fatfoogoo (in-game trading), CEO of ucp & SVP Qpass Inc (Mobile content... Read More →

MesosCon Presentation FINAL (1) pdf

Wednesday June 1, 2016 3:00pm - 3:50pm PDT
Chasm Creek

Frameworks, Intermediate

3:00pm PDT

Apache Mesos Security Best Practices (2016) - Adam Bordelon & Alexander Rojas, Mesosphere

Organizations migrating their infrastructure to Apache Mesos are concerned about protecting their critical workloads and sensitive data from naive/untrusted users and programs. Going beyond last year’s tips about encryption, authentication, and authorization, this year’s talk will cover advancements in:
- Authentication and authorization module interfaces
- Authenticating and authorizing HTTP operator endpoints
- Filtering Web UI and state endpoints based on HTTP user
- Protecting sandbox access
Come prepared to learn about the above, and share with us your needs and stories

Speakers

Adam Bordelon

Mesosphere, Distributed System Engineer

Adam Bordelon is a distributed systems architect at Mesosphere and an Apache Mesos committer. Before joining Mesosphere, Adam lead development on Hadoop core at MapR, built distributed systems for recommendations at Amazon, and re-architected the LabVIEW compiler at National Instruments... Read More →

Alexander Rojas

Senior Software Engineer, Mesosphere, Inc.

Alexander Rojas is a software engineer at Mesosphere Hamburg. He has been contributing to the Apache Mesos project over the last year. Before joining Mesosphere, Alexander worked on distributed rendering systems at 3DExcite. He studied Computer Systems at the National University of... Read More →

Wednesday June 1, 2016 3:00pm - 3:50pm PDT
Grand Mesa F

Operations, Intermediate

3:50pm PDT

Coffee Break and Sponsor Showcase

Wednesday June 1, 2016 3:50pm - 4:20pm PDT
Grand Mesa Foyer

Breaks

4:20pm PDT

Be a Microservices Hero - Dragos Dascalita Haut, Adobe

At Adobe APIs are powering the next generation of Creative applications.

Mesos makes it very easy and fun to deploy and run Robust and Scalable Microservices in the Cloud. Today's technologies offer simple solutions to create RESTfull services while Mesos brings them to life faster.

As the number of microservices increase and the inter communication between them becomes more complicated, we soon realize we have new questions awaiting our answers: how do microservices authenticate ? how do we monitor who's using the APIs they expose ? How do we protect them from attacks ? How do we set throttling and rate limiting rules across a cluster of microservices ? How do we control which service allows public access and which one we want to keep private ? How about Mesos APIs and its frameworks ? Can they benefit from these features as well ?

Come and learn a scalable architecture to manage microservices in Mesos by integrating an API Management layer inside your Mesos clusters. This presentation will show you what an API Management layer is, what it's composed of and how it can help you expose microservices in a secure,managed and highly-available way, even in multi-Mesos cluster setups.

During this session you will also have the opportunity to learn how Adobe's API Platform solved this problem, where it is today and what it envisions do to with Mesos further.

If you're working with microservices already or you're creating new ones then this presentation is for you. Come and learn how Mesos together with an API management layer will make you a microservices hero in your organisation.

Speakers

Dragos Dascalita Haut

Project Lead, Adobe I/O, Adobe Systems, Inc.

Dragos Dascalita Haut is working as Project Lead for Adobe I/O, working with his team in Romania, India and his hometown San Jose on scaling Adobe’s APIs using a distributed serverless platform. Dragos prefers dynamic programming languages over static ones, dogs over cats, and like... Read More →

Be a microservices hero mesos con pdf

Wednesday June 1, 2016 4:20pm - 5:10pm PDT
Grand Mesa DE

Developer, Intermediate

4:20pm PDT

Efficient Usage of Apache Mesos using Container Hibernation - Kamalakannan Muralidharan, Paypal

When operating an Mesos Cluster, one of the challenge is efficiently using the resources. One of the benefit of mesos is scheduling application on demand and so we can take down applications and bring it up any time. One of the use case in companies which have presence across Geo Location is that the resources which are wasted as there are times where some running application won't be used. The idea is to the put the application ( like Jenkins master instances, Testing environment etc.,) which is not getting traffic for a predetermined 'N' hours/minutes and then bring the application back from hibernation when the first request of traffic comes again. This requires integration with Software LoadBalancer which needs capabilities like events based on traffic pattern and traffic hits.

Speakers

Kamalakannan Muralidharan

Senior Member Technical Staff, PayPal

I have 13 years of experience in Software Engineering. we have been using Mesos and its framework in our company for the past 3 years. I have presented about OSGi in JavaOne and also about docker and distributed cluster managers in internal talks. I am currently building an massive... Read More →

Wednesday June 1, 2016 4:20pm - 5:10pm PDT
Grand Mesa ABC

Developer, Intermediate

4:20pm PDT

Frameworks in Harmony - How to Implement Quotas, Roles, Weights and Reservations in Production - Vishnu Mohan, Mesosphere

A lot of interesting features have made it into recent Mesos releases that allow greater control over resource fairness, prioritization and starvation prevention in a multi-tenant datacenter.

Learn how to use Quotas, Reservations, Roles and Weights with customer-inspired use-cases and example solutions.

Topics covered include how to run multiple instances (and versions) of frameworks like Spark, Cassandra, Kafka, Marathon, Jenkins, etc., all on the same Mesos Cluster while still ensuring that no single framework starves the other of resources.

Other use-cases include how to manage and prioritize the resources shared and consumed by Production, Staging and Development environments.

Speakers

Vishnu Mohan

Solutions Architect, Mesosphere

Vishnu Mohan is a Solutions Engineer at Mesosphere working closely with strategic customers in the field on Performance, Management and Automation initiatives. When he’s not analyzing sandbox logs or coding against some API for fun, he may be found rock climbing, hiking, running... Read More →

MesosCon 2016 Frameworks in Harmony Two Slides Per Page pdf

MesosCon 2016 Frameworks in Harmony Slides with Notes pdf

Wednesday June 1, 2016 4:20pm - 5:10pm PDT
Chasm Creek

Frameworks, Intermediate

Host Organization Apple

4:20pm PDT

A Seamless Monitoring System for Apache Mesos Clusters - Drew Gassaway, Bloomberg LP

Mesos and its distributed processing frameworks offer an easy way to migrate computation tasks to a machine-agnostic environment. To use the capabilities of Mesos to execute distributed tasks effectively a unified monitoring system is required. The monitoring system has to address the integration of disparate logging and metric facilities resulting from the heterogeneous tasks that can be executed on Mesos.

In this talk, we'll look at a framework that offers a way to ingest log, metric, and other data, and send it upstream. We'll go into detail about how the framework uses the dynamic Mesos state available on each slave to aggregate logs and metric data in a way that's transparent to running applications. It also provides a plugin-based component that can automatically ingest slave data such as detailed Mesos task resource usage statistics. We’ll also discuss the performance characteristics.

Speakers

Drew Gassaway

Senior Software Developer, Bloomberg LP

Drew is a developer at Bloomberg on a team building an analytics platform for Bloomberg Vault.

SeamlessMonitoringForMesosClusters pdf

Wednesday June 1, 2016 4:20pm - 5:10pm PDT
Grand Mesa F

Operations, Intermediate

5:20pm PDT

CI and CD at Scale: Scaling Jenkins with Docker and Apache Mesos - Carlos Sanchez, CloudBees

In this presentation Carlos Sanchez will share his experience running Jenkins at scale, using Docker and Apache Mesos to create one of the biggest (if not the biggest) Jenkins clusters to date.

By taking advantage of Apache Mesos, the Jenkins platform is dynamically scaled to run jobs across hundreds of Jenkins masters, on Docker containers distributed across the Mesos cluster. Jenkins slaves are dynamically created based on load, using the Jenkins Mesos and Docker plugins, running in containers distributed across multiple hosts, and isolating job execution.

This presentation will allow a better understanding of Apache Mesos and the challenges of running Docker containerized and distributed applications, particularly JVM ones, by sharing a real world use case, including good and bad decisions and how they affected the development.

Speakers

Carlos Sanchez

Principal Scientist, Adobe

Carlos Sanchez is a Principal Scientist at Adobe Experience Manager, specializing in software automation, from build tools to Continuous Delivery and Progressive Delivery. Involved in Open Source for over 15 years, he is the author of the Jenkins Kubernetes plugin and a member of... Read More →

CI and CD at Scale Scaling Jenkins with Docker and Apache Mesos pdf

Wednesday June 1, 2016 5:20pm - 6:10pm PDT
Grand Mesa DE

Developer, Intermediate

5:20pm PDT

Spark on Apache Mesos: The State of the Art - Tim Chen, Mesosphere

Speakers

Tim Chen

Distributed Systems Engineer, Mesosphere

Wednesday June 1, 2016 5:20pm - 6:10pm PDT
Grand Mesa ABC

Developer, Intermediate

5:20pm PDT

Building a Machine Learning Orchestration Framework on Apache Mesos - Antony Arokiasamy & Kedar Sadekar, Netflix

A scaleable and adaptable machine learning platform is essential for an organization to harness the full potential of their data. This talk outlines how Docker, Spark, Hadoop and several other building blocks can be integrated into a machine learning framework on Mesos. We will discuss how our Mesos framework leverages custom executors, framework/status messages and resource attributes to schedule tasks in a multi-tenant environment. A heterogeneous workload of Spark, Python, R & Scala tasks co-exist and run thousands of computations concurrently on an elastic Mesos cluster of hundreds of nodes. We will demonstrate how a simple user interface and a DSL allows researchers to design, test and deploy resilient machine learning pipelines.

Speakers

Antony Arokiasamy

Senior Software Engineer, Netflix

Antony is currently an engineer on the Personalization Infrastructure team at Netflix. His primary focus is on building various big data infrastructure components around Spark and Mesos that help algorithmic engineers at Netflix to innovate faster and improve personalization for our... Read More →

Kedar Sadekar

Sr. Software Engineer, Netflix Inc

I am a Senior software engineer on the Personalization Infrastructure team at Netflix that builds scalable, distributed computing systems for the algorithmic engineers that help improve member personalization. Interested in speaking about ML infrastructure challenges and solutions... Read More →

Meson MesosCon pdf

Wednesday June 1, 2016 5:20pm - 6:10pm PDT
Chasm Creek

Frameworks, Intermediate

5:20pm PDT

Container Network Interface (CNI) Support in Apache Mesos - Jie Yu & Avinash Sridharan, Mesosphere; Qian Zhang, IBM

Currently, despite the wide adoption of Mesos as the kernel for the data center, Mesos does not have a standardized interface to plug into different networks. Existing modules, such as the port mapping isolator or net-modules, are focused solutions that aim to make Mesos work on specific types of networks. In this talk Qian, Avinash and Jie will present the design and implementation of a new network isolator the network/cni isolator that implements the CNI (Container Network Interface) spec, proposed by CoreOS. The network/cni isolator will allow Mesos containers to work, potentially, on any type of IP network. CNI allows for a clean division of work, allowing Mesos to focus on network isolation and offloading network configuration to native binaries called CNI plugins. There are CNI plugins developed for different types of networks (e.g., bridge, flannel, calico, weave etc.) allowing Mesos to run containers on a multitude of different networks.

Speakers

Avinash Sridharan

Senior Software Engineer, Mesosphere

Avinash Sridharan is a software engineer at Mesosphere. At Mesosphere, he has been focusing on improving and developing the networking stack within Mesos. Prior to Mesosphere Avinash has been working in the networking industry, designing and implementing software-based data-planes... Read More →

Jie Yu

Senior Software Engineer, Mesosphere

Qian Zhang

Software Architect, IBM China

Qian Zhang is a software architect in IBM China, he has more than 10 years working experiences on resource management / scheduling, cloud computing, virtualization / container technologies. Currently he is Apache Mesos committer and PMC member, his contributions covers CNI support... Read More →

Container Network Interface (CNI) for Mesos pdf

Wednesday June 1, 2016 5:20pm - 6:10pm PDT
Grand Mesa F

Operations, Intermediate

6:15pm PDT

Onsite Attendee Reception & Sponsor Showcase

Wednesday June 1, 2016 6:15pm - 7:30pm PDT
Grand Mesa Foyer

Evening Events

7:30am PDT

New Stack Pancake Breakfast

Come have a short stack with The New Stack, sponsored by Intel.

Pancakes and a podcast, carbs and conversation — how can you beat that?

Please note that this event can only accommodate 170 attendees. Please arrive early to secure your seat.

Thursday June 2, 2016 7:30am - 8:30am PDT
Grand Mesa F

Breaks

Host Organization Linux Foundation

7:30am PDT

Registration, Continental Breakfast, and Sponsor Showcase

Thursday June 2, 2016 7:30am - 9:15am PDT
Grand Mesa Foyer

Breaks

9:00am PDT

Keynote: Day 2 Welcome and Special Demo - Benjamin Hindman, Founder and Chief Architect, Mesosphere

Speakers

Ben Hindman

Mesosphere Founder - Apache Mesos Co-Creator, Mesosphere

Thursday June 2, 2016 9:00am - 9:15am PDT
Grand Mesa A-F

Keynote

9:15am PDT

Keynote: Spark 2.0 - Matei Zaharia, Apache Spark Creator and CTO of Databricks

Apache Spark is one of the most widely used systems for big data processing, and it has been integrated with Mesos from day one -- in fact, Spark started as an example framework running on the Mesos cluster manager. In this talk, I'll discuss where Spark fits in the data processing ecosystem, and some exciting additions coming out soon in Spark 2.0. In particular, unlike Apache Hadoop, Spark was designed to be a computing engine agnostic of storage systems, so that it can connect to a variety of systems beyond HDFS. This choice proved useful because most organizations use a mix of storage systems and want to run Spark on elastic infrastructure such as Mesos. Spark 2.0 will go further in this direction through support for new data sources, high-level APIs that can push key parts of the computation into the storage systems, and a new Structured Streaming API that provides similar optimizations for stream processing.

Speakers

Matei Zaharia

Keynote: Spark 2.0 - Matei Zaharia, Apache Spark Creator and CTO, Databricks

Matei Zaharia is an assistant professor of computer science at MIT and CTO of Databricks, the company commercializing Apache Spark. He started the Spark project when he was a graduate student at UC Berkeley, and continues to serve as Spark’s vice president at Apache. Matei has also... Read More →

Spark 2.0 pdf

Thursday June 2, 2016 9:15am - 9:45am PDT
Grand Mesa A-F

Keynote

9:45am PDT

Keynote: Bringing Mesos to the World - Florian Leibert, Founding CEO, Mesosphere

Apache Mesos has powered remarkable innovations inside some of the world’s biggest and smartest technology companies, but not everyone can follow in their footsteps. A more complete package is necessary if we’re going to bring the power of Mesos and all it enables to organizations of every type.
Join Mesosphere CEO Florian Leibert as he introduces DC/OS, an open source platform aimed to do just that. Special guests from Cisco, Time Warner Cable and Autodesk will explain how they’ve used DC/OS to transform their datacenters, take technologies such as containers into production, and rollout new applications in a fraction of the time it would have taken otherwise.

Speakers

Florian Leibert

Founding CEO, Mesosphere

Florian Leibert is the founding chief executive officer of the high tech software company Mesosphere. In this position he has partnered with a number of clients to establish effective, data-centric business cultures while also leading premiere open source initiatives such as Chronos... Read More →

Thursday June 2, 2016 9:45am - 9:55am PDT
Grand Mesa A-F

Keynote

10:00am PDT

Keynote: Platform Infrastructure at Twitter: The Past, Present and Future - Chris Pinkham, VP of Engineering, Twitter

Platform Engineering builds systems and libraries that enable engineers at Twitter to easily run and operate their services globally at massive scale. These include the core compute and storage infrastructure, search infrastructure, edge, monitoring and messaging platforms, data & analytics platform, and core application services. In recent years, Twitter Inc. has expanded its product portfolio through acquisitions like Periscope, Vine, MoPub, TellApart, Crashlytics, and GNIP of which many of them currently run on the public cloud. To enable deeper integration between products and address the larger business need, it is vital to extend the scope and presence of Twitter’s Platform Infrastructure.

Chris Pinkham, Vice President of Platform Engineering will share the current state of Twitter’s Platform Infrastructure, the challenges when operating at scale and his team’s vision for hybrid cloud services.

Speakers

Chris Pinkham

Vice President of Engineering, Twitter

Chris leads Platform Engineering at Twitter where he is responsible for compute and storage platform, search infrastructure, data & analytics platform, communication infrastructure and other essential core application service teams. Before joining Twitter, Chris was Senior Vice President... Read More →

Thursday June 2, 2016 10:00am - 10:30am PDT
Grand Mesa A-F

Keynote

10:30am PDT

Coffee Break and Sponsor Showcase

Thursday June 2, 2016 10:30am - 11:00am PDT
Grand Mesa Foyer

Breaks

11:00am PDT

Quota - Reliable Guarantees - Jörg Schad & Joris Van Remoortere, Mesosphere

A problem when running multiple frameworks on Mesos is that if frameworks are not cooperative it might lead to a situations when certain frameworks hog all of the resources. Since version 0.27.0 Mesos provides an experimental mechanism to reserve a certain amount of resources in an entire cluster, i.e. not tied to a particular agent. Quota can be viewed as a cluster-wide dynamic reservation available for operators only.

In this talk Joris, Alex, and Jörg will first present an overview of the current state of Quota and the internal workflow of handling Quota request (which is especially helpful for understanding the implications, potential errors messages, and limitations). Then they will present a hands-on demo on how Quota can be configured from an operator's point of view. This talk will conclude with feedback and discussion of the future development of quota.

Speakers

Joris Van Remoortere

Distributed System Engineer, Mesosphere

Joerg Schad

Tech Lead Community, Mesosphere

Jörg Schad is a software engineer at Mesosphere in Hamburg where he works on the Apache Mesos project. Prior to this he worked on SAP Hana and in the Information Systems Group at Saarland University. His passions are distributed (database) systems, data analytics, and distributed... Read More →

Thursday June 2, 2016 11:00am - 11:50am PDT
Grand Mesa ABC

Developer, Intermediate

11:00am PDT

Building Frameworks with the New HTTP APIs - Vladimir Vivien, EMC {code}

Writing Mesos frameworks with the original framework API came with dependencies that made implementations of new client burdensome. If you have attempted to write a framework before the HTTP API you certainly ran into issues like the lack robust documentation, dependency on platform-dependent libmesos library, network communication issues between your cluster members.

Introduced in version 0.24.0, the new HTTP API solves these problems with a simpler HTTP-based protocol for communication between Mesos cluster members. The presentation explores how the HTTP API makes it possible to create robust frameworks using the HTTP library of your favorite language. The session will do a walkthrough of the HTTP endpoint requests to arrive at a fully functioning framework while addressing the implication of using pure JSON or the Protobuf for data encoding.

Speakers

Vladimir Vivien

Software Engineer, VMware

Vladimir Vivien has an extensive career as a software engineer. He currently works at VMware in the Cloud Native Application group where he is passionate about contributing upstream to the Kubernetes open source project. Vladimir also enjoys writing blogs on technology and he has... Read More →

mesos http api mesoscon2016 vladimirvivien pdf

Thursday June 2, 2016 11:00am - 11:50am PDT
Chasm Creek

Frameworks, Intermediate

11:00am PDT

No One Puts Java in the Container - Ken Sipe, Mesosphere

Whether it is Docker or the Mesos Container running with Apache Mesos means running in a container, but do you really understand cgroups and how they work? Do you understand the difference between CPU Sets and CPU Shares? Many organizations use Java for their application development, but do you understand the consequence of what impact the cgroup constraints have on the JRE?

This talk starts with a look at the anatomy of a container including control groups (cgroups) and namespaces. Then we will take a deep understand of Java's memory management and GC characteristics and how JRE characteristics change based on core count. The session will detail specifically the difference between CPU sets and CPU shares and memory management. The session will close with a deep understanding of the consequences of running the JRE in a CPU share environment and the potential for pseudo-random behavior of running in a heterogeneous datacenter.

Speakers

Ken Sipe

Distributed Applications Engineer, Mesosphere

Ken Sipe is a Cloud Solution Architect and Distributed Systems Engineer at Mesosphere, focused on helping companies simplify the development and operation of large scale infrastructure and distributed systems with Apache Mesos and DC/OS. Ken is a JavaOne Rockstar, an author and an... Read More →

Thursday June 2, 2016 11:00am - 11:50am PDT
Grand Mesa DE

Operations, Intermediate

11:00am PDT

It’s Complicated, Okay (or Let’s Talk Openly about Apache Mesos’ OSS Neighbors, Friends and Rivals) - Aaron Williams, Mesosphere

Mesos is never the only OSS you need to run your production datacenter. And just like all of us hanging out together at MesosCon, if you surround Mesos with its OSS friends, you get a happy, highly productive Mesos. But you have to be careful, not all OSS plays well with others.

In this talk, we’ll start by looking at a handful of production Mesos datacenters from major users. We’ll use these real-world examples to abstract a standard Mesos datacenter architecture that contains all of the components needed to run today’s modern, containerized apps with big data and analytics frameworks.

With that harmonized Mesos datacenter architecture, we’ll look at each of the abstract components and discuss the leading OSS projects that fit each piece. We’ll discuss the characteristics of what makes some solutions work well with Mesos, and call out the projects that don’t meet the standard.

We’ll wrap up the talk by showing the complete architecture diagram, and show the single- command trick for bringing all of the best OSS components together and getting them up and running in a production cluster.

Speakers

Aaron Williams

Engineering Leader, Mesosphere

Accomplished engineering manager with a passion and drive for building and scaling infrastructure, and utilizing data to solve complex issues. Strong believer in collaborative teamwork -- the sum is greater than its parts. Demonstrated track record of directing fast-paced, high-performing... Read More →

Thursday June 2, 2016 11:00am - 11:50am PDT
Grand Mesa F

Wildcard, Beginner

12:00pm PDT

GPU Support in Apache Mesos - Kevin Klues, Mesosphere

GPUs are the tool of choice for accelerating the data mining, machine learning and deep learning algorithms abundant in today's data-driven computing industry. These algorithms help solve problems ranging from weather forecasting to face and speech recognition to helping find a cure for cancer. In spite of this, Mesos has traditionally not supported GPUs as an allocatable resource. As such, many users have resorted to having a separate GPU cluster to run these algorithms outside of their primary Mesos installation. Fine-grained sharing of resources between these clusters has not been possible.

By adding first class support for GPUs in Mesos, developers are finally able to leverage the power of the GPU in the same shared cluster as all of their other workloads. This talk covers the details of how we added GPU support to Mesos as well as how developers and operators can now leverage this new capability.

Speakers

Kevin Klues

Distinguished Engineer, NVIDIA

Kevin Klues is a distinguished engineer on the NVIDIA Cloud Native team. Kevin has been involved in the design and implementation of a number of Kubernetes technologies, including the Topology Manager, the Kubernetes stack for Multi-Instance GPUs, and Dynamic Resource Allocation (DRA... Read More →

GPU Support in Mesos pdf

Thursday June 2, 2016 12:00pm - 12:50pm PDT
Grand Mesa ABC

Developer, Intermediate

12:00pm PDT

Maintenance: Automating Collaboration Between Frameworks and Operators - Joseph Wu, Mesosphere

Mesos is great at allocating cluster resources for schedulers. However, there is no way to downsize your cluster, short of pulling the plug on machines! How do you defragment or roll a kernel upgrade through your cluster? Most importantly, how do you do so without violating any frameworks’ SLAs?

This talk will introduce Inverse Offers and present different use cases for them. Maintenance Primitives, a feature implemented using Inverse Offers will be used as an example to present the requirements and challenges of cooperatively deallocating resources from a running cluster.

Guidelines, strategies, and trade-offs with respect to Inverse Offers and Maintenance Primitives for framework writers as well as cluster operators will be presented.

Speakers

Joseph Wu

Software Engineer, Mesosphere

Joseph Wu is a software engineer at Mesosphere. Joseph has been contributing to Mesos since mid-2015 and has worked on features like Maintenance Primitives and the Container Logger module. Joseph studied Computer Engineering & Biochemistry at the University of Washington, Seattle... Read More →

Thursday June 2, 2016 12:00pm - 12:50pm PDT
Chasm Creek

Frameworks, Intermediate

12:00pm PDT

Autoscaling Microservices with Apache Mesos and Marathon - David Arnold, Tendril

Mesos provides the ability to harness the resources of a compute cluster, and provides detailed insights into those compute resources. This made Mesos a great fit at Tendril for their microservices architecture that powers their Energy Services Management platform. The challenge arose as to how to best leverage Mesos to dynamically scale individual services based on workload. David Arnold will cover how Tendril created an autoscaling solution with Mesos and the Marathon framework running on Amazon Web Services.

Speakers

David Arnold

Manager - Site Reliability Engineering, Tendril

David Arnold is the manager of site reliability engineering at Tendril, a leading provider of Energy Services Management. Over past 15 years he has worked with a diverse set of companies spanning from startups to fortune 500s focusing on the implementation of cross-functional and... Read More →

Thursday June 2, 2016 12:00pm - 12:50pm PDT
Grand Mesa DE

Operations, Intermediate

12:00pm PDT

How We Built a Chargeback System for Twitter’s Compute Platform (Mesos/Aurora) That Incentives Higher Resource Utilization - Micheal Benedict & Jeyappragash Jeyakeerthi, Twitter

Twitter’s compute platform manages hundreds and thousands of containers across tens and thousands of hosts. At that scale, problems we have observed are:
1. Containers are not often sized appropriately in a way to utilize underlying hardware resources efficiently
2. Lack of visibility into who owns what containers (and services)
3. Identifying and tracking the utilization of resources by individual containers to the org structure

We built a Chargeback system for Mesos that provides visibility into who owns what and how much resources they use. It also generates a "bill" based on usage data. The goal here is to incentivize users of Mesos through visibility into what they use & effectively right size their containers to use the underlying resources in a cost-effective way. In this talk, we describe how we built the chargeback service that
1. Ingests utilization and quota data from Mesos master & container stats
2. process around figuring out resources to charge on (ex, cpu cores used per day)
3. ownership mapping i.e how we built a identity service that ties ldap roles with organizational teams (takes a more project/team centric view)

Towards the end of the talk, we will share a case study of how chargeback at Twitter helped improve resource utilization (cores in this case) by over 30% and save millions in $ prior to implementing something like Chargeback.

Speakers

Micheal Benedict

Head of Engineering Productivity, Pinterest

Micheal Benedict heads the Engineering Productivity organization at Pinterest that is responsible for languages strategy, source code management, build systems & CI/CD platform. Previously, Micheal led products for the Compute Platform at Twitter. Micheal holds a master's degree in... Read More →

JJ Jeyappragash

tetrate.io

Jeyappragash previously built the team and lead the technical roadmap for Twitter's Cloud Infrastructure Management Platform. This platform helps developers manage their services and provides detailed visibility to the infrastructure and the services that use the infrastructures... Read More →

Thursday June 2, 2016 12:00pm - 12:50pm PDT
Grand Mesa F

Wildcard, Intermediate

12:50pm PDT

Lunch and Sponsor Showcase

Thursday June 2, 2016 12:50pm - 2:00pm PDT
Grand Mesa Foyer

Breaks

2:00pm PDT

Resource Allocation in Apache Mesos: Present and Future - Benjamin Mahler, Mesosphere

Mesos provides a flexible “two-level” scheduling approach to cluster management: Mesos is responsible for allocation of resources to application-specific framework schedulers, and framework schedulers decide how best to use the resources available to them. We’ll explore why an architectural separation between resource management and scheduling has contributed to the widespread adoption of Mesos in the open source community. Next, we’ll specifically focus on resource allocation in Mesos, looking to understand the model, the present state of affairs, and the future directions that will be taken.

Speakers

Benjamin Mahler

Senior Software Engineer, Mesosphere

Benjamin Mahler is a Software Engineer at Mesosphere. Previously, he worked on Mesos at Twitter on some of the largest Mesos deployments in the world. Benjamin is a committer and PMC member of the Mesos project. He studied Software Engineering at the University of Waterloo and is... Read More →

mesoscon 2016 2 key

Thursday June 2, 2016 2:00pm - 2:50pm PDT
Grand Mesa ABC

Developer, Intermediate

2:00pm PDT

Integrating Storage and Apache Mesos: Anatomy of a Framework - Jörg Schad, Mesosphere & Björn Kolbeck, Quobyte

Mesos has been traditionally great at supporting stateless services , but most complex services actually require some form of scalable persistence.
This combination of container scheduling and software defined storage are enabling a new kind of data center that is well beyond the current enterprise IT for both new and legacy applications.

In this talk we present at the the challenge of deploying and operating a software storage system with and for Mesos from two sides.
First from an operator/user perspective: How can I deploy distributed storage frameworks on top of Mesos and utilize it from other services? What are current options for distributed storage inside Mesos.
Next from a framework perspective: What does the software storage need from Mesos and the container environment? How can the file systems be backed by containers? What Mesos feature would be required for even better support in the future.

Speakers

Björn Kolbeck

Founder, Quobyte

Joerg Schad

Tech Lead Community, Mesosphere

Thursday June 2, 2016 2:00pm - 2:50pm PDT
Chasm Creek

Frameworks, Advanced

2:00pm PDT

Monitoring Microservices: Docker, Mesos and DCOS Visibility at Scale - Loris Degioanni, Sysdig

Everyone knows how microservices and containers are revolutionizing the way we deploy applications and maintain our infrastructure. But as many teams are starting to find out, containers still have a key challenge: monitoring and troubleshooting them can be impractical, painful, and sometimes plain impossible. With the rise of microservice based architectures and container orchestration tools such as Mesos and DCOS managing difficult task has become a little bit easier - if you take the right approach.

In this demo-driven presentation, Loris Degioanni will cover the current state of the art of container and microservice monitoring, including the pros and cons of some popular approaches. Using real tools running in live environments, he will demonstrate how to effectively monitor, explore and troubleshoot highly scaled Mesos deployments.

The presentation will feature live interaction with container environments and live demos of all tools and techniques discussed. Special emphasis will be put on using the Mesos portfolio of scheduling and management tools as well as sysdig, an open source container and system troubleshooting tool developed by the presenter.

GitHub link: https://github.com/draios/sysdig

Specific topics will include:
* visualizing the physical vs logical architecture of Mesos & DCOS deployments
* understanding performance at the holistic microservice/application level for orchestrated systems
* Leveraging Mesos metadata such as Master, Slave, Marathon and labels for more intelligent troubleshooting
* extracting process and application-level performance metrics from inside containers using non-intrusive methods
* troubleshooting detailed network activity among distributed containers

Speakers

Loris Degioanni

Founder, Sysdig

Loris Degioanni is the CEO and founder of Sysdig, the Docker monitoring platform. He is also the creator of the popular open source troubleshooting tool, sysdig, and the open source container security tool Falco. Prior to founding Sysdig, Loris co-created Wireshark, the open source... Read More →

Thursday June 2, 2016 2:00pm - 2:50pm PDT
Grand Mesa DE

Operations, Intermediate

2:00pm PDT

Apache Mesos Ecosystem at Allegro - First Year of Production Use - Tomasz Ziarko and Wojciech Lesicki, Allegro

We would like to show what we are doing with mesos at Allegro. Allegro is the largest retail and auction site in Poland. Mesos is our main production system (right now one thousand CPUs big) for deploying microservices. During the presentation we are going to share our experience from around 1 year of setting automation of entire clusters that integrate with our cloud ecosystem. The stack we are going to talk about is based on: Zookeeper, Terraform, Marathon, Puppet, OpenStack, Nginx, Graphite, Grafana and many more. We would like to show how these tools are used in our daily workflow to cope with our developers needs. There will be a few points about size and problems encountered along the road and some major achievements in operating Mesos in production at scale in Allegro. We are going to show a demo of our production environment to picture our daily workflow with mesos environment.

Speakers

Wojciech Lesicki

Grupa Allegro Sp. z o.o., Product Manager

Tomasz Ziarko

Allegro Group

Thursday June 2, 2016 2:00pm - 2:50pm PDT
Grand Mesa F

Wildcard, Intermediate

3:00pm PDT

Yammer Datacenter Story - On-Premise, GFS, Azure - Tobias Haag, Microsoft; Kyle Gordon, Yammer / Microsoft

All things Docker seem to be the defining slogan for Yammer these days. And what other way to run Docker at scale than Mesos?
Yammer wrote an in-house datacenter automation platform which was fraught with problems and restrictions the Mesos landscape promised to solve, and in 2015 engineers at Yammer started exploring it as a possible replacement.
This talk will focus on two core points of the implementation run at Yammer: Docker & Security
Everything has to run inside Docker. From Zookeeper to the Mesos agents and even the executors. Dedication, mixed with some despair, eventually resulted in the platform for production today.

Security is the second biggest piece to honor the commitment made to Yammer customers as part of the Office365 suite. The path to provide a good solution to security aspects like compartmentalization, trust bootstrap, access control and transport encryption proved a balancing act between customer commitment and developer friendliness.

In the end Mesos helped us deliver Docker's promise of Build, Ship, Run as the foundation of environments Yammer can trust to run from Dev all the way to Production at scale and anywhere on the planet.

Speakers

Kyle Gordon

Software Engineer 2, Yammer / Microsoft

I have been an engineer on the operations team for Yammer for almost 3 years. Currently I am in the process of creating a stable environment to migrate Yammer to Azure. We are primarily a micro service company and are an ideal fit to live on a mesos architectured environment. We’ve... Read More →

Tobias Haag

Senior Software Engineer, Microsoft

4 years at Yammer from Junior to Senior Software Engineer at Yammer / Microsoft. Since late 2013 part of the Infrastructure team with focus on Datacenter automation and software lifecycle support. As of mid 2015 leading developer on Azure migration effort with focus on Docker and... Read More →

MesosCon 2016 Yammer pptx

Thursday June 2, 2016 3:00pm - 3:50pm PDT
Grand Mesa ABC

Developer, Intermediate

3:00pm PDT

A Declarative Approach to Building Stateful Frameworks - Gabriel Hartman, Mesosphere

Framework authors attempting to write frameworks which encapsulate or administer stateful services often encounter difficulties mapping the resource offer stream provided by Mesos to the framework’s provisioning, maintenance and upgrade goals. For disparate frameworks: Cassandra, Kafka, HDFS we have adopted a declarative approach to address this mapping problem. This approach has also been applied successfully to different layers of the framework lifecycle. In particular, we have applied a declarative approach to the fault-tolerant fulfillment of reservation and persistent volume requirements, and to the overall maintenance and upgrade of frameworks.

Speakers

Gabriel Hartmann

Technical Lead, Mesosphere, Inc.

Gabriel is the lead engineer on the DC/OS Stateful SDK team at Mesosphere. Prior to Mesosphere, Gabriel worked on SQLAzure, the best database in the world. Before Mesosphere he worked at Microsoft working on the high availability team developing the second generation of SQL Azure... Read More →

Thursday June 2, 2016 3:00pm - 3:50pm PDT
Chasm Creek

Frameworks, Advanced

3:00pm PDT

The Architecture of Mantl - Steven Borrelli, Asteris, LLC

Mesos is a core component of the Mantl project (Mantl.io), an open-source platform that makes it easy to deploy containerized workloads and streaming data applications.

Mantl integrates Mesos with a number of tools to provide security, high availability, service discovery, health checks, and load-balancing. It deploys to most cloud providers in minutes.

This talk will discuss the architecture and engineering of Mantl, from using Terraform to orchestrate multi-cloud deployments, Mesos-Consul for service discovery, load-balancing via Traefik, Mantl-api for launching frameworks, and Calico for Overlay networking.

Speakers

Steven Borrelli

CEO & Founder, Asteris, LLC

Steven Borrelli is the founder of Asteris, located in St. Louis, Missouri. He’s the lead architect and a core committer for the Mantl.io project.

Thursday June 2, 2016 3:00pm - 3:50pm PDT
Grand Mesa DE

Operations, Intermediate

3:00pm PDT

How to Stand Up a 600 Node Bare Metal Mesos Cluster in Two Weeks - Craig Neth, Verizon Labs

In this talk, Craig Neth (Distinguished Member of Technical Staff at Verizon) will describe his experiences in bringing up a 600 node Mesos cluster - from power on to running tasks in 14 days. He will describe the Open Source Hardware and Software he used, as well as the processes and methodology how all these components were used to automate and streamline the process. Neth will also talk about some of the challenges he faced and the improvements he’s hoping to see in the future.

Speakers

Craig Neth

Distinguished Member of Technical Staff, Verizon Labs

Craig Neth is an Architect and Software Developer at Verizon Labs who also likes to play with hardware. Over the course of his career, he’s done a little of everything, from building device drivers for mobile platforms to helping build Operating systems, Compilers, and Development... Read More →

Mesoscon 2016 cneth pdf

Thursday June 2, 2016 3:00pm - 3:50pm PDT
Grand Mesa F

Wildcard, Any

3:50pm PDT

Coffee Break and Sponsor Showcase

Thursday June 2, 2016 3:50pm - 4:20pm PDT
Grand Mesa Foyer

Breaks

4:20pm PDT

Self-Healing Systems on Elastic Mesos in the Cloud - Mike Sells, Oracle Data Cloud

The Oracle Data Cloud is processing billions of events and multiple terabytes of data per day in real-time. In this presentation Mike Sells will discuss the motivation, design, and implementation of an elastic Mesos platform to handle the needs of their real-time systems. They will discuss how to think about the elasticity of applications inside of Mesos as well as Mesos itself with details on how to implement both. Why scaling down, not up, is the biggest challenge. They will explain how they built a high volume low latency web tier and a Spark streaming data pipeline on top of the same self-healing platform. How building this multi-tenant system on top of Mesos can maximize resource utilization as well as productivity while automatically adjusting to the demands of traffic and self healing on failures. This includes how they test and validate that elasticity does not impact data integrity. And will conclude by demonstrating the real-time production system, creating live failures, and showing its ability to self heal and auto correct.

Speakers

Mike Sells

Director, Software Development, Oracle Data Cloud

Mike Sells is Director of Software Development at the Oracle Data Cloud. He leads a team building out highly scalable and fault tolerant systems on top of Mesos and Spark that power their audience targeting and data ingestion platforms. He’s been working on a variety of distributed... Read More →

mesoscon v2 pdf

Thursday June 2, 2016 4:20pm - 5:10pm PDT
Grand Mesa ABC

Developer, Intermediate

4:20pm PDT

Lessons Learned from Running Heterogeneous Workload on Apache Mesos - Imran Shaikh, Yellow Pages

Mesos is by far the best orchestration system available out there for running containers. At YP, when we started using Mesos couple of years ago, we were overwhelmed with the robustness it provided. We quickly started on-boarding some of the apps. We soon were faced with multiple request from various developers to on-board their apps onto Mesos. These apps ranged from infrastructure tools to highly critical billing systems, from traditional java to web based apps, from map reduce jobs to batch processing jobs, from one off cron jobs to build pipeline jobs. These apps were written in Java, Go Lang, Node.js, Ruby/Rails, C, Scala as well as Python. And their configuration came from git repo, key value store, pom files or some static files managed somehow. We were made to provide a unified platform that served the use-cases for all of them or at least come up with the processes that everyone can use.

Initially, we relied heavily on the out of the box features that Mesos provided. But that wasn’t enough to support these myriad range of apps. For eg: redirecting all logs to STDOUT/STDERR wasn’t enough or possible for some of these apps. Managing app secrets was very insecure and exposed via ENV variables in Marathon. Also, managing app configs for various environment was tedious. We wanted to achieve persistence and fault tolerance with block devices to run databases through Mesos. There was no easy way to troubleshoot running processes in production. There was a need to manage multiple similar frameworks within the same Mesos cluster. And the list goes on and on.

We, at YP, having been exposed to this madness. While doing so, we have picked up valuable information along the way. We may not have solved all the issues, but we have made significant strides to resolve them.

Speakers

Imran Shaikh

Lead/Architect

Imran is a Lead/Architect working in Greater LA area. He is a proven technical leader with an industry experience of 14+ years working with Fortune 500 companies. He has worked extensively developing, architecting and managing cloud and distributed computing technologies at Yahoo... Read More →

MesosConPresentation pdf

Thursday June 2, 2016 4:20pm - 5:10pm PDT
Grand Mesa DE

Operations, Intermediate

4:20pm PDT

Migrating 200+ Load Balancers into Apache Mesos - Stephen Salinas, HubSpot

It’s no secret that web services gain enhanced reliability and operational simplicity by running in Mesos. HubSpot wanted to achieve these same benefits for a much more static piece of infrastructure, our load balancers. This talk will explore HubSpot’s open source solution for keeping load balancers reliably reachable and up to date while running them inside a Mesos cluster, and the lessons learned from moving a normally static piece of infrastructure into a dynamic Mesos environment.

Speakers

Stephen Salinas

Senior Software Engineer, HubSpot

Stephen is a Senior Software Engineer on the Platform as a Service team at HubSpot and a contributor to the Singularity mesos framework. He focuses on supporting load balancers and docker usage at HubSpot and has previously spoken at Container Days Boston.

SalinasMesosCon2016 pdf

Thursday June 2, 2016 4:20pm - 5:10pm PDT
Chasm Creek

Operations, Intermediate

4:20pm PDT

Marathon Meets External Storage - Steven Wong, EMC(code); Jörg Schad & Matthias Eichstedt, Mesosphere

Many people are running stateless containers on top of Mesos, but most complex services actually require some form of storage. On the other hand many enterprise have made large investments into Network Attached Storage and Storage Area Networks, and still continue to do so.

This talks aims to both worlds and show how external volumes can be efficiently used together with containerized applications. We will first discuss the challenges of creating so called external volumes and how to share them between different containers. Then we will discuss a number of practical use cases for external volumes such as running legacy database applications on top of Mesos.

We will conclude with a demo of how we combine Marathon and external volumes created on AWS EBS.

Speakers

Matthias Eichstedt

Engineering Manager, Mesosphere

I'm Engineering Manager of the Orchestration team at Mesosphere, based in Hamburg, Germany.

Joerg Schad

Tech Lead Community, Mesosphere

Steven Wong

Developer Advocate, EMC

Steve Wong is a Developer Advocate with EMC{code}, a group within EMC focused on contributions to community open source projects. He is a principal contributor to the Mesos DVDI isolator project, which enables use of external storage volume mounts with containerized applications running... Read More →

MesosCon16 Marathon Meets External Storage pdf

Thursday June 2, 2016 4:20pm - 5:10pm PDT
Grand Mesa F

Wildcard, Advanced

5:20pm PDT

Finagle, linkerd, and Apache Mesos: Magical Operability Sprinkles for Microservices - Oliver Gould, Buoyant

Finagle and Mesos are two core technologies used by Twitter and many other companies to scale application infrastructure to high traffic workloads. In this talk, we describe how these two technologies work together to form applications that are both highly scalable and resilient to failure. We introduce linkerd, an open-source proxy form of Finagle, which extends Finagle's operational model to non-JVM or polyglot microservices. Finally, we show how linkerd can be used to "wrap" applications running on Mesos to provide higher-level, service-based semantics around scalability, reliability, and fault-tolerance for microservices---even in the presence of unpredictable traffic volumes and unreliable hardware.

Speakers

Oliver Gould

CTO, Buoyant

Oliver Gould is a core maintainer of Linkerd, and is the co-founder and CTO of Buoyant, where he leads open source development efforts. Prior to Buoyant, he was a staff infrastructure engineer at Twitter, where he was the tech lead of Observability, Traffic, and Configuration & Coordination... Read More →

Thursday June 2, 2016 5:20pm - 6:10pm PDT
Chasm Creek

Developer, Advanced

5:20pm PDT

Persistence Primitives in Action 2.0 - Max Neunhöffer, ArangoDB; Jörg Schad & Neil Conway, Mesosphere

Mesos 0.23.0 introduced the first version of persistence primitives supporting stateful frameworks. Since then framework developer have started using persistence primitives and based on their feedback Mesos has introduced a number of additions and improvements for persistence primitives. These features included for example admin endpoints for better maintainability of reservation labels enabling frameworks to distinguish multiple reservations.
We will give an overview of the existing persistence primitives including the new features and then with the example of the ArangoDB Mesos framework discuss the practical challenges when implementing and using persistence primitives.

Speakers

Neil Conway

Distributed Systems Engineer, Mesosphere

Max Neunhöffer

Database Developer, ArangoDB

Max Neunhöffer is a mathematician turned database developer. In his academic career he has worked for 16 years on the development and implementation of new algorithms in computer algebra. During this time he has juggled a lot with mathematical big data like group orbits containing... Read More →

Joerg Schad

Tech Lead Community, Mesosphere

Thursday June 2, 2016 5:20pm - 6:10pm PDT
Grand Mesa ABC

Developer, Advanced

5:20pm PDT

All Marathons Need a Runner. Introducing Pheidippides - James Humphrey & John Dennison, Activision Publishing

All Marathons need a runner. Introducing Pheidippides (John Dennison & James Humphrey, Activision Publishing, Inc). With Docker microservices taking the world by storm, John and James cover the challenges with the transition, approach, and their solution to this problem. Introducing a new service named Pheidippides (the apocryphal runner of the first marathon), built to help deploy, configure, and manage services within the Mesos, Marathon, and Chronos ecosystem.

Speakers

John Dennison

Data Scientist, Activision Publishing, Inc

John Dennison is a Data Scientist at Activision with a background in applied analytics and software engineering. John delivers analytics solutions to help improve player experience and game design. Before joining Activision, John worked with analytics startups in the healthcare and... Read More →

James Humphrey

Senior Game Analytics Engineer, Activision Publishing, Inc

James Humphrey is a Senior Software Engineer at Activision with a background in enterprise Java and software architecture. James is part of a team that builds data pipelines to support the integration of analytics within the games they create. Before joining Activision, James worked... Read More →

pheidip.key zip

Thursday June 2, 2016 5:20pm - 6:10pm PDT
Grand Mesa DE

Operations, Intermediate

5:20pm PDT

Workload Co-Location Has Just Begun: Sub-Millisecond Quality of Service at Scale - Maciej Patelczyk & Murali Sundar, Intel

Today, Apache Mesos enables operators and developers of modern distributed systems to treat machines like abstract resources in number of cores and gigabytes of memory. However, with abstractions comes simplifications and assumptions. Modern servers exhibit very different performance behavior based on the workload configuration and the its use of shared resources like last-level cpu caches, memory, network and I/O bandwidth. This becomes an unavoidable aspect when operators are tasked with running latency critical systems while maintaining high utilization **and** not violating service level objectives. In this talk, we will address how to maintain ease of use for operators and developers through Apache Mesos abstractions **and** make the best use of the hardware platform in operating system and hardware controls and monitoring to ensure quality of service of business critical jobs.

Speakers

Maciej Patelczyk

Software Engineer, Intel

Murali Sundar

Sr. Principal Engineer / Software Defined Infrastructure Group, Intel

I work in the Software Defined Infrastructure Group (SDIG) at Intel, where I specialize in creating tools and technologies that allow small and large cloud operators and services providers to run their datacenters more efficiently. I am interested in workload scheduling, metrics gathering... Read More →

MesosCon 2016 Intel Murali Maciej pdf

Thursday June 2, 2016 5:20pm - 6:10pm PDT
Grand Mesa F

Wildcard, Advanced

7:00pm PDT

Offsite Attendee Reception - Viewhouse Centennial

Join fellow attendees for an evening event with a view! ViewHouse is a local chef-driven, casual eatery, bar & rooftop that will provide a great atmosphere to wrap up the event. Get ready for good food, lawn games, and conversation.

Transportation will be provided.

Thursday June 2, 2016 7:00pm - 9:30pm PDT
ViewHouse Centennial 7101 South Clinton Street Centennial, CO 80112

Evening Events

9:00am PDT

Hackathon - Sponsored by Cisco

Join other members of the Apache Mesos community, in partnership with Hackathon Sponsor Cisco, for a day of hacking.

Content details (including contest and prize information!) will be provided soon.

If you are interested in attending, please add the Hackathon option to your registration.

Friday June 3, 2016 9:00am - 3:00pm PDT
Mesa Verde (lower level)

Hackathon