Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic

Sign up or log in to bookmark your favorites and sync them to your phone or calendar.

Tuesday, May 31
 

4:00pm

Early Registration
Avoid the Wednesday morning rush and pick-up your badge early!

Tuesday May 31, 2016 4:00pm - 7:00pm
Grand Mesa Foyer
 
Wednesday, June 1
 

7:30am

9:00am

Keynote: Welcome Address - Benjamin Hindman, Founder and Chief Architect, Mesosphere
Speakers
avatar for Ben Hindman

Ben Hindman

Founder and Chief Architect, Mesosphere
Benjamin Hindman is a Founder and Chief Architect at Mesosphere where he leads a team building out core services for the Mesosphere Data Center Operating System (DCOS). Ben co-created Apache Mesos as a PhD student at UC Berkeley before bringing it to Twitter where it now runs on tens of thousands of machines powering Twitter's datacenters. An academic at heart, his research in programming languages and distributed systems has been published in... Read More →


Wednesday June 1, 2016 9:00am - 9:30am
Grand Mesa A-F

9:30am

Keynote: The New Open Source Data Center - Joshua Bernstein, Vice President of Technology, EMC {code}
In today’s ever shifting world the most accomplished CIO’s know that adaptability is crucial for their organizations success. For the past 20 years some of the most successful organizations in the world have been using open source platforms and tools to break the status quo and disrupt industries. EMC {codes}’s Josh Bernstein will share his personal experiences doing just that from his days running the Siri Deployment and Infrastructure Architecture team at Apple. By embracing open source and DevOps tools and methodologies, Josh’s team was able to take  Siri from launch to tens of thousands of servers, deployed in more than a dozen locations, in under 5 years.  Join us to find out why building open source data centers is the key to the modern data center and how the world’s largest organizations are taking advantage of this knowledge.


Speakers
avatar for Josh Bernstein

Josh Bernstein

Vice President of Technology, EMC {code}
Joshua Bernstein recently joined EMC as the new VP of Technology for the Emerging Technologies Division. Prior to EMC, Joshua ran the Siri Deployment and Infrastructure Architecture team at Apple for 4 1/2 years. As a member of the small team, Joshua and his colleagues successfully took Siri from launch to tens of thousands of servers, deploying in over a dozen locations worldwide. Prior to working at Apple, Joshua was the senior... Read More →



Wednesday June 1, 2016 9:30am - 9:40am
Grand Mesa A-F

9:45am

Keynote: A Real-Time Cloud for the Internet of Things - Professor Ken Birman, Cornell University
We’ve all read the hype about the Internet of Things: a technology trend that seems endlessly about to happen, yet has been stubbornly hard to integrate with cloud computing.  In this talk I want to ask why this has been so, and how we can fix it.   

I’ll start by describing work Cornell has done over the past few years on creating a cloud platform to host “smart power grid” applications.  This involves (1) new rack-scale management solutions aimed at applications that need to run 24x7, (2) replication with ultra-fast updates for scalable real-time responsiveness,  and (3) new real-time storage solutions, to enable a new kind of big-data temporal computing.  But new models also create huge performance puzzles.  For our work, these center on how to overcome Brewer’s CAP principle.  CAP was about performance tradeoffs, and the key to conquering CAP is to leverage RDMA and NVRAM hardware, which offer amazing speedups for critical data paths.   By working from the ground up, and using RDMA and NVRAM as accelerators for data replication, storage and management solutions, we can get huge speedups compared to older styles of cloud computing, even when consistency and fault-tolerance are required.

This work is all open-source, and should be of special interest to the Apache Mesos community because container models turn out to be one of the key enablers for pulling off these tricks.  With older styles of cloud virtualization, it can be incredibly hard to offer scheduling guarantees, and technologies like RDMA and NVRAM are very hard to virtualize.  Containers eliminate both of those obstacles. 

Speakers
avatar for Prof. Ken Birman

Prof. Ken Birman

N. Rama Rao Professor of Computer Science, Cornell University
Ken is a serial entrepreneur and a professor of computer science at Cornell University, where he has worked since getting his PhD at UC Berkeley in 1981. His research has always focused on reliable distributed computing. Back in the 1990’s he developed core parts of the French air traffic control system, the New York and Swiss Stock Exchanges, the US Navy AEGIS communication system, and Oracle’s network management infrastructure... Read More →




Wednesday June 1, 2016 9:45am - 10:15am
Grand Mesa A-F

10:15am

Keynote: Verizon Calls Mesos - Larry Rau, Director of Architecture and Infrastructure, Verizon Labs
As data services change the way the world does business, Verizon Labs has built a platform designed around the Mesos open source system that enables the robust development of micro services for a variety of products and services. This presentation will use a real world example of how Verizon Lab's Mesos-based platform integrates with America's most reliable wireless network to transform how Verizon builds and delivers new services.

Speakers
avatar for Larry Rau

Larry Rau

Director, Architecture and Infrastructure, Verizon Labs
Larry leads development teams working on the advancement and use of cluster computing at Verizon Labs.  Much of that time spent on developing solutions targeting the Internet of Things.  Prior to joining Verizon Labs Larry was the CTO of Consumer Solutions in Embedded Java unit of Sun Microsystems, CTO and co-founder of SavaJe technologies, and engineer at Lucent Bell Labs all working on operating systems and language runtimes and... Read More →


Wednesday June 1, 2016 10:15am - 10:25am
Grand Mesa A-F

10:30am

Coffee Break and Sponsor Showcase
Wednesday June 1, 2016 10:30am - 11:00am
Grand Mesa Foyer

11:00am

Containers in Apache Mesos: Present and Future - Jie Yu & Tim Chen, Mesosphere
Mesos currently supports two types of container runtimes: one is Mesos’ own pluggable runtime which uses OS primitives directly (a.k.a. the Mesos containerizer); the other is to delegate the entire container management to Docker engine (a.k.a. the Docker containerizer). Recently, we added container image support to Mesos containerizer, which allows it to launch off-the-shelf Docker or Appc containers without depending on Docker daemon or rkt. In this talk, we are going to discuss the motivation of why we want to unify the containerizers in Mesos and how this benefits the Mesos maintainers and our users. We will then talk about the current status of this work, and show what can be built on top of this pluggable architecture. Finally, we will share our vision on the near future for the Mesos containerizer and how it’s going to enable more innovation in the Mesos ecosystem.

Speakers
TC

Tim Chen

Distributed Systems Engineer, Mesosphere
Tim Chen is on the Mesosphere core team and focuses on containerization and big data frameworks. He is also a PMC/committer on Apache Drill and Apache Mesos, and contributed to other open source projects such as Spark, Kafka, Hive. Before joining Mesosphere, Tim past experiences includes working on data services on Halo, CloudFoundry (PaaS) and search engines.
JY

Jie Yu

Senior Software Engineer, Mesosphere
Jie Yu is a Software Engineer at Mesosphere, Inc, focused on Mesos development. He has worked on several key components in Mesos including containerization, persistence primitives and replicated logs. Before joining Mesosphere, he was a software engineer at Twitter. Jie obtained his PhD in Computer Science and Engineering from the University of Michigan where he conducted research for concurrent and event-driven systems.



Wednesday June 1, 2016 11:00am - 11:50am
Grand Mesa DE

11:00am

Contributing to Apache Mesos: Where to Begin - Joris Van Remoortere & Michael Park, Mesosphere
Have you found a bug in Mesos that you would like to fix yourself? Have you got a feature that you would like to introduce to Mesos? Are you already a contributor, but finding it difficult to maneuver the codebase and getting your patches committed?

This talk is intended for those who would like to contribute to Mesos. Contributing to any open source project can be intimidating and trying to seek information remotely can be frustrating and demotivating. We aim to provide information that will help contributors, and will cover topics such as the project management process (JIRA, shepherds), coding standards, developer documentation, developer tools, debugging tools and techniques, running tests, and submitting patches.

Speakers
MP

Michael Park

Software Engineer, Mesosphere
Michael Park is an Apache Mesos committer working at Mesosphere. He loves language design, compiler construction and distributed systems. He takes a special interest in C++, and is a member of the ISO C++ Standards Committee. He started to work on Apache Mesos in late 2014 and contributed to introducing persistent primitives as well as improving the performance of the `/state` endpoint.
JV

Joris Van Remoortere

Distributed System Engineer, Mesosphere
Joris Van Remoortere is an Apache Mesos committer at Mesosphere. Joris has been contributing to Mesos since 2014 and previously worked on low latency distributed graph databases. He studied Computing & Financial Management at the University of Waterloo.


Wednesday June 1, 2016 11:00am - 11:50am
Grand Mesa ABC

11:00am

Building Highly Available Mesos Frameworks - Neil Conway, Mesosphere
Production-quality Mesos frameworks must be able to continue managing tasks despite unreliable networks and faulty computers. Mesos provides tools to help developers do fault-tolerant task management, but putting these tools together effectively remains something of a black art. This talk will offer practical guidance to current and prospective framework developers to help them understand how Mesos deals with failures and the tools it provides to enable fault tolerant frameworks. Mesos operators will also benefit from a discussion of exactly how Mesos behaves during network partitions and other failure scenarios.

This talk will cover the following specific topics:
* fault tolerance in Mesos itself: how Mesos masters and agents behave in the face of process crashes and network partitions
* the tools that Mesos provides to help framework authors write reliable systems (e.g., task state reconciliation, the state abstraction, and the MasterDetector interface)
* the lifecycle of a Mesos task
* a collection of recommendations for how framework developers should build highly available framework schedulers and executors

Speakers
NC

Neil Conway

Distributed Systems Engineer​, Mesosphere
Neil Conway is a Distributed Systems Engineer at Mesosphere, where he works on the Apache Mesos project. Before Mesosphere, Neil built automated trading systems at a quantitative hedge fund, completed a PhD in distributed systems at UC Berkeley, was a principal engineer at a stream processing startup, and was a committer and major developer of the PostgreSQL relational database system


Wednesday June 1, 2016 11:00am - 11:50am
Chasm Creek

11:00am

Federated Mesos Clusters for Global Data Center Designs - Krishna Kumar, Huawei
Multi region global Data centers can be setup by using Mesos as the Kernel for all resource management. This presentation will cover one of the designs for federated mesos clusters to enable uniform data center resource orchestration across the globe. We will also compare and contrast various design approaches that has been considered for this project including some industry’s competitive models. The Model we propose is not only distributed by nature, it can also tolerate dynamic addition/deletions/modifications of masters in the federation. We will also explain how a framework can participate in such a design without having to change its core functionality.

A policy engine is integrated with this cluster federation model to control the nature of the scheduler. This federation work will not only handle the IaaS layer resource requirements but also extended to deal with PaaS layer application resources. So in the container world, Mesos can play a big role directly handling the applications which could avoid other PaaS resource schedulers by using custom frameworks. Various optimum schedulers can be pluggable to this model and health of the overall system is taken care by inter cluster communication in HA mode. Finally we will show a POC demo developed within our lab and probably the ongoing implementation details in our cloud.

Speakers
avatar for Krishna Kumar

Krishna Kumar

Lead Architect & Delivery Head Cloud Huawei India, Huawei Technologies
Krishna M Kumar is a Lead Architect & Delivery Head Cloud PaaS Huawei India. He is with the IT Industry around 20 years and has led several cloud projects for various clients. Currently his team is working on various cloud services implementation & optimization for Huawei Cloud. He is a avid marathon runner and a Certified Yoga Instructor. See more at https://in.linkedin.com/in/krishna00.



Wednesday June 1, 2016 11:00am - 11:50am
Grand Mesa F

12:00pm

Apache Mesos 1.0 - Vinod Kone & Anand Mazumdar, Mesosphere
Mesos will soon reach the 1.0 milestone. In addition to new features, this would mean a more stable user-facing API and stricter support/release guarantees for operators/framework developers. The aim of this talk is to apprise the operators/framework developers/users about the new API and also discuss the support/compatibility guarantees offered by Mesos going forward.

This talk is a sequel to the last year’s MesosCon Seattle talk on “Mesos HTTP API” and continues from where it left off.

This talk will cover the following specific topics:
- Discuss the newly introduced Operator APl.
- Update on the recent improvements to the Framework API.
- Update on client libraries for the new Framework API.
- Release cadence for Mesos going forward.
- Support/Compatibility guarantees for operators/framework developers e.g., backporting of patches etc.
- Master->Agent renaming in the 1.0 API.

Speakers
avatar for Vinod Kone

Vinod Kone

Distributed Systems Engineer, Mesosphere
Vinod Kone is an Engineer at Mesosphere working on the Mesos core team. He is also a committer and on the PMC for Apache Mesos and Mesos Jenkins plugin. Previously, he was a Tech Lead for the Mesos team at Twitter. In a past life, he did his PhD in UC Santa Barbara researching how to make cars talk to each other. His interests lie in distributed systems and outdoor adventures.
AM

Anand Mazumdar

Distributed System Engineer, Mesosphere
Anand Mazumdar is a software engineer at Mesosphere where he works on the Apache Mesos project. Prior to that, he used to work at a Quantitative Hedge Fund and Amazon Web Services on scalable data stream processing. He holds a Masters in Computer Science from The University of Texas at Austin. On weekends, you can find him playing Poker at a nearby local casino.



Wednesday June 1, 2016 12:00pm - 12:50pm
Grand Mesa DE

12:00pm

Apache Mesos on Windows: Status and the Roadmap - Alex Clemmer & Daniel Pravat, Microsoft
Windows Server 2016 is expected to be made generally available sometime in Q3 2016, and with it, the Windows Containers API.

Supporting Windows Containers natively is a major growth opportunity for the Mesos community -- by enabling users to operate clusters containing a mix of Unix and Windows hosts, it is possible to significantly reduce administrative overhead and increase resource utilization in data centers.

In this talk we will provide a ground-up view of the work we have done over the last year to make the Windows agent a reality.

We’ll cover the changes made to Mesos core so far, discussing in detail how the Mesos agent works on Windows. We will then discuss the implications of these changes at the service level, covering how to operate clusters with a mix of Windows and Unix nodes in practice.

Finally, we will present a demo running on such a cluster, and a roadmap for future plans.

Speakers
AC

Alex Clemmer

Software Engineer, Microsoft
Alex Clemmer is a software engineer at Microsoft. He started the initiative to add Windows support to Mesos. Prior to this, he was a student. Alex is mostly known for turning Snapchat into a remote filesystem: http://www.nullspace.io/#snapchat-fs and porting lisp to the Apple //e: http://www.nullspace.io/#turtles
DP

Daniel Pravat

Engineering Manager, Microsoft
Daniel Pravat is an Engineering Manager with Microsoft Corporation where he delivered several infrastructure components in Windows and added many cutting edge cellular features to Windows Phone. In the current role in Windows Server he is focused to to bring Mesos framework features to Windows ecosystem.


Wednesday June 1, 2016 12:00pm - 12:50pm
Grand Mesa ABC

12:00pm

Optimistic Offer - What Does it Mean to Apache Mesos Framework - Yong Feng, IBM Canada Ltd.
Mesos enables two layer scheduling by employing an offer-based resource negotiation protocol between the Mesos master and the Framework scheduler. Currently, Mesos only supports the Pessimistic Offer model. With the Pessimistic Offer model, if a resource has been offered to a framework, this same resource will not be offered to another framework until the previous offer times out. When Framework schedulers receive an offer, they will either cache unused offers, or block the offer and then trigger Mesos to resend the offer through the revive API when the Framework has a new workload request. This current method of handling offers, generally leads to tradeoffs among framework performance, resource utilization and allocation fairness.

This talk will introduce an alternative - the Optimistic Offer model - that can reduce the need for such tradeoffs leading to improved scheduling of resources. With the Optimistic Offer model, the same offer will be made available to all frameworks, which provides each framework with an equal opportunity to view for available resources in the cluster. This presentation will cover the proposed Mesos Optimistic Offer development plan, the current development status of the Mesos Optimistic Offer, the process for developing frameworks to utilize the Optimistic Offer model, as well as an evaluation of running existing Mesos frameworks with Optimistic Offer.

Speakers
YF

Yong Feng

Senior Software Architect, IBM Canada Ltd.
Yong Feng is a Senior Software Architect at IBM Platform. He has more than 10 years of experience in design, and implements cluster, grid and cloud computing systems with a focus on scheduling, resource and workload management. He has a deep knowledge on related open-source projects such as OpenStack, Mesos, Swarm, Kubernetes, Spark, etc. and leads the IBM teams who work on them. Yong holds a Ph.D from Northwestern Polytechnical University of... Read More →



Wednesday June 1, 2016 12:00pm - 12:50pm
Chasm Creek

12:00pm

Lessons from Netflix Mesos Clusters - Sharma Podila, Netflix
Netflix customers worldwide streamed over Forty Two Billion hours of content last year. Service style applications, batch jobs, and stream processing alike, from a variety of use cases across Netflix rely on executing container based applications in multi-tenant clusters powered by Mesos and Fenzo. This talk will show you how disparate use cases call for a separation of job management concerns from resource scheduling, as well as a polymorphic job API. Based on the experiences from Netflix projects Mantis and Titus, the talk will highlight results and lessons learned in running Docker and Cgroups based containers in a cloud native environment.

Speakers
avatar for Sharma Podila

Sharma Podila

Senior Software Engineer, Netflix
Sharma Podila is a Senior Software Engineer at Netflix, Inc. He is the author of open source Fenzo scheduling library for Mesos frameworks. His current work includes developing cloud native Mesos frameworks for Netflix project Titus, a Docker based application deployment platform, and project Mantis, a reactive stream processing platform. Sharma is looking forward to chatting about and collaborating on Mesos frameworks and schedulers.



Wednesday June 1, 2016 12:00pm - 12:50pm
Grand Mesa F

12:50pm

Lunch and Sponsor Showcase
Wednesday June 1, 2016 12:50pm - 2:00pm
Grand Mesa Foyer

1:10pm

1:15pm

Lightning Talk: Raspberry Pi's run containers using Apache Mesos - Sharma Podila, Netflix

This talk will highlight Mesos running Docker containers on ARM processor based Raspberry Pi 3's. I will share the steps taken to compile and then run Mesos agents on the Pi's, along side other x86 based agents. Time and logistics permitting, I will demo a rack of Pi's running the Mesos cluster.


Wednesday June 1, 2016 1:15pm - 1:20pm
Grand Mesa A-F

1:20pm

Lightning Talk: An off-the-network approach to monitoring microservices - Sahil Bansal, Netsil

The increased adoption of microservices has necessitated a rethink in the way application performance monitoring works for distributed systems. We propose an off-the-network, stream processing approach to create a real-time copy of application chatter and use this copy as the “source of truth” to create a topology map of services. This topology map helps SREs to visually identify choke-points and hotspots and identifying API end-points makes it a completely framework agnostic approach reducing the overall time to value for performance monitoring and addressing SLA issues.


Wednesday June 1, 2016 1:20pm - 1:25pm
Grand Mesa A-F

1:25pm

Lightning Talk: Mesos Integration for Detector-Based Alerting - Janet Yu, SignalFx

For anyone who wants to interact with Mesos’s observability metrics - hear about how we set up a Mesos cluster using Docker containers, integrated with it using a collectd plugin, then created dashboards for monitoring and detector-based alerting.


Wednesday June 1, 2016 1:25pm - 1:30pm
Grand Mesa A-F

1:30pm

Lightning Talk: Introducing Blazar: an out-of-this-world CI environment built on Mesos - Tom Petr, HubSpot
This lightning talk will introduce Blazar, HubSpot's Mesos-based CI environment built from scratch. We'll quickly run though how it works, benefits seen, and lessons learned.


Wednesday June 1, 2016 1:30pm - 1:35pm
Grand Mesa A-F

1:35pm

Lightning Talk: Enabling Docker apps to use platform security features using Mesos and Marathon - Dr. Abhishek Gupta, Intel
In this talk (and quick demo), I will show how Mesos attributes combined with Marathon constraints can be used to a) expose H/W as well as S/W features such as security and acceleration capabilities to Mesos master and b) enable application frameworks to land up on the matching Mesos slaves to get the best benefits and utilization in a Mesos enabled data center. The seamless integration with Mesos and Marathon enables Docker applications with significantly different needs. e.g. key security, batch, analytics, etc to be intelligently mapped in a heterogeneous Mesos data center.


Wednesday June 1, 2016 1:35pm - 1:40pm
Grand Mesa A-F

2:00pm

minimesos - The Experimentation and Testing Tool for Apache Mesos - Frank Scholten, Container Solutions
The Apache Mesos project allows a developer to orchestrate and utilize a cluster of machines as if it were a single pool of resources. Engineers from multiple disciplines are writing “frameworks” to take advantage of the redundancy and scalability that Mesos provides. During the development of the ELK stack on Mesos (Elasticsearch, Logstash and Kibana) we found that the Mesos and Docker community is sorely missing tools to enable integration tests and projects to reduce boilerplate code. We decided to create our own tool for experimenting with Mesos and testing frameworks: minimesos, available at

https://www.minimesos.org

Minimesos is an experimentation and testing tool which can be used as a standalone cli application or from within a JUnit test. Start a containerized Mesos cluster, start the scheduler of your framework and perform assertions. At the end of the test the cluster is destroyed. In this talk I will introduce minimesos, it's features, design and implementation and what is on the horizon.

Speakers
avatar for Frank Scholten

Frank Scholten

Senior Software Engineer, Container Solutions
Frank is a senior software engineer at Container Solutions. He is been contributing to various Apache projects in the past such as Apache Mahout and Apache Whirr and has spoken on these topics at conferences. Recently he has been involved in the development of the Mesos Elasticsearch framework and the ELK stack on Mesos. During this process minimesos was created, a Mesos experimentation and testing tool which was used to test frameworks during... Read More →


Wednesday June 1, 2016 2:00pm - 2:50pm
Grand Mesa ABC

2:00pm

Upgrading a Mesos Cluster - Greg Mann, Mesosphere
Upgrading a running cluster can be a daunting task, but do not fear: Mesos masters and agents intelligently persist their state to allow recovery after restart, which enables upgrades with zero downtime! In this talk, we’ll cover the best practices and potential pitfalls you should be aware of before performing a live upgrade of a Mesos cluster: how to properly kill and restart Mesos master/agent processes, how and when to recompile Mesos schedulers and modules, and what to do when things go wrong.

Speakers
GM

Greg Mann

Distributed Systems Engineer, Mesosphere
Greg Mann is an engineer at Mesosphere and a contributor to the Apache Mesos project. He came to distributed systems by way of high performance computing, running physics-based simulations of solid state materials during his time in the physical chemistry PhD program at UC Berkeley.



Wednesday June 1, 2016 2:00pm - 2:50pm
Grand Mesa DE

2:00pm

Redis on Apache Mesos, A New Framework - by Huawei - Dhilip Kumar S, Huawei Technologies
Among all the in-memory cache stores available the popular one is Redis.
Though Redis is extremely simple to install for standalone KV store, but to host redis-as-a-service in your cloud it becomes complex.
Creating, administering , monitoring, clustering and metering 1000s of instance of redis server is extremely complex
Along with Mesos, a thin high performing framework exclusively written for redis will not only retain the redis’s inherent performance but also simplifies these problems to a large extent.
Huawei in collaboration with the community recently open sourced a framework for Redis on Mesos which is available on github https://github.com/mesos/mr-redis
This presentation will focus on that framework and a detailed discussion on framework’s design & its future plans.
A demo will also be shown by using this framework how easy to create 1000s of redis service instances in less than a minute by using Mesos. The presentation will also briefly touch on the cloudfoundry framework for mesos.

Speakers
DK

Dhilip Kumar Shankaranarayanan

System Architect, huawei
Engineer@Huawei PaaS team | Creator and Maintainer of the redis framework | Spoke at MesosCon 2016 NA | Spoke at Shanghai Cloud Foundry Summit 2015



Wednesday June 1, 2016 2:00pm - 2:50pm
Chasm Creek

2:00pm

Throw Away Your Firewalls and Make Your Applications More Secure - Casey Davenport, Project Calico
Count the number of data breaches in 2015 and it's clear that enterprise security is splitting at the seams. The old model of trying to secure large applications using firewall appliances between each application “tier” just isn't working. As we move into the cloud-native era and break applications into smaller more easily understandable micro-services, there is a huge opportunity to revolutionize security by rendering developer intent directly into the network fabric to create networks that are more secure and more dynamic than ever before. Casey will discuss how evolving micro-services architectures allow you to throw away your traditional firewalls, and transition data center networks from statically configured, application-specific monoliths to highly dynamic, scalable, and secure systems.

Speakers
avatar for Casey Davenport

Casey Davenport

Software Engineer, Tigera
Casey Davenport is a core developer at Tigera working on Project Calico and has worked on software defined networking solutions since 2012. He is an active technology evangelist for containers and simplified networking, and has spoken recently on related topics at multiple meetups. He holds a Bachelor of Science in Electrical Engineering from Northeastern University.



Wednesday June 1, 2016 2:00pm - 2:50pm
Grand Mesa F

3:00pm

A Novel Approach for Distributing and Managing Container Images: Integrating CernVM File System and Mesos - Jakob Blomer, CERN; Jie Yu & Artem Harutyunyan, Mesosphere
CERN developed and is using CernVM File System (CVMFS) to distribute terabytes of software to hundreds of thousands of nodes across hundreds of datacenters. CVMFS uses a combination of lazy loading, extensive indexing, deduplication, caching and geographic distribution. This help to significantly reduce the network load and speed-up the distribution.
All these features make CVMFS a very attractive candidate for solving container-image management and distribution problem in Mesos.
In this talk we are going to present our work on integrating CVMFS client with Mesos agents as well as show how CVMFS backend can be used as a secure and scalable container image registry. We will also run a demo in which we will show how can one launch a container running a popular Linux distribution (image size is about ~300MB) by only downloading a tiny fraction of the image (~6MB).

Speakers
avatar for Jakob Blomer

Jakob Blomer

Computer Scientist, CERN
Jakob Blomer is a computer scientist in the scientific software group at CERN in Geneva. He is the lead developer of the CernVM File System and the CernVM virtual appliance. Blomer received a PhD in computer science from the Technical University of Munich in 2012 and he was a visiting scholar at John Ousterhout’s group at Stanford University in 2014.
avatar for Artem Harutyunyan

Artem Harutyunyan

Director of Engineering, Mesosphere
Artem Harutyunyan is a Director of Engineering at Mesosphere where he works on Apache Mesos project. Prior to joining Mesosphere he spent several years at Qualys where he led the design and development of a distributed system for storing and analyzing large volumes of data. Prior to Qualys Artem worked at CERN, where he built geographically distributed large-scale Grid and cloud computing systems.
JY

Jie Yu

Senior Software Engineer, Mesosphere
Jie Yu is a Software Engineer at Mesosphere, Inc, focused on Mesos development. He has worked on several key components in Mesos including containerization, persistence primitives and replicated logs. Before joining Mesosphere, he was a software engineer at Twitter. Jie obtained his PhD in Computer Science and Engineering from the University of Michigan where he conducted research for concurrent and event-driven systems.



Wednesday June 1, 2016 3:00pm - 3:50pm
Grand Mesa DE

3:00pm

Running Cassandra on Apache Mesos Across Multiple Datacenters at Uber - Abhishek Verma & Matthias Eichstaedt & Teng Xu, Uber
Traditionally, machines were statically partitioned across the different services at Uber. In an effort to increase the machine utilization, Uber has recently started transitioning most of its services, including the storage services, to run on top of Mesos. This presentation will describe the initial experience building and operating a framework for running Cassandra on top of Mesos running across multiple datacenters at Uber. This framework automates several Cassandra operations such as node repairs, addition of new nodes and backup/restore. It improves efficiency by co-locating CPU-intensive services as well as multiple Cassandra nodes on the same Mesos agent. It handles failure and restart of Mesos agents by using persistent volumes and dynamic reservations. This talk includes statistics about the number of Cassandra clusters in production, time taken to start a new cluster, add a new node, detect a node failure; and the observed Cassandra query throughput and latency.

Speakers
ME

Matthias Eichstaedt

Sr. Engineering Manager, Uber
AV

Abhishek Verma

Software Engineer, Uber
Dr. Abhishek Verma is currently working on running Cassandra on top of Mesos at Uber. Prior to this, he worked on BorgMaster at Google and was the first author of the Borg paper published in Eurosys 2015. He received an MS in 2010 and a PhD in 2012 in Computer Science from the University of Illinois at Urbana-Champaign, during which he authored more than 20 publications in conferences, journals and books and presented tens of talks.
TX

Teng Xu

sr software engineer, uber
I am software engineer working in storage platform team at uber. Currently, I am working on a project to launch cassandra as service for uber internal users and we run cassandra on Mesos.



Wednesday June 1, 2016 3:00pm - 3:50pm
Grand Mesa ABC

3:00pm

Managing Large SQL Database Clusters with the Apache Mesos Crate Framework - Aslan Bakirov & Christian Lutz, Crate.IO
The reliable and scalable access to databases with a standardized interface like SQL or an ORM remains a real challenge. Crate is an open source, highly scalable, shared-nothing distributed SQL database. It offers the scalability and performance of a modern NoSQL database with the power of SQL. Still, the nodes forming such a cluster need to be orchestrated.

With the introduction of persistent volumes in Mesos 0.23, reliability of stateful services improved. After a task failure or a Mesos agent restart, the stateful framework guarantees the availability of stateful data. As such it is a natural fit for a clustered database like Crate.

The Crate Mesos Framework, developed as an open source project, integrates the data storage layer with Mesos. It is a good fit for stateful services that run on top of Mesos. It avoids operations teams to manually install Crate on their cluster with resources, such as disk space, statically partitioned. Instead, it scales infinitely due to its shared-nothing architecture. The framework is highly fault tolerant: If a node or task fails, Mesos reschedules Crate instances and attaches them to the existing Crate cluster. The framework makes use of Mesos-DNS for data rebalance operations and service discovery.

The Crate Mesos Framework API simplifies managing the cluster. Using the framework API, system managers scale the cluster simply by changing the number of instances. Scaling out is easy: By using constraint rules, the Mesos framework enforces only one Crate instance to run on each host in our configuration. Scaling back by gracefully removing nodes from the cluster, is a challenge, though. The Crate Mesos framework API takes care of this task, taing into account a number of corner cases.

Speakers
avatar for Aslan Bakirov

Aslan Bakirov

Software Engineer, Crate.IO
Aslan Bakirov is a Software Engineer and working at Crate.IO. He focused on big data research, worked with Mesosphere and recently joined the integrations team at Crate.IO. Before he became a Developer, he pursued a career as junior boxing champion.
avatar for Christian Lutz

Christian Lutz

CEO, Crate.io
Christian is a successful builder of software companies, including enterprise delivery platforms and big consumer portals. Previous to Crate he was co-founder of the Impossible Project (Polaroid Film Production), Fatfoogoo (in-game trading),  CEO of ucp & SVP Qpass Inc (Mobile content delivery), CEO at uboot.com (mobile youth community). Christian is a serial entrepreneur, freerider, dad of 2, foodie and mountaineer at heart.



Wednesday June 1, 2016 3:00pm - 3:50pm
Chasm Creek

3:00pm

Apache Mesos Security Best Practices (2016) - Adam Bordelon & Alexander Rojas, Mesosphere
Organizations migrating their infrastructure to Apache Mesos are concerned about protecting their critical workloads and sensitive data from naive/untrusted users and programs. Going beyond last year’s tips about encryption, authentication, and authorization, this year’s talk will cover advancements in:
- Authentication and authorization module interfaces
- Authenticating and authorizing HTTP operator endpoints
- Filtering Web UI and state endpoints based on HTTP user
- Protecting sandbox access
Come prepared to learn about the above, and share with us your needs and stories

Speakers
AB

Adam Bordelon

Mesosphere, Distributed System Engineer
Adam Bordelon is a distributed systems architect at Mesosphere and an Apache Mesos committer. Before joining Mesosphere, Adam lead development on Hadoop core at MapR, built distributed systems for recommendations at Amazon, and re-architected the LabVIEW compiler at National Instruments. He completed his Master’s degree at Rice University, building a tool to analyze supercomputer performance data for bottlenecks and anomalies.
avatar for Alexander Rojas

Alexander Rojas

Distributed Systems Engineer, Mesosphere
Alexander Rojas is a software engineer at Mesosphere Hamburg. He has been contributing to the Apache Mesos project over the last year. Before joining Mesosphere, Alexander worked on distributed rendering systems at 3DExcite. He studied Computer Systems at the National University of Colombia and later did some studies in Computational Logic at the Technical University of Dresden.


Wednesday June 1, 2016 3:00pm - 3:50pm
Grand Mesa F

3:50pm

Coffee Break and Sponsor Showcase
Wednesday June 1, 2016 3:50pm - 4:20pm
Grand Mesa Foyer

4:20pm

Be a Microservices Hero - Dragos Dascalita Haut, Adobe
At Adobe APIs are powering the next generation of Creative applications.

Mesos makes it very easy and fun to deploy and run Robust and Scalable Microservices in the Cloud. Today's technologies offer simple solutions to create RESTfull services while Mesos brings them to life faster.

As the number of microservices increase and the inter communication between them becomes more complicated, we soon realize we have new questions awaiting our answers: how do microservices authenticate ? how do we monitor who's using the APIs they expose ? How do we protect them from attacks ? How do we set throttling and rate limiting rules across a cluster of microservices ? How do we control which service allows public access and which one we want to keep private ? How about Mesos APIs and its frameworks ? Can they benefit from these features as well ?

Come and learn a scalable architecture to manage microservices in Mesos by integrating an API Management layer inside your Mesos clusters. This presentation will show you what an API Management layer is, what it's composed of and how it can help you expose microservices in a secure,managed and highly-available way, even in multi-Mesos cluster setups.

During this session you will also have the opportunity to learn how Adobe's API Platform solved this problem, where it is today and what it envisions do to with Mesos further.

If you're working with microservices already or you're creating new ones then this presentation is for you. Come and learn how Mesos together with an API management layer will make you a microservices hero in your organisation.

Speakers
avatar for Dragos Dascalita Haut

Dragos Dascalita Haut

Project Lead, Adobe I/O, Adobe
Solution Architect for Adobe’s API Platform, adobe.io, building a high scale distributed API Gateway running where else but in the Cloud where all APIs wanna be. Working with a fantastic international team our of Romania, India and US and with the emphasis on performance and security, we’re supporting the API go-to-market strategy for Adobe Creative and Marketing Clouds.



Wednesday June 1, 2016 4:20pm - 5:10pm
Grand Mesa DE

4:20pm

Efficient Usage of Apache Mesos using Container Hibernation - Kamalakannan Muralidharan, Paypal
When operating an Mesos Cluster, one of the challenge is efficiently using the resources. One of the benefit of mesos is scheduling application on demand and so we can take down applications and bring it up any time. One of the use case in companies which have presence across Geo Location is that the resources which are wasted as there are times where some running application won't be used. The idea is to the put the application ( like Jenkins master instances, Testing environment etc.,) which is not getting traffic for a predetermined 'N' hours/minutes and then bring the application back from hibernation when the first request of traffic comes again. This requires integration with Software LoadBalancer which needs capabilities like events based on traffic pattern and traffic hits.

Speakers
KM

Kamalakannan Muralidharan

Senior Member Technical Staff, PayPal
I have 13 years of experience in Software Engineering. we have been using Mesos and its framework in our company for the past 3 years. I have presented about OSGi in JavaOne and also about docker and distributed cluster managers in internal talks. I am currently building an massive distributed PaaS using Mesos for our hybrid cloud strategy.


Wednesday June 1, 2016 4:20pm - 5:10pm
Grand Mesa ABC

4:20pm

Frameworks in Harmony - How to Implement Quotas, Roles, Weights and Reservations in Production - Vishnu Mohan, Mesosphere
A lot of interesting features have made it into recent Mesos releases that allow greater control over resource fairness, prioritization and starvation prevention in a multi-tenant datacenter.

Learn how to use Quotas, Reservations, Roles and Weights with customer-inspired use-cases and example solutions.

Topics covered include how to run multiple instances (and versions) of frameworks like Spark, Cassandra, Kafka, Marathon, Jenkins, etc., all on the same Mesos Cluster while still ensuring that no single framework starves the other of resources.

Other use-cases include how to manage and prioritize the resources shared and consumed by Production, Staging and Development environments.

Speakers
VM

Vishnu Mohan

Solutions Architect, Mesosphere
Vishnu Mohan is a Solutions Architect at Mesosphere working closely with strategic customers in the field on Performance, Management and Automation initiatives. When he’s not analyzing sandbox logs or coding against some API for fun, he may be found rock climbing, hiking, running or scuba diving.



Wednesday June 1, 2016 4:20pm - 5:10pm
Chasm Creek
  • Host Organization Apple

4:20pm

A Seamless Monitoring System for Apache Mesos Clusters - Drew Gassaway, Bloomberg LP
Mesos and its distributed processing frameworks offer an easy way to migrate computation tasks to a machine-agnostic environment. To use the capabilities of Mesos to execute distributed tasks effectively a unified monitoring system is required. The monitoring system has to address the integration of disparate logging and metric facilities resulting from the heterogeneous tasks that can be executed on Mesos.

In this talk, we'll look at a framework that offers a way to ingest log, metric, and other data, and send it upstream. We'll go into detail about how the framework uses the dynamic Mesos state available on each slave to aggregate logs and metric data in a way that's transparent to running applications. It also provides a plugin-based component that can automatically ingest slave data such as detailed Mesos task resource usage statistics. We’ll also discuss the performance characteristics.

Speakers
DG

Drew Gassaway

Senior Software Developer, Bloomberg LP
Drew is a developer at Bloomberg on a team building an analytics platform for Bloomberg Vault.



Wednesday June 1, 2016 4:20pm - 5:10pm
Grand Mesa F

5:20pm

CI and CD at Scale: Scaling Jenkins with Docker and Apache Mesos - Carlos Sanchez, CloudBees
In this presentation Carlos Sanchez will share his experience running Jenkins at scale, using Docker and Apache Mesos to create one of the biggest (if not the biggest) Jenkins clusters to date.

By taking advantage of Apache Mesos, the Jenkins platform is dynamically scaled to run jobs across hundreds of Jenkins masters, on Docker containers distributed across the Mesos cluster. Jenkins slaves are dynamically created based on load, using the Jenkins Mesos and Docker plugins, running in containers distributed across multiple hosts, and isolating job execution.

This presentation will allow a better understanding of Apache Mesos and the challenges of running Docker containerized and distributed applications, particularly JVM ones, by sharing a real world use case, including good and bad decisions and how they affected the development.

Speakers
avatar for Carlos Sanchez

Carlos Sanchez

Software Engineer, CloudBees
Carlos Sanchez specializes in software automation, from build tools to Continuous Delivery, integrating technologies at multiple levels: Docker, micro services, Infrastructure-As-Code and even IoT. He has spoken at several conferences around the world, including ApacheCON, JavaOne, Fosdem,... Involved in Open Source for more than ten years, he is a member of the ASF amongst other open source groups, contributing to several projects, such as... Read More →



Wednesday June 1, 2016 5:20pm - 6:10pm
Grand Mesa DE

5:20pm

Spark on Apache Mesos: The State of the Art - Tim Chen, Mesosphere
Multi region global Data centers can be setup by using Mesos as the Kernel for all resource management. This presentation will cover one of the designs for federated mesos clusters to enable uniform data center resource orchestration across the globe. We will also compare and contrast various design approaches that has been considered for this project including some industry’s competitive models. The Model we propose is not only distributed by nature, it can also tolerate dynamic addition/deletions/modifications of masters in the federation. We will also explain how a framework can participate in such a design without having to change its core functionality.

A policy engine is integrated with this cluster federation model to control the nature of the scheduler. This federation work will not only handle the IaaS layer resource requirements but also extended to deal with PaaS layer application resources. So in the container world, Mesos can play a big role directly handling the applications which could avoid other PaaS resource schedulers by using custom frameworks. Various optimum schedulers can be pluggable to this model and health of the overall system is taken care by inter cluster communication in HA mode. Finally we will show a POC demo developed within our lab and probably the ongoing implementation details in our cloud.

Speakers
TC

Tim Chen

Distributed Systems Engineer, Mesosphere
Tim Chen is on the Mesosphere core team and focuses on containerization and big data frameworks. He is also a PMC/committer on Apache Drill and Apache Mesos, and contributed to other open source projects such as Spark, Kafka, Hive. Before joining Mesosphere, Tim past experiences includes working on data services on Halo, CloudFoundry (PaaS) and search engines.


Wednesday June 1, 2016 5:20pm - 6:10pm
Grand Mesa ABC

5:20pm

Building a Machine Learning Orchestration Framework on Apache Mesos - Antony Arokiasamy & Kedar Sadekar, Netflix
A scaleable and adaptable machine learning platform is essential for an organization to harness the full potential of their data. This talk outlines how Docker, Spark, Hadoop and several other building blocks can be integrated into a machine learning framework on Mesos. We will discuss how our Mesos framework leverages custom executors, framework/status messages and resource attributes to schedule tasks in a multi-tenant environment. A heterogeneous workload of Spark, Python, R & Scala tasks co-exist and run thousands of computations concurrently on an elastic Mesos cluster of hundreds of nodes. We will demonstrate how a simple user interface and a DSL allows researchers to design, test and deploy resilient machine learning pipelines.

Speakers
avatar for Antony Arokiasamy

Antony Arokiasamy

Senior Software Engineer, Netflix
Antony is currently an engineer on the Personalization Infrastructure team at Netflix. His primary focus is on building various big data infrastructure components around Spark and Mesos that help algorithmic engineers at Netflix to innovate faster and improve personalization for our members. In the past, he has built machine learning pipelines at Salesforce and AgileOne.
KS

Kedar Sadekar

Sr. Software Engineer, Netflix Inc
I am a Senior software engineer on the Personalization Infrastructure team at Netflix that builds scalable, distributed computing systems for the algorithmic engineers that help improve member personalization. | | Interested in speaking about ML infrastructure challenges and solutions. Also happy to talk about Meson: our general purpose workflow orchestration and scheduling framework that we built to manage ML pipelines that execute... Read More →



Wednesday June 1, 2016 5:20pm - 6:10pm
Chasm Creek

5:20pm

Container Network Interface (CNI) Support in Apache Mesos - Jie Yu & Avinash Sridharan, Mesosphere; Qian Zhang, IBM
Currently, despite the wide adoption of Mesos as the kernel for the data center, Mesos does not have a standardized interface to plug into different networks. Existing modules, such as the port mapping isolator or net-modules, are focused solutions that aim to make Mesos work on specific types of networks. In this talk Qian, Avinash and Jie will present the design and implementation of a new network isolator the network/cni isolator that implements the CNI (Container Network Interface) spec, proposed by CoreOS. The network/cni isolator will allow Mesos containers to work, potentially, on any type of IP network. CNI allows for a clean division of work, allowing Mesos to focus on network isolation and offloading network configuration to native binaries called CNI plugins. There are CNI plugins developed for different types of networks (e.g., bridge, flannel, calico, weave etc.) allowing Mesos to run containers on a multitude of different networks.

Speakers
AS

Avinash Sridharan

Senior Software Engineer, Mesosphere
Avinash Sridharan is a software engineer at Mesosphere. At Mesosphere, he has been focusing on improving and developing the networking stack within Mesos. Prior to Mesosphere Avinash has been working in the networking industry, designing and implementing software-based data-planes that can achieve near line rate forwarding. He holds a Ph.D in Electrical Engineering from the University of Southern California.
JY

Jie Yu

Senior Software Engineer, Mesosphere
Jie Yu is a Software Engineer at Mesosphere, Inc, focused on Mesos development. He has worked on several key components in Mesos including containerization, persistence primitives and replicated logs. Before joining Mesosphere, he was a software engineer at Twitter. Jie obtained his PhD in Computer Science and Engineering from the University of Michigan where he conducted research for concurrent and event-driven systems.
avatar for Qian Zhang

Qian Zhang

Software Architect, IBM China
Qian Zhang is a software architect in IBM China, he has more than 10 years working experiences on resource management / scheduling, cloud computing, virtualization / container technologies. Currently he is Apache Mesos committer and PMC member, his contributions covers allocator, containerizer, isolator, CNI support, OCI support and Mesos on Power.



Wednesday June 1, 2016 5:20pm - 6:10pm
Grand Mesa F

6:15pm

 
Thursday, June 2
 

7:30am

New Stack Pancake Breakfast

Come have a short stack with The New Stack, sponsored by Intel.

Pancakes and a podcast, carbs and conversation — how can you beat that?

Please note that this event can only accommodate 170 attendees. Please arrive early to secure your seat.

Thursday June 2, 2016 7:30am - 8:30am
Grand Mesa F

7:30am

9:00am

Keynote: Day 2 Welcome and Special Demo - Benjamin Hindman, Founder and Chief Architect, Mesosphere
Speakers
avatar for Ben Hindman

Ben Hindman

Founder and Chief Architect, Mesosphere
Benjamin Hindman is a Founder and Chief Architect at Mesosphere where he leads a team building out core services for the Mesosphere Data Center Operating System (DCOS). Ben co-created Apache Mesos as a PhD student at UC Berkeley before bringing it to Twitter where it now runs on tens of thousands of machines powering Twitter's datacenters. An academic at heart, his research in programming languages and distributed systems has been published in... Read More →


Thursday June 2, 2016 9:00am - 9:15am
Grand Mesa A-F

9:15am

Keynote: Spark 2.0 - Matei Zaharia, Apache Spark Creator and CTO of Databricks
Apache Spark is one of the most widely used systems for big data processing, and it has been integrated with Mesos from day one -- in fact, Spark started as an example framework running on the Mesos cluster manager. In this talk, I'll discuss where Spark fits in the data processing ecosystem, and some exciting additions coming out soon in Spark 2.0. In particular, unlike Apache Hadoop, Spark was designed to be a computing engine agnostic of storage systems, so that it can connect to a variety of systems beyond HDFS. This choice proved useful because most organizations use a mix of storage systems and want to run Spark on elastic infrastructure such as Mesos. Spark 2.0 will go further in this direction through support for new data sources, high-level APIs that can push key parts of the computation into the storage systems, and a new Structured Streaming API that provides similar optimizations for stream processing.

Speakers
avatar for Matei Zaharia

Matei Zaharia

Keynote: Spark 2.0 - Matei Zaharia, Apache Spark Creator and CTO, Databricks
Matei Zaharia is an assistant professor of computer science at MIT and CTO of Databricks, the company commercializing Apache Spark. He started the Spark project when he was a graduate student at UC Berkeley, and continues to serve as Spark’s vice president at Apache. Matei has also contributed to other open source cluster computing projects -- he is a co-creator of Mesos, and a committer on Apache Hadoop. He received the 2014 ACM Doctoral... Read More →



Thursday June 2, 2016 9:15am - 9:45am
Grand Mesa A-F

9:45am

Keynote: Bringing Mesos to the World - Florian Leibert, Founding CEO, Mesosphere
Apache Mesos has powered remarkable innovations inside some of the world’s biggest and smartest technology companies, but not everyone can follow in their footsteps. A more complete package is necessary if we’re going to bring the power of Mesos and all it enables to organizations of every type.
Join Mesosphere CEO Florian Leibert as he introduces DC/OS, an open source platform aimed to do just that. Special guests from Cisco, Time Warner Cable and Autodesk will explain how they’ve used DC/OS to transform their datacenters, take technologies such as containers into production, and rollout new applications in a fraction of the time it would have taken otherwise.

Speakers
avatar for Florian Leibert

Florian Leibert

Founding CEO, Mesosphere
Florian Leibert is the founding chief executive officer of the high tech software company Mesosphere. In this position he has partnered with a number of clients to establish effective, data-centric business cultures while also leading premiere open source initiatives such as Chronos. Prior to launching Mesosphere Florian Leibert, known also as Flo, spent time as a technical lead and software engineer for Twitter in San Francisco, California... Read More →


Thursday June 2, 2016 9:45am - 9:55am
Grand Mesa A-F

10:00am

Keynote: Platform Infrastructure at Twitter: The Past, Present and Future - Chris Pinkham, VP of Engineering, Twitter

Platform Engineering builds systems and libraries that enable engineers at Twitter to easily run and operate their services globally at massive scale. These include the core compute and storage infrastructure, search infrastructure, edge, monitoring and messaging platforms, data & analytics platform, and core application services. In recent years, Twitter Inc. has expanded its product portfolio through acquisitions like Periscope, Vine, MoPub, TellApart, Crashlytics, and GNIP of which many of them currently run on the public cloud. To enable deeper integration between products and address the larger business need, it is vital to extend the scope and presence of Twitter’s Platform Infrastructure.

Chris Pinkham, Vice President of Platform Engineering will share the current state of Twitter’s Platform Infrastructure, the challenges when operating at scale and his team’s vision for hybrid cloud services.

Speakers
avatar for Chris Pinkham

Chris Pinkham

Vice President of Engineering, Twitter
Chris leads Platform Engineering at Twitter where he is responsible for compute and storage platform, search infrastructure, data & analytics platform, communication infrastructure and other essential core application service teams. Before joining Twitter, Chris was Senior Vice President for Cloud Product Development at Oracle. He was previously a co-founder and CEO of Nimbula, a cloud software company acquired by Oracle. Earlier, he was a... Read More →


Thursday June 2, 2016 10:00am - 10:30am
Grand Mesa A-F

10:30am

Coffee Break and Sponsor Showcase
Thursday June 2, 2016 10:30am - 11:00am
Grand Mesa Foyer

11:00am

Quota - Reliable Guarantees - Jörg Schad & Joris Van Remoortere, Mesosphere
A problem when running multiple frameworks on Mesos is that if frameworks are not cooperative it might lead to a situations when certain frameworks hog all of the resources. Since version 0.27.0 Mesos provides an experimental mechanism to reserve a certain amount of resources in an entire cluster, i.e. not tied to a particular agent. Quota can be viewed as a cluster-wide dynamic reservation available for operators only.

In this talk Joris, Alex, and Jörg will first present an overview of the current state of Quota and the internal workflow of handling Quota request (which is especially helpful for understanding the implications, potential errors messages, and limitations). Then they will present a hands-on demo on how Quota can be configured from an operator's point of view. This talk will conclude with feedback and discussion of the future development of quota.

Speakers
JV

Joris Van Remoortere

Distributed System Engineer, Mesosphere
Joris Van Remoortere is an Apache Mesos committer at Mesosphere. Joris has been contributing to Mesos since 2014 and previously worked on low latency distributed graph databases. He studied Computing & Financial Management at the University of Waterloo.
JS

Jörg Schad

Distributed Systems Engineer, Mesosphere
Jörg Schad is a software engineer at Mesosphere in Hamburg where he works on the Apache Mesos project. Prior to this he worked on SAP Hana and in the Information Systems Group at Saarland University. His passions are distributed (database) systems, data analytics, and distributed algorithms.


Thursday June 2, 2016 11:00am - 11:50am
Grand Mesa ABC

11:00am

Building Frameworks with the New HTTP APIs - Vladimir Vivien, EMC {code}
Writing Mesos frameworks with the original framework API came with dependencies that made implementations of new client burdensome. If you have attempted to write a framework before the HTTP API you certainly ran into issues like the lack robust documentation, dependency on platform-dependent libmesos library, network communication issues between your cluster members.

Introduced in version 0.24.0, the new HTTP API solves these problems with a simpler HTTP-based protocol for communication between Mesos cluster members. The presentation explores how the HTTP API makes it possible to create robust frameworks using the HTTP library of your favorite language. The session will do a walkthrough of the HTTP endpoint requests to arrive at a fully functioning framework while addressing the implication of using pure JSON or the Protobuf for data encoding.

Speakers
avatar for Vladimir Vivien

Vladimir Vivien

Developer Advocate, EMC {code}
Vladimir Vivien is a Developer Advocate with EMC {code}, a group within EMC that focuses on promoting open source technologies. Vladimir enjoys contributing to open source software and using the Go programming language (as of late). He created an early pure Mesos binding API for Go called Gomes. Prior to EMC {code} Vladimir worked as a Solutions Architect with Pivotal Software’s distributed data products.



Thursday June 2, 2016 11:00am - 11:50am
Chasm Creek

11:00am

No One Puts Java in the Container - Ken Sipe, Mesosphere
Whether it is Docker or the Mesos Container running with Apache Mesos means running in a container, but do you really understand cgroups and how they work? Do you understand the difference between CPU Sets and CPU Shares? Many organizations use Java for their application development, but do you understand the consequence of what impact the cgroup constraints have on the JRE?

This talk starts with a look at the anatomy of a container including control groups (cgroups) and namespaces. Then we will take a deep understand of Java's memory management and GC characteristics and how JRE characteristics change based on core count. The session will detail specifically the difference between CPU sets and CPU shares and memory management. The session will close with a deep understanding of the consequences of running the JRE in a CPU share environment and the potential for pseudo-random behavior of running in a heterogeneous datacenter.

Speakers
avatar for Ken Sipe

Ken Sipe

Distributed Applications Engineer, Mesosphere
Ken Sipe is a Cloud Solution Architect and Distributed Systems Engineer at Mesosphere, focused on helping companies simplify the development and operation of large scale infrastructure and distributed systems with Apache Mesos and DC/OS. Ken is a JavaOne Rockstar, an author and an accomplished international speaker on the practices of software architecture and engineering, continuous delivery and agile practices. Ken is an Apache Mesos... Read More →


Thursday June 2, 2016 11:00am - 11:50am
Grand Mesa DE

11:00am

It’s Complicated, Okay (or Let’s Talk Openly about Apache Mesos’ OSS Neighbors, Friends and Rivals) - Aaron Williams, Mesosphere
Mesos is never the only OSS you need to run your production datacenter. And just like all of us hanging out together at MesosCon, if you surround Mesos with its OSS friends, you get a happy, highly productive Mesos. But you have to be careful, not all OSS plays well with others.

In this talk, we’ll start by looking at a handful of production Mesos datacenters from major users. We’ll use these real-world examples to abstract a standard Mesos datacenter architecture that contains all of the components needed to run today’s modern, containerized apps with big data and analytics frameworks.

With that harmonized Mesos datacenter architecture, we’ll look at each of the abstract components and discuss the leading OSS projects that fit each piece. We’ll discuss the characteristics of what makes some solutions work well with Mesos, and call out the projects that don’t meet the standard.

We’ll wrap up the talk by showing the complete architecture diagram, and show the single- command trick for bringing all of the best OSS components together and getting them up and running in a production cluster.

Speakers
avatar for Aaron Williams

Aaron Williams

VP Global Community, Mesosphere
Aaron Williams is VP, Global Community at Mesosphere, where he’s responsible for driving adoption of the Datacenter Operating System (DC/OS) with developers, and managing the open source project and community. Aaron also represents Mesosphere and the DC/OS community on the CNCF Governing Board. Prior to Mesosphere, Aaron spent 5 years running the Java Community Process at Sun Microsystems, and another 5 years as VP of ecosystem programs at SAP... Read More →


Thursday June 2, 2016 11:00am - 11:50am
Grand Mesa F

12:00pm

GPU Support in Apache Mesos - Kevin Klues, Mesosphere
GPUs are the tool of choice for accelerating the data mining, machine learning and deep learning algorithms abundant in today's data-driven computing industry. These algorithms help solve problems ranging from weather forecasting to face and speech recognition to helping find a cure for cancer. In spite of this, Mesos has traditionally not supported GPUs as an allocatable resource. As such, many users have resorted to having a separate GPU cluster to run these algorithms outside of their primary Mesos installation. Fine-grained sharing of resources between these clusters has not been possible.

By adding first class support for GPUs in Mesos, developers are finally able to leverage the power of the GPU in the same shared cluster as all of their other workloads. This talk covers the details of how we added GPU support to Mesos as well as how developers and operators can now leverage this new capability.

Speakers
avatar for Kevin Klues

Kevin Klues

Senior Software Engineer, Mesosphere
Kevin Klues is a Senior Software Engineer at Mesosphere working on the Mesos core team. Prior to joining Mesosphere, he worked at Google on an experimental operating system for data centers called Akaros. He and a few others founded the Akaros project while working on their Ph.Ds at UC Berkeley. In a past life Kevin was a lead developer of the TinyOS project, working at Stanford, the Technical University of Berlin, and the CSIRO in Australia... Read More →



Thursday June 2, 2016 12:00pm - 12:50pm
Grand Mesa ABC

12:00pm

Maintenance: Automating Collaboration Between Frameworks and Operators - Joseph Wu, Mesosphere
Mesos is great at allocating cluster resources for schedulers. However, there is no way to downsize your cluster, short of pulling the plug on machines! How do you defragment or roll a kernel upgrade through your cluster? Most importantly, how do you do so without violating any frameworks’ SLAs?

This talk will introduce Inverse Offers and present different use cases for them. Maintenance Primitives, a feature implemented using Inverse Offers will be used as an example to present the requirements and challenges of cooperatively deallocating resources from a running cluster.

Guidelines, strategies, and trade-offs with respect to Inverse Offers and Maintenance Primitives for framework writers as well as cluster operators will be presented.

Speakers
JW

Joseph Wu

Distributed Systems Engineer, Mesosphere
Joseph Wu is a software engineer at Mesosphere. Joseph has been contributing to Mesos since mid-2015 and has worked on features like Maintenance Primitives and the Container Logger module. Joseph studied Computer Engineering & Biochemistry at the University of Washington, Seattle.


Thursday June 2, 2016 12:00pm - 12:50pm
Chasm Creek

12:00pm

Autoscaling Microservices with Apache Mesos and Marathon - David Arnold, Tendril
Mesos provides the ability to harness the resources of a compute cluster, and provides detailed insights into those compute resources. This made Mesos a great fit at Tendril for their microservices architecture that powers their Energy Services Management platform. The challenge arose as to how to best leverage Mesos to dynamically scale individual services based on workload. David Arnold will cover how Tendril created an autoscaling solution with Mesos and the Marathon framework running on Amazon Web Services.

Speakers
DA

David Arnold

Manager - Site Reliability Engineering, Tendril
David Arnold is the manager of site reliability engineering at Tendril, a leading provider of Energy Services Management. Over past 15 years he has worked with a diverse set of companies spanning from startups to fortune 500s focusing on the implementation of cross-functional and collaborative complex systems and solutions.


Thursday June 2, 2016 12:00pm - 12:50pm
Grand Mesa DE

12:00pm

How We Built a Chargeback System for Twitter’s Compute Platform (Mesos/Aurora) That Incentives Higher Resource Utilization - Micheal Benedict & Jeyappragash Jeyakeerthi, Twitter
Twitter’s compute platform manages hundreds and thousands of containers across tens and thousands of hosts. At that scale, problems we have observed are:
1. Containers are not often sized appropriately in a way to utilize underlying hardware resources efficiently
2. Lack of visibility into who owns what containers (and services)
3. Identifying and tracking the utilization of resources by individual containers to the org structure

We built a Chargeback system for Mesos that provides visibility into who owns what and how much resources they use. It also generates a "bill" based on usage data. The goal here is to incentivize users of Mesos through visibility into what they use & effectively right size their containers to use the underlying resources in a cost-effective way. In this talk, we describe how we built the chargeback service that
1. Ingests utilization and quota data from Mesos master & container stats
2. process around figuring out resources to charge on (ex, cpu cores used per day)
3. ownership mapping i.e how we built a identity service that ties ldap roles with organizational teams (takes a more project/team centric view)

Towards the end of the talk, we will share a case study of how chargeback at Twitter helped improve resource utilization (cores in this case) by over 30% and save millions in $ prior to implementing something like Chargeback.

Speakers
avatar for Micheal Benedict

Micheal Benedict

Product Manager, Twitter
Micheal Benedict leads Product Management for Twitter's Cloud Platform. He and his team are building the next generation compute infrastructure that spans private and public clouds. Previously, he was a Software Engineer at Twitter building Observability. Before joining Twitter, Micheal was a Research Assistant at University at Buffalo’s Blue Labs and built PhoneLab: World’s Largest Smartphone Experimentation Test Bed. Micheal has a M.S in... Read More →
avatar for Jeyappragash Jeyakeerthi

Jeyappragash Jeyakeerthi

Engineering Manager, Twitter
Jeyappragash leads Twitter’s Cloud Infrastructure Management Platform. This hybrid cloud platform helps developers manage and launch their services providing detailed visibility about resource usage and for infrastructure owners, to offer their infrastructure or platform as a true multi-tenant offering. Previously he worked as a Distinguished Engineer at Motorola, leading efforts to build their Notification Infrastructure, their Software... Read More →


Thursday June 2, 2016 12:00pm - 12:50pm
Grand Mesa F

12:50pm

Lunch and Sponsor Showcase
Thursday June 2, 2016 12:50pm - 2:00pm
Grand Mesa Foyer

2:00pm

Resource Allocation in Apache Mesos: Present and Future - Benjamin Mahler, Mesosphere
Mesos provides a flexible “two-level” scheduling approach to cluster management: Mesos is responsible for allocation of resources to application-specific framework schedulers, and framework schedulers decide how best to use the resources available to them. We’ll explore why an architectural separation between resource management and scheduling has contributed to the widespread adoption of Mesos in the open source community. Next, we’ll specifically focus on resource allocation in Mesos, looking to understand the model, the present state of affairs, and the future directions that will be taken.

Speakers
BM

Benjamin Mahler

Senior Software Engineer, Mesosphere
Benjamin Mahler is a Software Engineer at Mesosphere. Previously, he worked on Mesos at Twitter on some of the largest Mesos deployments in the world. Benjamin is a committer and PMC member of the Mesos project. He studied Software Engineering at the University of Waterloo and is passionate about software craftsmanship and sustainability.



Thursday June 2, 2016 2:00pm - 2:50pm
Grand Mesa ABC

2:00pm

Integrating Storage and Apache Mesos: Anatomy of a Framework - Jörg Schad, Mesosphere & Björn Kolbeck, Quobyte
Mesos has been traditionally great at supporting stateless services , but most complex services actually require some form of scalable persistence.
This combination of container scheduling and software defined storage are enabling a new kind of data center that is well beyond the current enterprise IT for both new and legacy applications.

In this talk we present at the the challenge of deploying and operating a software storage system with and for Mesos from two sides.
First from an operator/user perspective: How can I deploy distributed storage frameworks on top of Mesos and utilize it from other services? What are current options for distributed storage inside Mesos.
Next from a framework perspective: What does the software storage need from Mesos and the container environment? How can the file systems be backed by containers? What Mesos feature would be required for even better support in the future.

Speakers
avatar for Björn Kolbeck

Björn Kolbeck

Founder, Quobyte
JS

Jörg Schad

Distributed Systems Engineer, Mesosphere
Jörg Schad is a software engineer at Mesosphere in Hamburg where he works on the Apache Mesos project. Prior to this he worked on SAP Hana and in the Information Systems Group at Saarland University. His passions are distributed (database) systems, data analytics, and distributed algorithms.


Thursday June 2, 2016 2:00pm - 2:50pm
Chasm Creek

2:00pm

Monitoring Microservices: Docker, Mesos and DCOS Visibility at Scale - Loris Degioanni, Sysdig
Everyone knows how microservices and containers are revolutionizing the way we deploy applications and maintain our infrastructure. But as many teams are starting to find out, containers still have a key challenge: monitoring and troubleshooting them can be impractical, painful, and sometimes plain impossible. With the rise of microservice based architectures and container orchestration tools such as Mesos and DCOS managing difficult task has become a little bit easier - if you take the right approach.

In this demo-driven presentation, Loris Degioanni will cover the current state of the art of container and microservice monitoring, including the pros and cons of some popular approaches. Using real tools running in live environments, he will demonstrate how to effectively monitor, explore and troubleshoot highly scaled Mesos deployments.

The presentation will feature live interaction with container environments and live demos of all tools and techniques discussed. Special emphasis will be put on using the Mesos portfolio of scheduling and management tools as well as sysdig, an open source container and system troubleshooting tool developed by the presenter.

GitHub link: https://github.com/draios/sysdig

Specific topics will include:
* visualizing the physical vs logical architecture of Mesos & DCOS deployments
* understanding performance at the holistic microservice/application level for orchestrated systems
* Leveraging Mesos metadata such as Master, Slave, Marathon and labels for more intelligent troubleshooting
* extracting process and application-level performance metrics from inside containers using non-intrusive methods
* troubleshooting detailed network activity among distributed containers

Speakers
LD

Loris Degioanni

Founder, Sysdig
Loris Degioanni is the CEO and founder of Sysdig. He is the creator of the popular open source troubleshooting tool sysdig, and the open source container security tool Falco. Prior to founding Sysdig, Loris co-created Wireshark, the open source network analyzer, which today has 20+ million users. Loris holds a PhD in computer engineering from Politecnico di Torino and lives in Davis, California.


Thursday June 2, 2016 2:00pm - 2:50pm
Grand Mesa DE

2:00pm

Apache Mesos Ecosystem at Allegro - First Year of Production Use - Tomasz Ziarko and Wojciech Lesicki, Allegro
We would like to show what we are doing with mesos at Allegro. Allegro is the largest retail and auction site in Poland. Mesos is our main production system (right now one thousand CPUs big) for deploying microservices. During the presentation we are going to share our experience from around 1 year of setting automation of entire clusters that integrate with our cloud ecosystem. The stack we are going to talk about is based on: Zookeeper, Terraform, Marathon, Puppet, OpenStack, Nginx, Graphite, Grafana and many more. We would like to show how these tools are used in our daily workflow to cope with our developers needs. There will be a few points about size and problems encountered along the road and some major achievements in operating Mesos in production at scale in Allegro. We are going to show a demo of our production environment to picture our daily workflow with mesos environment. 

Speakers
WL

Wojciech Lesicki

Grupa Allegro Sp. z o.o., Product Manager
TZ

Tomasz Ziarko

Allegro Group


Thursday June 2, 2016 2:00pm - 2:50pm
Grand Mesa F

3:00pm

Yammer Datacenter Story - On-Premise, GFS, Azure - Tobias Haag, Microsoft; Kyle Gordon, Yammer / Microsoft
All things Docker seem to be the defining slogan for Yammer these days. And what other way to run Docker at scale than Mesos?
Yammer wrote an in-house datacenter automation platform which was fraught with problems and restrictions the Mesos landscape promised to solve, and in 2015 engineers at Yammer started exploring it as a possible replacement.
This talk will focus on two core points of the implementation run at Yammer: Docker & Security
Everything has to run inside Docker. From Zookeeper to the Mesos agents and even the executors. Dedication, mixed with some despair, eventually resulted in the platform for production today.

Security is the second biggest piece to honor the commitment made to Yammer customers as part of the Office365 suite. The path to provide a good solution to security aspects like compartmentalization, trust bootstrap, access control and transport encryption proved a balancing act between customer commitment and developer friendliness.

In the end Mesos helped us deliver Docker's promise of Build, Ship, Run as the foundation of environments Yammer can trust to run from Dev all the way to Production at scale and anywhere on the planet.

Speakers
avatar for Kyle Gordon

Kyle Gordon

Software Engineer 2, Yammer / Microsoft
I have been an engineer on the operations team for Yammer for almost 3 years. Currently I am in the process of creating a stable environment to migrate Yammer to Azure. We are primarily a micro service company and are an ideal fit to live on a mesos architectured environment. We’ve just completed the initial buildout and have successfully migrated a few of our services. I am a first time speaker.
avatar for Tobias Haag

Tobias Haag

Senior Software Engineer, Microsoft
4 years at Yammer from Junior to Senior Software Engineer at Yammer / Microsoft. Since late 2013 part of the Infrastructure team with focus on Datacenter automation and software lifecycle support. As of mid 2015 leading developer on Azure migration effort with focus on Docker and Mesos.



Thursday June 2, 2016 3:00pm - 3:50pm
Grand Mesa ABC

3:00pm

A Declarative Approach to Building Stateful Frameworks - Gabriel Hartman, Mesosphere
Framework authors attempting to write frameworks which encapsulate or administer stateful services often encounter difficulties mapping the resource offer stream provided by Mesos to the framework’s provisioning, maintenance and upgrade goals. For disparate frameworks: Cassandra, Kafka, HDFS we have adopted a declarative approach to address this mapping problem. This approach has also been applied successfully to different layers of the framework lifecycle. In particular, we have applied a declarative approach to the fault-tolerant fulfillment of reservation and persistent volume requirements, and to the overall maintenance and upgrade of frameworks.

Speakers
GH

Gabriel Hartman

Technical Lead, Mesosphere
Gabriel is a distributed applications engineer at Mesosphere where he works on new implementations of the stateful frameworks: Kafka, Cassandra and HDFS frameworks. Before Mesosphere he worked at Microsoft working on the high availability team developing the second generation of SQL Azure. In an academic setting, he pursued monocular computer vision research in the context of driver assistance systems.


Thursday June 2, 2016 3:00pm - 3:50pm
Chasm Creek

3:00pm

The Architecture of Mantl - Steven Borrelli, Asteris, LLC
Mesos is a core component of the Mantl project (Mantl.io), an open-source platform that makes it easy to deploy containerized workloads and streaming data applications.

Mantl integrates Mesos with a number of tools to provide security, high availability, service discovery, health checks, and load-balancing. It deploys to most cloud providers in minutes.

This talk will discuss the architecture and engineering of Mantl, from using Terraform to orchestrate multi-cloud deployments, Mesos-Consul for service discovery, load-balancing via Traefik, Mantl-api for launching frameworks, and Calico for Overlay networking.

Speakers
SB

Steven Borrelli

CEO & Founder, Asteris, LLC
Steven Borrelli is the founder of Asteris, located in St. Louis, Missouri. He’s the lead architect and a core committer for the Mantl.io project.


Thursday June 2, 2016 3:00pm - 3:50pm
Grand Mesa DE

3:00pm

How to Stand Up a 600 Node Bare Metal Mesos Cluster in Two Weeks - Craig Neth, Verizon Labs
In this talk, Craig Neth (Distinguished Member of Technical Staff at Verizon) will describe his experiences in bringing up a 600 node Mesos cluster - from power on to running tasks in 14 days. He will describe the Open Source Hardware and Software he used, as well as the processes and methodology how all these components were used to automate and streamline the process. Neth will also talk about some of the challenges he faced and the improvements he’s hoping to see in the future.

Speakers
avatar for Craig Neth

Craig Neth

Distinguished Member of Technical Staff, Verizon Labs
Craig Neth is an Architect and Software Developer at Verizon Labs who also likes to play with hardware. Over the course of his career, he’s done a little of everything, from building device drivers for mobile platforms to helping build Operating systems, Compilers, and Development tools. He has previously presented at DECUS and other technical forums, both internal and external.



Thursday June 2, 2016 3:00pm - 3:50pm
Grand Mesa F

3:50pm

Coffee Break and Sponsor Showcase
Thursday June 2, 2016 3:50pm - 4:20pm
Grand Mesa Foyer

4:20pm

Self-Healing Systems on Elastic Mesos in the Cloud - Mike Sells, Oracle Data Cloud
The Oracle Data Cloud is processing billions of events and multiple terabytes of data per day in real-time. In this presentation Mike Sells will discuss the motivation, design, and implementation of an elastic Mesos platform to handle the needs of their real-time systems. They will discuss how to think about the elasticity of applications inside of Mesos as well as Mesos itself with details on how to implement both. Why scaling down, not up, is the biggest challenge. They will explain how they built a high volume low latency web tier and a Spark streaming data pipeline on top of the same self-healing platform. How building this multi-tenant system on top of Mesos can maximize resource utilization as well as productivity while automatically adjusting to the demands of traffic and self healing on failures. This includes how they test and validate that elasticity does not impact data integrity. And will conclude by demonstrating the real-time production system, creating live failures, and showing its ability to self heal and auto correct.

Speakers
avatar for Mike Sells

Mike Sells

Director, Software Development, Oracle Data Cloud
Mike Sells is Director of Software Development at the Oracle Data Cloud. He leads a team building out highly scalable and fault tolerant systems on top of Mesos and Spark that power their audience targeting and data ingestion platforms. He’s been working on a variety of distributed systems including Spark, Cassandra and MapReduce since 2011.



Thursday June 2, 2016 4:20pm - 5:10pm
Grand Mesa ABC

4:20pm

Lessons Learned from Running Heterogeneous Workload on Apache Mesos - Imran Shaikh, Yellow Pages
Mesos is by far the best orchestration system available out there for running containers. At YP, when we started using Mesos couple of years ago, we were overwhelmed with the robustness it provided. We quickly started on-boarding some of the apps. We soon were faced with multiple request from various developers to on-board their apps onto Mesos. These apps ranged from infrastructure tools to highly critical billing systems, from traditional java to web based apps, from map reduce jobs to batch processing jobs, from one off cron jobs to build pipeline jobs. These apps were written in Java, Go Lang, Node.js, Ruby/Rails, C, Scala as well as Python. And their configuration came from git repo, key value store, pom files or some static files managed somehow. We were made to provide a unified platform that served the use-cases for all of them or at least come up with the processes that everyone can use.

Initially, we relied heavily on the out of the box features that Mesos provided. But that wasn’t enough to support these myriad range of apps. For eg: redirecting all logs to STDOUT/STDERR wasn’t enough or possible for some of these apps. Managing app secrets was very insecure and exposed via ENV variables in Marathon. Also, managing app configs for various environment was tedious. We wanted to achieve persistence and fault tolerance with block devices to run databases through Mesos. There was no easy way to troubleshoot running processes in production. There was a need to manage multiple similar frameworks within the same Mesos cluster. And the list goes on and on.

We, at YP, having been exposed to this madness. While doing so, we have picked up valuable information along the way. We may not have solved all the issues, but we have made significant strides to resolve them.

Speakers
avatar for Imran Shaikh

Imran Shaikh

Lead/Architect, YP
Imran is a Lead/Architect working at YP. He is a proven technical leader with an industry experience of 13+ years working with Fortune 500 companies. He has worked extensively developing, architecting and managing cloud and distributed computing technologies at YP and Yahoo. He has substantial experience running a globally distributed production environment on thousands of systems running hundreds of application in a complex, fast moving and... Read More →



Thursday June 2, 2016 4:20pm - 5:10pm
Grand Mesa DE

4:20pm

Migrating 200+ Load Balancers into Apache Mesos - Stephen Salinas, HubSpot
It’s no secret that web services gain enhanced reliability and operational simplicity by running in Mesos. HubSpot wanted to achieve these same benefits for a much more static piece of infrastructure, our load balancers. This talk will explore HubSpot’s open source solution for keeping load balancers reliably reachable and up to date while running them inside a Mesos cluster, and the lessons learned from moving a normally static piece of infrastructure into a dynamic Mesos environment.

Speakers
avatar for Stephen Salinas

Stephen Salinas

Senior Software Engineer, HubSpot
Stephen is a Senior Software Engineer on the Platform as a Service team at HubSpot and a contributor to the Singularity mesos framework. He focuses on supporting load balancers and docker usage at HubSpot and has previously spoken at Container Days Boston.



Thursday June 2, 2016 4:20pm - 5:10pm
Chasm Creek

4:20pm

Marathon Meets External Storage - Steven Wong, EMC(code); Jörg Schad & Matthias Eichstedt, Mesosphere
Many people are running stateless containers on top of Mesos, but most complex services actually require some form of storage. On the other hand many enterprise have made large investments into Network Attached Storage and Storage Area Networks, and still continue to do so.

This talks aims to both worlds and show how external volumes can be efficiently used together with containerized applications. We will first discuss the challenges of creating so called external volumes and how to share them between different containers. Then we will discuss a number of practical use cases for external volumes such as running legacy database applications on top of Mesos.

We will conclude with a demo of how we combine Marathon and external volumes created on AWS EBS.

Speakers
avatar for Matthias Eichstedt

Matthias Eichstedt

Distributed Applications Engineer, Mesosphere
Matthias Eichstedt is a software engineer at Mesosphere in Hamburg where he works on Mesosphere’s Marathon and Metronome projects. He previously worked as a software engineer in various industries and seeks elegance and simplicity in everything he codes.
JS

Jörg Schad

Distributed Systems Engineer, Mesosphere
Jörg Schad is a software engineer at Mesosphere in Hamburg where he works on the Apache Mesos project. Prior to this he worked on SAP Hana and in the Information Systems Group at Saarland University. His passions are distributed (database) systems, data analytics, and distributed algorithms.
SW

Steven Wong

Developer Advocate, EMC
Steve Wong is a Developer Advocate with EMC{code}, a group within EMC focused on contributions to community open source projects. He is a principal contributor to the Mesos DVDI isolator project, which enables use of external storage volume mounts with containerized applications running under Mesos. He previously worked as an architect and developer on vSphere and various EMC storage products. Steve has been a speaker at VMworld and local tech... Read More →



Thursday June 2, 2016 4:20pm - 5:10pm
Grand Mesa F

5:20pm

Finagle, linkerd, and Apache Mesos: Magical Operability Sprinkles for Microservices - Oliver Gould, Buoyant
Finagle and Mesos are two core technologies used by Twitter and many other companies to scale application infrastructure to high traffic workloads. In this talk, we describe how these two technologies work together to form applications that are both highly scalable and resilient to failure. We introduce linkerd, an open-source proxy form of Finagle, which extends Finagle's operational model to non-JVM or polyglot microservices. Finally, we show how linkerd can be used to "wrap" applications running on Mesos to provide higher-level, service-based semantics around scalability, reliability, and fault-tolerance for microservices---even in the presence of unpredictable traffic volumes and unreliable hardware.

Speakers
avatar for Oliver Gould

Oliver Gould

CTO, Buoyant
Oliver is the CTO of Buoyant, where he leads open source development efforts. Prior to joining Buoyant, he was a staff infrastructure engineer at Twitter, where he was the technical lead of Observability, Traffic, and Configuration & Coordination teams, and helped the company migrate from a monolithic Rails application to a massively distributed microservice application running on Mesos. He is the creator of linkerd and a core contributor to... Read More →


Thursday June 2, 2016 5:20pm - 6:10pm
Chasm Creek

5:20pm

Persistence Primitives in Action 2.0 - Max Neunhöffer, ArangoDB; Jörg Schad & Neil Conway, Mesosphere
Mesos 0.23.0 introduced the first version of persistence primitives supporting stateful frameworks. Since then framework developer have started using persistence primitives and based on their feedback Mesos has introduced a number of additions and improvements for persistence primitives. These features included for example admin endpoints for better maintainability of reservation labels enabling frameworks to distinguish multiple reservations.
We will give an overview of the existing persistence primitives including the new features and then with the example of the ArangoDB Mesos framework discuss the practical challenges when implementing and using persistence primitives.

Speakers
NC

Neil Conway

Distributed Systems Engineer​, Mesosphere
Neil Conway is a Distributed Systems Engineer at Mesosphere, where he works on the Apache Mesos project. Before Mesosphere, Neil built automated trading systems at a quantitative hedge fund, completed a PhD in distributed systems at UC Berkeley, was a principal engineer at a stream processing startup, and was a committer and major developer of the PostgreSQL relational database system
avatar for Max Neunhöffer

Max Neunhöffer

Database Developer, ArangoDB
Max Neunhöffer is a mathematician turned database developer. In his academic career he has worked for 16 years on the development and implementation of new algorithms in computer algebra. During this time he has juggled a lot with mathematical big data like group orbits containing trillions of points. Recently he has returned from St Andrews to Germany, has shifted his focus to NoSQL databases, and now helps to develop ArangoDB. He has spoken at... Read More →
JS

Jörg Schad

Distributed Systems Engineer, Mesosphere
Jörg Schad is a software engineer at Mesosphere in Hamburg where he works on the Apache Mesos project. Prior to this he worked on SAP Hana and in the Information Systems Group at Saarland University. His passions are distributed (database) systems, data analytics, and distributed algorithms.


Thursday June 2, 2016 5:20pm - 6:10pm
Grand Mesa ABC

5:20pm

All Marathons Need a Runner. Introducing Pheidippides - James Humphrey & John Dennison, Activision Publishing
All Marathons need a runner. Introducing Pheidippides (John Dennison & James Humphrey, Activision Publishing, Inc). With Docker microservices taking the world by storm, John and James cover the challenges with the transition, approach, and their solution to this problem. Introducing a new service named Pheidippides (the apocryphal runner of the first marathon), built to help deploy, configure, and manage services within the Mesos, Marathon, and Chronos ecosystem.

Speakers
JD

John Dennison

Data Scientist, Activision Publishing, Inc
John Dennison is a Data Scientist at Activision with a background in applied analytics and software engineering. John delivers analytics solutions to help improve player experience and game design. Before joining Activision, John | worked with analytics startups in the healthcare and energy sectors and loves seeing the effect data can have on improving products and user experience. John has presented at multiple meetups and also at the Game... Read More →
avatar for James Humphrey

James Humphrey

Senior Game Analytics Engineer, Activision Publishing, Inc
James Humphrey is a Senior Software Engineer at Activision with a background in enterprise Java and software architecture. James is part of a team that builds data pipelines to support the integration of analytics within the games they create. Before joining Activision, James worked in large scale enterprise systems in the media and web conferencing space. This will be James’ first conference presentation.



Thursday June 2, 2016 5:20pm - 6:10pm
Grand Mesa DE

5:20pm

Workload Co-Location Has Just Begun: Sub-Millisecond Quality of Service at Scale - Maciej Patelczyk & Murali Sundar, Intel
Today, Apache Mesos enables operators and developers of modern distributed systems to treat machines like abstract resources in number of cores and gigabytes of memory. However, with abstractions comes simplifications and assumptions. Modern servers exhibit very different performance behavior based on the workload configuration and the its use of shared resources like last-level cpu caches, memory, network and I/O bandwidth. This becomes an unavoidable aspect when operators are tasked with running latency critical systems while maintaining high utilization **and** not violating service level objectives. In this talk, we will address how to maintain ease of use for operators and developers through Apache Mesos abstractions **and** make the best use of the hardware platform in operating system and hardware controls and monitoring to ensure quality of service of business critical jobs.

Speakers
avatar for Maciej Patelczyk

Maciej Patelczyk

Software Engineer, Intel
avatar for Murali Sundar

Murali Sundar

Sr. Principal Engineer / Software Defined Infrastructure Group, Intel
I work in the Software Defined Infrastructure Group (SDIG) at Intel, where I specialize in creating tools and technologies that allow small and large cloud operators and services providers to run their datacenters more efficiently. I am interested in workload scheduling, metrics gathering, datacenter management, and new computing/programming models such as event driven computing at a datacenter level. In the past I've worked on desktop video... Read More →



Thursday June 2, 2016 5:20pm - 6:10pm
Grand Mesa F

7:00pm

Offsite Attendee Reception - Viewhouse Centennial

Join fellow attendees for an evening event with a view! ViewHouse is a local chef-driven, casual eatery, bar & rooftop that will provide a great atmosphere to wrap up the event. Get ready for good food, lawn games, and conversation.

Transportation will be provided.



Thursday June 2, 2016 7:00pm - 9:30pm
ViewHouse Centennial 7101 South Clinton Street Centennial, CO 80112
 
Friday, June 3
 

9:00am

Hackathon - Sponsored by Cisco

Join other members of the Apache Mesos community, in partnership with Hackathon Sponsor Cisco, for a day of hacking.

Content details (including contest and prize information!) will be provided soon.

If you are interested in attending, please add the Hackathon option to your registration.


Friday June 3, 2016 9:00am - 3:00pm
Mesa Verde (lower level)