Loading…
OpenStack Summit May 2015 Vancouver has ended
Back To Schedule
Thursday, May 21 • 9:00am - 9:40am
Big Data Analytics and Docker: The Thrilla in Manila

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Docker containers are an ideal platform for the Big Data analytics use case because of their unique security and performance advantages.  Big Data work loads typically use distributed file systems to provide shared access to both input and output data sets. OpenStack Manila is an excellent way to manage distributed file systems in the Cloud environment. Applications like Spark and Hadoop add the analytics engine to complete the picture.

 

In this talk, we describe how we use Manila, Nova-docker and our distributed file system to allow Big Data clients in OpenStack, distributed across various compute nodes, to access large amounts of data in a shared, load-balanced and multi-tenant fashion.  We will discuss our experience deploying this cloud service, in use today by a collection universities, and provide a brief demo.
Speakers
avatar for Nilesh Bhosale

Nilesh Bhosale

Advisory Software Engineer, IBM
Nilesh Bhosale is a working as a member of IBM Storage & SDS CTO office, closely working with IBM's Spectrum Scale (a.k.a. General Parallel File System) team.  He is responsible for the integration of OpenStack with GPFS and has been actively contributing to OpenStack Cinder, Manila... Read More →
avatar for Dean Hildebrand

Dean Hildebrand

Research Staff Member - IBM Research, IBM Research - Almaden
Dean Hildebrand is a researcher at the IBM Almaden Research Center and a recognized expert in the field of object storage as well as distributed and parallel file systems. Dr. Hildebrand pioneered pNFS, demonstrating the feasibility of providing standard and scalable access to any... Read More →
avatar for Michael Hines

Michael Hines

Research Staff Member, IBM
I enjoy creating and analyzing experimental systems software and networks. Particularly when the application (usually) does not know where its resources are coming from. Sometimes that involves manipulating the OS. Sometimes writing a network protocol. Or it may, perhaps, require... Read More →
avatar for Bill Owen

Bill Owen

Senior Software Engineer - IBM, IBM
Bill Owen is Senior Software Engineer with IBM's General Parallel File System team.  He is responsible for the integration of OpenStack with GPFS.  He has worked in various development roles within IBM for the past 15 years.  Prior to joining IBM, Bill developed and deployed grid... Read More →

Thursday May 21, 2015 9:00am - 9:40am PDT
Room 109
  Storage

Attendees (0)