Amalgamating Manila and Swift for

Transcription

1 Amalgamating Manila and Swift for Unified Data Sharing Across Instances Bill Owen Sandeep Patil Gaurang Tapase Simon Lorenz Brian Nelson Sr Software Engineer STSM Software Engineer Software Engineer

2 Problem

3 Problem Scenario Media Production House or Professional Sports Team 1. Employees collects videos and upload to a central object storage system 2. Employees edit videos using sophisticated image editing software. This software requires file access to these images 3. Each employee has access to data in dedicated container from object interface. 4. Same access credentials are used to access data from file interface 5. Requirement for multi-tenant support to segregate clients 6. Must be able to easily scale up compute based on priority and schedule of projects Ingest data from Object interface, analyze data from file interface

4 Solution

5 Agenda 1. Solution architecture to address these and similar use cases 2. Demo of sample deployment 3. Challenges to overcome to realize this architecture

6 Components of the solution OpenStack Swift is the highly available, distributed object storage system used for uploading unstructured data SwiftonFile diskfile backend implementation for Swift enables object data to be accessed as files OpenStack Manila is the file share service used to share file data across VM instances. Multi-tenancy in Manila can help share data securely across tenants Shared Filesystem backend for both Swift and Manila enables common data access OpenStack Keystone, an authentication service coupled with AD/LDAP as common authentication backend enforce authentication and data access authorization OpenStack Nova, Cinder, Glance etc. for creation of virtual machines used for creating VM farm which will be used to analyze data Object Data Swift (with SwiftonFile) OpenStack Cloud AD/LDAP Shared Data Shared Filesystem VM Instances Nova Cinder Glance Manila shares over object data Manila (File Share)

7 OpenStack Swift Highly scalable, enterprise class OpenStack Object storage Rich and growing feature set Extensible: custom middleware pluggable backend: diskfile Swift and Amazon S3 protocol support

8 But how do file applications access object data?

9 Swift On File Origin: Red Hat contribution in April 2014 Allows you to: Write an object, read as a file Write a file, read as an object Swift Diskfile Module: different modules for different types of storage Swift Storage polices: coexists nicely with traditional storage policies Clients can access data directly from file interface Swiftonfile diskfile GlusterFS Openstack Swift default diskfile XFS Swiftonfile diskfile Spectrum Scale

10 Swift on File Storage Policy Standard Policy File and Object Access Policy

11 Swift on File Storage Object Layout This object: Is located here with traditional Swift: /mnt/swift/z1device7/objects/63773/ba2/f91d1e7550cd32822a17b00fa86d9ba2/ data But is located here with Swift On File: /mnt/scaleout_fs/acct/cont/obj

12 What about easy remote access to this data? And access from VMs?

13 Manila Overview Shared file system service for OpenStack Provides uniform interface for management of file system shares from different storage backends Many different vendor drivers today Share Operations include: Create, delete, extend, shrink shares Create snapshot, create share from snapshot Manage share access rules Manage / unmanage existing data sets Consistency groups, replication, Multi-tenancy support

14 This is sounding better But how do I share data between Swift on File and Manila?

15 Shared File Systems and OpenStack Storage Common data plane for OpenStack storage Provides enterprise features like: Snapshots & backups Automatic tiering/migration of data across storage pools Local & multi-site Replication Enables Unique Features for OpenStack services Nova live migration Efficient data sharing between Glance, Cinder, Nova using COW Features vary between vendors, but the idea is the same Shared File System

16 That seems simple enough

17 Demo

18 But What are the challenges to make this work in a production environment? Unified Authentication: Use same credentials for object interface and file interface Today: Middleware to enable creation of objects with ownership (UID/GID) of requesting user Future Extensions: Mapping of Object ACLs to File ACLs Mapping of Object quotas to File quotas Define on either interface, enforce on both Learn more at: Write a File, Read as an Object 1:30pm

19 More Challenges to make this work in a production environment Semantic Mismatch Object uses eventual consistency, file uses strong consistency Today: Access managed by user & application workflow Ingest through file, read through object Ingest through object, analyze and publish through file, read results through object Single writer to container or subdirectory at any point in time Can be enforced by ACLs or export permissions New files are automatically objectized by background daemon Future Extensions: Enforced coordination between object and file interfaces Eventual goal: full simultaneous access from either interface

20 Conclusions OpenStack provides the building blocks for sharing data between wide variety of clients and interfaces An enterprise shared file system can be the glue that brings the pieces together in the most efficient manner Simple, hypothetical use cases presented today The infrastructure can be used to solve the complex real life use cases that customers are facing today Object Data Swift (with SwiftonFile) OpenStack Cloud AD/LDAP Shared Data Shared Filesystem VM Instances Nova Cinder Glance Manila shares over object data Manila (File Share)

21 Announcements

22 OpenStack & Spectrum Scale Red Paper Released this week:

23

24 11:15 Kick-off Event Jesse Proudman 11:20 OpenStack for Beginners Brad Topol Shamail Tahir Tyler Britten IBM Sponsored Track 12:05 The open cloud: A platform of possibilities Local, Dedicated and Public use cases Jason McGee Azmir Mohamed 2:00 Modelling, Deploying and Managing Applications in IBM Blue Box with Cloudsoft AMP Duncan Johnston-Watt (Cloudsoft) Hernan Alvarez 2:50 Open without Limits -- LinuxONE, Ubuntu and OpenStack Mark Shuttleworth (Canonical) Angel Diaz Jessica Murillo Kershaw Mehta 3:40 One network to rule them all: Open, scalable, & integrated networking for Containers & VMs Kyle Mestery Phil Estes 4:20 Networking Time-out with Kyle Mestery and Team Skip the coffee: ipad Air 2 raffle, Texan specialty beers, sodas, cool posters 4:40 Accelerating Mobile App delivery with IBM UrbanCode Deploy, Heat, and OpenStack Tim Pouyer Tyson Lawrie Glen Hickman April 26 th, Austin Convention Center, Level 4, MR 18 C/D

25 THANK YOU