Storage Management Solutions. The Case For Efficient Data Management In Broadcast

Transcription

1 Storage Management Solutions The Case For Efficient Data Management In Broadcast

2 Overview Definitions Data Management Subsystem Integrated Environment

3 Data Content or Data as used in this presentation, these terms refer to material such as digitized files in onair departments and essence in the asset management environment; they include images, both audio and video, rather than the descriptive metadata that may be created by indexers, catalogers and asset managers Definitions

4 Operational Controller - third party application responsible for controlling data acquisition into the customer facility and delivery from the facility; usually not focused on data management but has the big picture view of where data should be at any point in time; examples: automation systems, asset managers, health care PACS Definitions

5 Data Server - collection of special purpose computer hardware and software that buffers acquired data; sometimes the data server also performs the acquisition and delivery of the data under the direction of the operational controllers; examples: video servers, edit stations, network file servers Definitions

6 Data Management Software (Data Manager) manages data according to user-defined policies; directs the movement of data between data servers and storage management systems; implements high performance transfer algorithms to meet work flow needs; manages WAN transfers cohesively; takes direction from operational controllers or acts automatically Definitions

7 Storage Management Software (Storage Managers) - manage data stored on digital storage devices such as magnetic disk, DVD and data tape; transfer data between data servers and the storage devices; act under the direction of the data manager; the data manager unites independent storage managers into a co-operating whole Definitions

8 Definitions OPERATIONAL CONTROLLER DATA SERVER DATA SERVER Policy DATA MANAGER STORAGE MANAGER STORAGE MANAGER control data Disk Tape

9 The Data Management Subsystem POLICY DATA MANAGER DISK STORAGE MANAGER TAPE STORAGE MANAGER WAN TRANSFER MANAGER Disk Tape

10 The Data Management Subsystem Site A WAN Manager Site B Data Manager Data Manager Storage Mgr Storage Mgr Storage Mgr Storage Mgr WAN Manager

11 The Roles Of Data Management Basic storage management disk storage devices data tape storage devices segregating data on specified storage devices data redundancy Data distribution on storage devices according to work flow requirements disk-only data tape-only disk and tape in a PEER relationship

12 The Roles Of Data Management File-level control of data movement prioritization of file transfer operations providing file transfer status aborting in-progress file transfers Separation of data paths from control (command) paths permits operational controllers to use same low speed, e.g., 10/100BaseT, network allows data to flow on faster networks dedicated to data transfer stops data transfers from choking front line network

13 The Roles Of Data Management High performance data transfer capability file leader caching (configurable amount of file data remains on disk storage device) locality of reference (treats a specified collection of files as a unit for transfer to and from storage devices) Distributed data and storage management architecture data manager and storage managers can execute on separate computer platforms than storage system data transfer agents data transfer agents can execute on separate platforms from each other to optimize performance and provide scalable, redundant solution

14 The Roles Of Data Management Use of relational database for metadata store permits more flexible data management decouples storage systems from traditional file systems and their limitations Cohesive WAN data transfer management metadata viewing and modification file transfers to and from any node and any other node persistence in overcoming transitory network errors asynchronous notification of file arrivals on local destinations

15 The Roles Of Data Management Data management based on user-defined policies commands of operational controllers are executed according to user policies, defined through configuration of data manager s relational data base permits data management according to customers workflow model

16 The Roles Of Data Management User defined policies include configurable peer-to-peer storage device management data stored on storage device optimized for data s characteristics data sent to data servers from storage device that makes most sense high performance data access data movement based on locality of reference (collection of files) file leader caching on disk storage devices automatic, scheduled transfers between data servers and storage devices

17 The Roles Of Data Management User defined policies (cont.) complex WAN data transfer management cohesive data sharing among remote network nodes central storage management for shared storage devices automatic file backup to a remote location conventional disk space conservation algorithms migration caching purging

18 The Integrated Environment Asset Management Controller Automation Controller News Controller Video Servers User Defined Policy Data Manager Tape Storage Mgr Disk Storage Mgr

19 The Integrated Environment Asset Management Controller Automation Controller News Controller Video Servers User Defined Policy Data Manager WAN Transfer Mgr Tape Storage Mgr Disk Storage Mgr

20 The WAN Environment Data Mgr Disk Mgr Data Mgr Tape Mgr Wan Wan Data Mgr Tape Mgr Wan Data Mgr Storage Mgrs Wan Data Mgr Disk Mgr Wan Wan Data Mgr Disk Mgr Data Mgr Tape Mgr