ISO/IEC JTC 1/SC 32 N 2490

Transcription

1 REPLACES: ISO/IEC JTC 1/SC 32 Data Management and Interchange Secretariat: United States of America (ANSI) Administered by Farance Inc. on behalf of ANSI DOCUMENT TYPE Information from SC Secretariat TITLE Report on the JTC1 Study Group on Big Data (SGBD) SOURCE Keith W. Hare PROJECT NUMBER STATUS Status report for consderation by SC32 at Beijing meeting REFERENCES ACTION ID. REQUESTED ACTION DUE DATE Number of Pages 6 LANGUAGE USED English DISTRIBUTION P & L Members SC Chair WG Conveners and Secretaries Dr. Timothy Schoechle, Secretary, ISO/IEC JTC 1/SC 32 Farance Inc *, 3066 Sixth Street, Boulder, CO, United States of America Telephone: ; Timothy@Schoechle.org available from the JTC 1/SC 32 WebSite *Farance Inc. administers the ISO/IEC JTC 1/SC 32 Secretariat on behalf of ANSI Page 1 of 6

2 1 Introduction At the November, 2013 JTC1 plenary, JTC1 established a Study Group on Big Data (JTC1 SGBD). To some extent, the JTC1 SGBD is a follow on to the JTC request (resolution 33) that SCs study and report back on the topic of Next Generation Analytics. The SC32 Ad Hoc and Study Group on Next Generation Analytics was created in response to this JTC request. In addition to the JTC1 and SC32 study groups, within the USA, the National Institute of Standards and Technology (NIST) has organized a Public Working Group on Big Data (NIST PWG BD). This effort has had weekly teleconference since June 2013 and has produced fairly extensive documents on a variety of Big Data aspects. 2 Big Data Efforts The following sections describe the current overlapping, but independent, Big Data efforts. 2.1 SC32 Ad Hoc and Study Group on Next Generation Analytics The initial SC32 Ad Hoc on Next Generation Analytics was established at the 2012 Berlin Germany plenary and extended the work at the 2013 Gyeongju, Korea. The most recent report is SC32 N 2388a SC32 Study Group on Next Generation Analytics, June 4, This report was delivered to the JTC1 Special Working Group on Planning (SWG-P) in the summer of Although the SC32 study group was tasked with Next Generation Analytics it was clear that the analytics were operating on what is being called Big Data. 2.2 USA NIST Big Data Public Working Group In June, 2013, NIST instituted a Big Data Public Working Group (NIST BDPWG). It has been chaired by: Dr. Chaitan Baru, Distinguished Scientist and Associate Director Data Initiatives, San Diego Supercomputer Center Dr. Robert Marcus, Chief Technology Officer at ET-Strategies, Co-Chair of Big Data Working Group at Cloud Standards Customer Council Mr. Wo Chang, Digital Data Advisor for the NIST Information Technology Laboratory (ITL), Convenor of ISO/IEC JTC/1 SC29 WG11 (MPEG) Multimedia Preservation AHG While Chaitan Baru and Bob Marcus have provided substantial input into the NIST BDPWG, Wo Change has been the visible driving force in the effort. The charter for this group is: The focus of the NBD-PWG is to form a community of interest from industry, academia, and government, with the goal of developing a consensus definitions, taxonomies, secure reference architectures, and technology roadmap. The aim is to create vendorneutral, technology and infrastructure agnostic deliverables to enable Big Data stakeholders to pick-and-choose best analytics tools for their processing and visualization requirements on the most suitable computing platforms and clusters while

3 allowing value-added from Big Data service providers and flow of data between the stakeholders in a cohesive and secure manner. The NIST BDPWG web site is: The web site is open to the public. The NIST BDPWG participants have primarily been from the USA, although there have been some contributions from a university in the Netherlands. No formal list of participants has been published. The NIST BDPWG has operated through weekly Web Conferences/Conference Calls. The efforts have focused on five areas: Definition and Taxonomy Requirements Security & Privacy Reference Architecture Technology Roadmap The NIST BDPWG has produced a series of reports: NIST Big Data Definitions & Taxonomies Subgroup Volume 1: NIST Big Data Definitions Volume 2: NIST Big Data Taxonomies NIST Big Data Use Case & Requirements Subgroup Volume 3: NIST Big Data Use Case & Requirements NIST Big Data Security & Privacy Subgroup Volume 4: NIST Big Data Security and Privacy Requirements NIST Big Data Reference Architecture Subgroup Volume 5: NIST Big Data Architectures White Paper Survey Volume 6: NIST Big Data Reference Architecture NIST Big Data Technology Roadmap Subgroup Volume 7: NIST Big Data Technology Roadmap The current NIST BDPWG drafts are located at The NIST Big Data Technology Roadmap, section 8, Multi-stakeholder Collaborative Initiatives Related to Big Data has a substantial overlap with SC32N2388a Section 4 Existing Standards, primarily because I contributed much of the text in Section 8.

4 Within the NIST BDPWG reflector, there was discussion of SC32N2388a but I do not know if it influenced any of the other parts. 2.3 JTC1 Study Group on Big Data At the November, 2013 JTC1 Plenary, JTC1 approved resolution 27 to establish a Study Group on Big Data and accepted Wo Chang of the USA as the Study Group Convenor. Mr. Chang initially scheduled three study group meetings and issued a call for participation (SC32 N 2489 JTC1 N 11953). The Terms of Reference from resolution 27 are: 1. Survey the existing IT landscape for key technologies and relevant standards /models/studies /use cases and scenarios for Big Data from JTC 1, ISO, IEC and other standards setting organizations, 2. Identify key terms and definitions commonly used in the area of Big Data, 3. Assess the current status of Big Data standardization market requirements, identify standards gaps, and propose standardization priorities to serve as a basis for future JTC 1 work, and 4. Provide a report with recommendations and other potential deliverables to the 2014 JTC 1 Plenary. The web site for this effort is: This web site is open to public. Mr. Chang has also posted copies of the document to the JTC1 Livelink site JTC1 SGBD Meeting Schedule Mr. Chang initially scheduled three face-to-face meetings, but the May meeting added several conference calls and an additional meeting at the beginning of September, The current list of meetings is: USA San Diego, California Workshop: March Study Group Meeting: March Europe Amsterdam Workshop: May Study Group Meeting: May Asia Beijing China Workshop: June Study Group Meeting: June Conference Call July, 23, 2014, Time: UTC 22:00 Conference Call August?? 2014 Tentatively London, UK Study Group Meeting: September Conference Call September?? 2014

5 Note that the meeting schedule is extremely tight. The JTC1 SGBD report needs to be complete by the end of September, 2014 in order to be an on-time contribution to the November 2014 JTC1 plenary JTC1 SGBD Draft Report to JTC1 The current draft of the report to JTC1 is: ISO/IEC JTC 1 SGBD N0040 Draft SGBD Report to JTC 1 v2.0 May 16, 2014 The following sections of the draft report are of particular interest to SC32: 5 Relevant standardization activities 7 Potential Gaps in Standardization 8 JTC 1 prospective standardization areas and issues 9 Top Level Summary of Recommendations to JTC 1 Appendix I. The mapping table between SCs and issues of Big Data Appendix II. Topics & Technologies Relevant to Big Data Standardization NIST BDPWG Documents The USA TAG to the JTC1 SGBD submitted the NIST BDPWG drafts as informational documents so that they would be officially visible to the JTC1 SGBD. The JTC1 SGBD versions of these documents are: N0028 NBD-PWG Volume 1 - NIST Big Data Definitions V1.0 Draft Pre-release; N0029 NBD-PWG Volume 2 - NIST Big Data Taxonomies V1.0 Draft Pre-release; N0030 NBD-PWG Volume 3 - NIST Big Data Use Cases & Requirements V1.0 Draft Pre-release; National Body Informational Contribution, US National Body (INCITS) N0031 NBD-PWG Volume 4 - NIST Big Data Security & Privacy V1.0 Draft Prerelease; N0032 NBD-PWG Volume 5 - NIST Big Data Architecture White Paper Survey V1.0 Draft Pre-release; National Body Informational Contribution, US National Body (INCITS) N0033 NBD-PWG Volume 6 - NIST Big Data Reference Architecture V1.0 Draft Prerelease; N0034 NBD-PWG Volume 7 - NIST Big Data Technology Roadmap V1.0 Draft Prerelease; Research Data Alliance Mr. Chang has also been working with Research Data Alliance (RDA, to create reference/example implementations. I have not yet seen any output from this effort.

6 3 Observations Within the USA at least, many of the participants in the Big Data efforts have not previously been involved in JTC1 standards efforts. It may be possible to incorporate some of these participants into ongoing de jure standards development efforts. Big Data is amorphous, evolving set of technologies. Once pieces are identified that can potentially be standardized, standards development groups will need to create standards as quickly as possible. Because of the breadth and complexity of technologies associated with Big Data, standards development is unlikely to fall within a single SC. Cooperation and coordination will be required. 4 Next Steps The JTC1 SGBD report to JTC1 will contain recommendations for areas that would benefit from standardization. In part because of the NIST BDPWG efforts, I expect the report to be fairly comprehensive. Possible responses from JTC1 are: Continue the JTC1 SGBD for another year to give it time for additional exploration and expansion Create a new SC specifically to handle Big Data related Technologies Assign specific items from the report to existing SCs Some combination of the above SC32 participants should review all of the JTC1 SGBD documents, ISO/IEC JTC 1 SGBD N0040, Draft SGBD Report to JTC 1 v2.0 to ensure that: Relevant technologies currently being standardized by SC32 Working Groups are attributed to SC32. New standardization areas that would be appropriate for SC32 Working Groups include recommendations that they be assigned to SC32. New standardization areas that are of no interest to SC32 Working Groups include recommendations that they be assigned to some other SC.