From Mass Digitization to Description: Indiana University s Strategy to Overcome the Next Great Challenge

Transcription

1 From Mass Digitization to Description: Indiana University s Strategy to Overcome the Next Great Challenge Chris Lacinak, AVPreserve Jon Dunn, Indiana University AMIA Conference - Pittsburgh November 10, 2016

2 MDPI: Media Digitization and Preservation Initiative Goal: To digitize, preserve and make universally available by IU s Bicentennial subject to copyright or other legal restrictions all of the time-based media objects on all campuses of IU judged important by experts. 280,000+ audio and video items ~7PB over 4 years 9TB per day peak 80 different units 20+ different physical formats INDIANA UNIVERSITY

3 Public-Private Partnership for Digitization Memnon Archiving Services, A Sony Company INDIANA UNIVERSITY

4 4 Digitization and Preservation: The Phases Digitization Discovery and Access Pre-Digitization Inventory Catalog Prioritize Batch & Queue à Memnon Massive parallel digitization IU Operation Digitization of selected unique and highly vulnerable formats Quality control à à Metadata Rights Issues Technical aspects Metadata Technical infrastructure Ongoing monitoring and migration Digital Preservation and Storage INDIANA UNIVERSITY

5 Progress to Date mdpi.iu.edu INDIANA UNIVERSITY

6 Many Types of Units Some Examples: Libraries Herman B Wells Library Cook Music Library Lilly Library Archives Archives of African American Music and Culture Archives of Traditional Music Black Film Center/Archive IUL Moving Image Archive University Archives Museums Sage Costume Collection Mathers Museum Production Units Radio and Television Services Media Design and Production Performing Groups African American Arts Institute Department of Bands Academic Units School of Journalism Department of Folklore and Ethnomusicology Jacobs School of Music Research Centers and Institutes Kinsey Institute Russian and East European Institute Athletics! INDIANA UNIVERSITY

7 Rights Goal: make universally available Many rights situations: Copyright held by IU Copyright held by others Copyright held by others with license or deed of gift to IU Public domain Copyrighted orphaned work Copyright status and ownership unknown Also, ethical and cultural considerations Decision trees being developed to guide rights and access determinations INDIANA UNIVERSITY

8 Existing metadata sources: IUCAT INDIANA UNIVERSITY

9 Existing metadata sources: POD INDIANA UNIVERSITY

10 Access: Avalon Media System INDIANA UNIVERSITY

11 Digital Preservation: HydraDAM2 Media Files and Metadata Masters, Mezzanines Digital Preservation Repository (HydraDAM2) SDA Out-of-Region Storage Transcodes Access Repository (Avalon) INDIANA UNIVERSITY

12 Bit Storage: Scholarly Data Archive INDIANA UNIVERSITY

13 Collection and Metadata Examples

14 INDIANA UNIVERSITY

15 INDIANA UNIVERSITY

16 INDIANA UNIVERSITY

17 INDIANA UNIVERSITY

18 INDIANA UNIVERSITY

19 INDIANA UNIVERSITY

20 INDIANA UNIVERSITY

21 INDIANA UNIVERSITY

22 INDIANA UNIVERSITY

23 INDIANA UNIVERSITY

24 INDIANA UNIVERSITY

25 Hours 280k

26 Media Content Description

27 Core Principles Technological Heroism Human Assisted Computing People First Phased and Iterative Service Oriented Architecture

28 Methodology +

29 Applied permission Applied perm note Collection *Date created *Default permissions *Department/Unit Duration Full text Geographic Identifiers Links & relationships *MDPI barcode Music/Speech *Names Notes Parts/components Physical description *Publication status Relationship *Rights holder *Rights status *Role (for names) Sound/silent Source Subjects Target audience *Title Type of Resource Type of title Year of renewal Date other Event Geographic other Keywords Language Publisher Beats per minute Color info Color/B&W Ethnicity Frequency info Gender Genre Music present

30 Metadata Generation Mechanisms AV images text metadata MGM

31 Phase One MGMs Phase Two MGMs Phase Three MGMs Commercial content ID Human generation Human transcription Legacy closed caption Legacy date & timecode Memnon output Music vs speech detection Queried/Imported data Segmentation Shipping manifest (POD) Silence detection Tech-embedded metadata Facial recognition Linked data Named entity recognition Natural language processing Paper & video OCR Phoneme analysis Speech to text Subtitle recovery Speech-to-text comparison & weighting Artificial intelligence Audio frequency analysis Beats per minute detection Chroma analysis Content matching Genre detection Speaker identification

32

33

34

35 Phase One Phase Two Phase Three 1) Staffing & Training 1) SMART team embed 2) Acquire/Develop & implement core infrastructure & MGMs 3) Rights analysis 4) Associated materials 5) Phase 2 Prep Required & prioritized Manual Low hanging fruit 1) Develop/Acquire & implement phase 2 MGMs 2) Additional system dev 3) Phase 3 prep Semi/Automated Time-based MD Linked data 1) Develop/Acquire & implement phase 3 MGMs 2) Additional system dev 3) Focus on AI Synthesized/AI Specialized/ Domain specific

36 Without the Project

37 Possible Searches Wells Radio and Television Services Collection

38 Phase One Title A Conversation with HB Wells Title (Type of Title Alternative) A Conversation with Herman B. Wells Collection Radio and Television Services Department/Unit Radio and Television Services Physical Description Betacam Duration 31:07 MDPI Barcode Type of Resource moving image Date Created 1970/1979 Music/speech Speech Sound/silent Sound Subjects Indiana University ( ) Universities and colleges United States Administration ( h ) Universities and colleges United States History 20 th century ( h ) Wells, Herman B. ( )

39 Phase One Names Mundt, Bruce (Producer) Petranoff, Robert (Producer) Office of University Relations (Production company) Wells, Herman B. (Interviewee) Clark, Thomas D. (Interviewer) WTIU Bloomington (Production place) Geographic (Recording location) United States Parts/components 1 of 1 Notes Betacam is transfer from film original based on film leader at start of content. Date range is based on main library building being complete and having electricity. Rights holder Indiana University Rights status In Copyright Year of Renewal 2067 Publication status Unpublished Applied permissions Campus only Default permissions Campus only

40 Phase One Search Unpublished videos Produced by Radio and TV Audio type speech Herman B. Wells is interviewee IU is rights holder

41 Phase Two (Additional) Language English Keywords Board of Trustees Faculty University administration University president Music Arts Midwest universities President's spouses 20 th -century leaders Names Bryan, William Lowe Kinsey, Alfred Roosevelt, Eleanor Rockefeller Foundation Date other 1940/1970 Full Text OCR from text within video Speech to Text Geographic other Bloomington ( Indiana (

42 Phase Two Search Every place within the video Face of Herman B. Wells appears Eleanor Roosevelt exists in text

43 Phase Three (Additional) Color/bw Color Color Information [time stamp and values representing predominant colors being represented] Relation [Content matching will identify where any portions of content in this video also exist in any portions of videos within the repository] Music present [time stamp at points at which music is present] Genre Interview Speaker Identification [time stamp and name each time a speaker changes, combined with the names field]

44 Phase Three Searches All repository content with any portions of the audio or video in this video Information for each piece of commercial music

45

46 Encompassed in Budget Existing Staff Hours Human Generation MGMs Query and Import Hours SMART Assessment Hours MGM Products & Services MGM Dev Avalon Dev Workflow System Dev RMS Dev Consulting Scanning & Imaging Costs Hardware Costs

47 Cost Per Item (All In) Phase 1 Phase 2 Phase 3 Total $16.26 $12.58 $4.07 $32.91

48 A Few Takeaways Organizational effort and preparation Segmentation vs timestamping Lower than anticipated costs

49 Next Steps 1. Access Workflows task force formed Develop workflows for items/collections with good metadata and clear rights 2. Continued internal messaging Digitization access 3. Longer-term planning Implementation plan and budget for full metadata project Development of platform for workflow engine / data warehouse Grant funding, collaborators? INDIANA UNIVERSITY

50 Questions? mdpi.iu.edu avpreserve.com INDIANA UNIVERSITY