NDNP: The Kentucky Edition

Transcription

1 University of Kentucky UKnowledge Library Presentations University of Kentucky Libraries NDNP: The Kentucky Edition Eric Weig University of Kentucky, Kopana Terry University of Kentucky, Click here to let us know how access to this document benefits you. Follow this and additional works at: Part of the Archival Science Commons Repository Citation Weig, Eric and Terry, Kopana, "NDNP: The Kentucky Edition" (2007). Library Presentations This Presentation is brought to you for free and open access by the University of Kentucky Libraries at UKnowledge. It has been accepted for inclusion in Library Presentations by an authorized administrator of UKnowledge. For more information, please contact

2 NDNP : The Kentucky Edition Eric Weig: eweig@ .uky.edu & Kopana Terry: kopana.terry@uky.edu

3

4 Beyond the Shelf: Serving Historic Kentuckiana Through Virtual Access

5 When are you going to digitize newspapers?

6 Kentucky Newspapers We have a 50 year history of microfilming We were in the first round of the USNP We still microfilm current KY newspapers

7 Kentucky History

8 Experience with newspapers, microfilm,& digitization

9 NDNP checklist Successful film to digital experience Know microfilm well Have the master negatives Fits into overall growth plan We didn t propose outsourcing

10 Grant Awarded! Order server Order new scanner Order software pieces and parts Hire project manager Get organized Call meeting of advisory board

11 Training Opportunity 2 team members went to a workshop in Utah Visited iarchives while in Utah

12 Everything Changed

13 Content Selection Geographically distributed Significant titles Titles that are available What we have in our vault Advisory board recommendations

14 Digital Production Application Framework Manages Ingest the Digitization Process Automation Manual Process Output

15 Digitization Steps Before Post Processing 1. Ingest (automated) 2. Split/Deskew/Crop (manual) Structural Metadata (manual) 4. Zoning for OCR (manual)

16 1. Ingest (Automated) Import images and CSV file into application framework. Create derivative images for use in the application framework. Create new work container in database manager.

17 2. Split/Deskew/Crop (Manual) Split any images from IIB oriented film so that each page image is a distinct file. Deskew by text line for better OCR Crop to include page edges.

18 3. Structural Metadata (Manual) Key data for page numbers, reel sequence, newspaper section, and any targets included on the film.

19 4. Zoning for OCR (Manual) Plot division lines over page images to create templates that guide the OCR engines during their recognition process. Ensure preservation of correct reading order in the generated searchable text.

20 Quality Control Example: Scan through thumbnails of every page image to check for proper skew, split and crop.

21 Automated process >> Output: Post Processing

22 Validation of Data (Automated) LC Digital Viewer and Validation software parses output to ensure data is present and properly formatted. Writes digital signatures into XML files that have validated successfully.

23 Advantages of in-house production We know the process intimately from beginning to end

24 Lessons Learned

25 The better you know your film and content the easier things will be

26 Microfilm evaluation collects information and reveals physical problems dirty film circulated master negatives redox Silvering Vinegar syndrome Newton rings from hydration

27 Microfilm evaluation collects information and reveals intellectual problems [1], [2], [1], [2], [3], [4], [5], [6] < > splice [3], [4], [8], [blank], [1], [2], [7], [8] < > B

28 Microfilm evaluation collects information and identifies metadata challenges Title: The Owingsville Outlook, Frequency: Weekly, Location: Owingsville, KY, File Number: S/83-5, Date: 1906: January 25, December 20, Notes: some pages are mutilated, *Issues this month are missing (June) Present: , , , , , , , , , , , , , , , , , , , , , ; Missing: , , , , , , , , , , , , , , , , , , ; Incomplete: , Codes: check mark=present, M=missing, I=incomplete, Mu=mutilated, NP=not published;

29 You can never have enough storage

30 Large-format microfilm (IA) + NDNP image specifications Scanning and storage challenges 72 MB 576 MB 29,952 MB and that s just the TIFFs

31 Quality control matters at every step

32 What makes a good image? and, remember, newspapers aren t printed on white paper.

33 Learn the specification well and work to the specification

34 Consider the number of titles KY-NDNP Phase I chose 34 titles 34 titles = 34 histories

35 Technical Infrastructure Issues Systems support challenging (personnel issues) Not the library s integrated catalogue Network issues Storage issues Desktop issues

36 Benefits Gain expertise Stimulating work Excellent team work Something to build other work/projects on Building infrastructure

37 Real Strength of NDNP? Access & Preservation

38 Opportunities? Share expertise with others Grow future project managers Library school students benefit from experience Continue to supply preservation and access to Kentucky s history Find hidden treasures

39 A lost paper found

40 Afro-American Mission Herald

41 Newspaper Conservation

42

43 Kentucky Vindicator

44 IT (Lawrenceburg, Ky.)

45 Bourbon News

46 Kentucky Irish American

47 Richmond Climax

48

49 NDNP : The Kentucky Edition Eric Weig: eweig@ .uky.edu & Kopana Terry kopana.terry@uky.edu