Paper Presented at 20th Business meeting

Transcription

1 Paper Presented at 20th Business meeting IFLA Newspapers Section Shanghai Library China 2004

2 Newspaper digitisation development at National library of Finland HUL

3

4 The National Library of Finland - Helsinki University Library established in 1640 Legal deposit law since Legal deposit in Russia Legal deposit in Finland Newspapers in Finland from Finnish-American newspapers

5 NATIONAL DIGITISATION AND PRESERVATION CENTRE (Centre for Microfilming and Conservation) Situated in Mikkeli since 1990 Staff about 50 employees Extensive microfilming and digitisation (newsp) Coord. Digitisation program in the library field Coord. Digitisation work in the ABM-sector International participation

6

7 Nordic Digital Newspaper Library Project period: Participants Helsinki University Library, Finland Royal Library in Stockholm, Sweden National Library in Norway, Mo Århus State Library, Denmark Financing: NORDINFO Ministry of Education in Finland

8 Objectives To begin with : Microfilm platform for digitisation of brittle paper collections Full text search from newspaper collections Fuzzy search for old language and defect OCRresults Article search from newspaper collections Solutions for large scale digitisation.

9 Browse

10 Fulltext search

11 Result

12 Article Index: Asia

13 Result on search

14 A Fin on business in China in 1872

15 Information flow

16 Objectives today Converting large volumes : in an industrial production environment with optical character recognition of both Fraktur and Roman text with high quality enlightment of search words on the newspaper page using xml- METS-standard (L of C)

17 Testing of Zissor Testing of the Zissor Content Conversion System ZCCS Testperiod of 3 months, beginning 15th of February Partner the Royal Library of Sweden A test report will be done and a request for tenders will be announced Nordic libraries will take part in the test results Actual testing: at the National Digitisation Centre in Finland, Mikkeli

18 Preparations Technical pre-study: objectives, needs and roles includes a detailed installation plan test criteria and evaluation methods omnifont tool of Gothic Fraktur included Zissor installation and start-up team National Digitisation Centre: hardware, network and set up required Training of key personnel during installation and start-up by Zissor After start-up: support via continuous link to partners

19 Zissor installation

20 Third party components ABBYY software Finereader 7, including support of omnifont carachter recognition of Gothic Fraktur CCS component of newspaper column clipping at National Digitisation Centre: Oracle license

21 Microfilming process

22 Microfilming and digitisation

23 Scanning of film

24 The Zissor prosess Preparation: Human intervation titles and dates given per issue or/and supplement. Pages checked. Generate: automatic continuation, 9 CPU - 1. indexing according to preparation - 2. page images - 3. Layout of columns - 4. OCR Finereader, needs 6 computers - 5. Analyses of articles (CCS) - Checking of the prosess, OCR and export

25 Now included in Zissor :OCR - interpretation

26 Servers in action

27 Speed of process per day Preparation/ microfilming 2-3 rolls per person Digitisation and checking of films, 3 rolls/pers. Preparation to checking of digitised files: 5 rolls per person (1,5 h/1000 pages) Indexing 0,15 s/page Layout 10 s/page OCR 30 min/page Article analyses 2 s/page Indexing to layout: pages Export to web is slow: 2000 pages

28 The testphase today The work with the Zissor company has been smooth, any suggestions have been dealt with immediately Finereader of Gothic Fraktur text will be delivered 22nd of March OCR is varying from 93-98% of Roman text

29 This spring Testing of Swedish material: newspapers, journals and books in April Evaluation in May: meeting of the administrative and technical expertise at the National Digitisation Centre in Finland Request for proposals together with the Royal Library: in Spring or in early Autumn

30 Future prospectives Automation of digitised newspaper holdings Newspaper database and its fuzzy search function is enlarged to other groups of older materia and made searchable via various entities.

31