Building a Data Catalog

Transcription

1 Building a Data Catalog Promoting Data Reuse and Collaboration at an Academic Medical Center Kevin Read, MLIS, MAS Alisa Surkis, PhD, MLIS

2 EXTERNAL DATASETS 2

3 EXTERNAL DATASETS INTERNAL DATASETS 3

4 NYU Data Catalog THE INSTITUTIONAL PLAYERS 4

5 NYU Langone Medical Center NYU NYU Health Sciences Library NYU Division of Libraries 5

6 Clinical and Translational Science Institute (CTSI) Bridging gaps across different schools at NYU and beyond Mission of promoting collaboration Role in data sharing 6

7 Department of Population Health (DPH) Research using existing large datasets Willingness to share data Clinical informatics hub 7

8 Research IT Provides applications for clinical research data collection Research data storage Data governance 8

9 DataCore NYULMC DataCore Clinical Research Data Management Accessing Clinical Data for Research; Data Warehouse Data Set Curation Single Center Studies Multicenter Studies Clinical Data Claims Data Omics Data External Data Sets Internal Data Sets 9

10 Libraries NYU Health Sciences Library Works mainly with researchers at NYU School of Medicine, College of Dentistry NYU Division of Libraries Serve Global Public Health program, School of Nursing, Bioengineering, Neuroscience, Psychology, Nutrition, etc. 10

11 Libraries NYU Health Sciences Library Works mainly with researchers at NYU School of Medicine, College of Dentistry NYU Division of Libraries Serve Global Public Health program, School of Nursing, Bioengineering, Neuroscience, Psychology, Nutrition, etc. NYU Abu Dhabi Library Increasing amount of research at campus 11

12 NYU Data Catalog REASONS FOR IMPLEMENTATION 12

13 Heavy users of large, external datasets (e.g. census, national health surveys, Medicare) Department of Population Health 13

14 Heavy users of large, external datasets (e.g. census, national health surveys, Medicare) Lack of knowledge about institutional licenses Department of Population Health 14

15 Heavy users of large, external datasets (e.g. census, national health surveys, Medicare) Lack of knowledge about institutional licenses Department of Population Health Difficulty accessing datasets Difficulty working with datasets 15

16 16

17 NYU Data Catalog STRATEGY PART 1: OUR INITIAL APPROACH 17

18 Give the people what they want Focus on external datasets first Deal with internal datasets in the future Add functionality wherever possible 18

19 Local experts Identified researchers through grant and publication data Worked with DPH for outreach Includes researchers (and staff) from NYU and NYULMC Facilitates research and fosters collaboration 19

20 Facilitate access Host NY Statewide Planning and Research Cooperative System (SPARCS) data University Health Consortium (UHC) data 20

21 Other functionality PubMed searches Related datasets Linkage datasets (e.g. MEPS and NHIS) Datasets from same publisher (e.g. HCUP) National and local dataset versions (e.g. NHANES and NYCHANES) 21

22 NYU Data Catalog METADATA 22

23 23

24 Existing metadata schemas W3C Data Catalog Vocabulary Dryad Metadata Schema DataCite Metadata Schema NPG s Scientific Data 24

25 Strategy over purity Need to describe both external and internal datasets PubMed: search link vs article link Local Experts = external data only Authorship 25

26 Metadata 26

27 NYU Data Catalog THE DATA CATALOG 27

28 The Data Catalog 28

29 Current population health focus Maintaining functionality as catalog expands in scope Increase in subject domains 29

30 30

31 31

32 Technical Components Apache Solr search engine Javascript using: Backbone.js* (structure) jquery (webpage interaction) Underscore.js (display) Will use Google Analytics 32

33 NYU Data Catalog ISSUES: THE BIG THREE 33

34 PROMOTION NO USE NO RESOURCES FEW DATASET ENTRIES SCALABILITY POORLY MAINTAINED DATA MAINTENANCE 34

35 Promotion: Consumers and producers Combination of reaching out to targeted groups and broad blasts Many owners increases visibility DataCore, CTSI, Library, DPH Data discoverable through multiple systems NYU Main Library Catalog, Profiles RNS 35

36 Scalability: Factors and issues Curation time per dataset/researcher Number of FTEs Researcher upload of datasets 36

37 Maintenance: People and data in motion Researcher information Feed from Faculty Data Mart HR feeds from main campus People that leave vs data that leaves Published vs. archival records ORCID for all researchers by Spring 2015 Tracking data location 37

38 BONUS ISSUE 38

39 How do we define a dataset? DATA SET 39

40 NYU Data Catalog STRATEGY PART 2: NEXT STEPS 40

41 Building a community of users Strategy over purity External datasets form a strong core Initial internal datasets will be within similar domains to external datasets DPH Aiming for scope creep Clinical research data Social science data Basic science data down the road 41

42 Internal data curation Low bar for inclusion Data on a flash drive? Okay for now Ingest slowly Addition of internal datasets may lead to changes in workflow and metadata 42

43 Heavy users of large, external datasets (e.g. census, national health surveys, Medicare) Lack of knowledge about institutional licenses Department of Population Health Difficulty accessing datasets Difficulty working with datasets Willingness to share research data 43

44 Promotional strategies Demo the data catalog at DPH faculty meeting hours ago! Reach out to small research areas in DPH Demo to Global Institute of Public Health 11 schools across NYU 44

45 NYU Data Catalog FUTURE DIRECTIONS 45

46 DataCore NYULMC DataCore Clinical Research Data Management Accessing Clinical Data for Research; Data Warehouse Data Set Curation Single Center Studies Multicenter Studies Clinical Data Claims Data Omics Data External Data Sets Internal Data Sets 46

47 Clinical Research Data Flow NYU Patient Encounter EHR: EPIC Clinical Data Request Analysis Datasets Clinical Data Governance Publications Abstracted Data Reports EDC Analysis Datasets Publications Reports External Site External Site Non-NYU Patient Encounter External Data Transfers 47

48 Hosted Internal & External Data Flow (Future State) Metadata NYU HSL Data Catalog (website) Hosted Data Access Request Internal Analysis Datasets Data Use Agreement: HSL, DataCore Re-Analysis Metadata External Datasets Access permission Full Datasets Hosted Internal & External Datasets Data Pull Analysis Datasets Publications Data Flow Business Owners/Collaborators: NYU Health Sciences Library Clinical Translational Science Institute MCIT/Research IT/DataCore Reports 48

49 Cross-campus collaboration Pushing data from catalog into NYU Library Main catalog Outreach from main campus librarians for ingesting internal datasets 49

50 Integrating with Profiles 50

51 Continuing the conversation 51

52 Thank you!