Country Report Uganda. ADP Quality Assessment ADP/PARIS21

Transcription

1

2 Country Report Uganda ADP Quality Assessment ADP/PARIS

3 Table of Contents Introduction... 3 Executive Summary... 3 Section 1: DDI Assessment... 4 Section 2: NADA Assessment... 6 Section 3: Status on Dissemination... 6 Data Access and User Management... 6 Status of Dissemination Policy and Statistics Act... 8 Section 4: Microdata Outreach and Advocacy Workshop... 8 Section 5: Institutional Progress and Internalization of the ADP Processes... 9 Section 6: Performance Indicators Section 7: Innovations and Data Revolutions Section 8: Conclusions and Recommendations Section 9: Looking Forwards Annex 1: Summary of ADP implementation in Uganda Annex 2: DDI score by metadata category Annex 3: Comprehensive review of NADA Annex 4: Country prioritization of data development activities in post

4 INTRODUCTION The ADP was launched in 2006 as a recommendation of the Marrakech Action Plan for Statistics (MAPS) to undertake urgent improvements in survey programs for monitoring the Millennium Development Goals (MDGs). With the high-level endorsement in November 2011 of the Busan Action Plan for Statistics (BAPS), the ADP is addressing the BAPS's second priority (i.e., promote open access to and use of data ). The ADP s goal is to increase the use and value of survey data. The ADP supports data producers and users in developing countries by carrying out inventory, documentation, dissemination and preservation of micro-datasets; establishing national and regional survey data repositories to make existing survey microdata more accessible to users; establishing national microdata dissemination policies; and developing and implementing outreach and advocacy programs targeting the microdata users (i.e., universities, research centers, independent think tanks, NGOs, development partners, and others) to increase awareness of microdata availability and use of microdata. The ADP takes advantage of tools and guidelines developed by the International Household Survey Network (IHSN). The ADP is currently supporting agencies in more than 70 countries in Africa, Asia and the Pacific, Latin America and the Caribbean. The ADP has been implemented by PARIS21 and funded through contributions from the World Bank Development Grant Facility which began in 2006 and ends in With the end of the program, a program evaluation was undertaken. Under the tasks and activities undertaken by the ADP, this assessment developed some standardized tools used to render the evaluation comparable across countries in the region and across regions in the world. Over 30 countries in 7 regions were evaluated. The following key areas were evaluated: Quality of the metadata produced to describe the household surveys and statistical observation as documented using the DDI Quality of the NADA and its visibility for web based dissemination A review of the microdata dissemination and data access policies Management of users and cultivating relationships with data users Institutionalization of the documentation and dissemination processes This report will assess each of these areas and assess the performance of the country in attaining a minimum level or threshold and/or exceeding that threshold. The report will also look at the countries outlook and ability to respond to the new data agenda being defined by the new Sustainable Development Goals (SDGs) measurement agenda and the call for a Data Revolution. 3

5 EXECUTIVE SUMMARY The Accelerated Data Program (ADP) was implemented in the Ugandan Bureau of Statistics (UBOS) in Since then the UBOS has been conducting a number of activities to archive and promote the use of microdata in Uganda. Chart 1 presents an overview of the ADP activities in Uganda. A summary table of ADP implementation in Uganda is also presented in Annex 1. Chart 1. Timeline of the implementation of ADP in Uganda UBOS joins the ADP Initiative UBOS launches NADA Conducts 2nd MMT training workshop Drafts a microdata access policy Organizes a MOW 2014 Since the start of data management training in 2010, the UBOS has conducted a number of activities from microdata documentation training to organizing an outreach workshop. To date, four ADP activities are undertaken in the UBOS and the UBOS has completed most of the process of the ADP cycle including data documentation, NADA publication, drafting a microdata dissemination policy and promoting data use through a microdata outreach and advocacy program. The UBOS NADA disseminates 50 studies on its catalog. Among them, 39 are posted as the Data not available type and the remaining 11 are linked from external repositories. That is, the UBOS does not provide data online through the NADA. The microdata of the studies documented by the UBOS, however, can be obtained through direct request by sending an official letter addressed to the UBOS Executive Director requesting for the specific data. SECTION 1: DDI ASSESSMENT The DDI is a metadata standard adapted by the World Bank. It was originally intended to form a common standard for researchers to exchange information on research projects. For this reason, the custodian of the standards remains in large part within the ICPSR. The tools developed for the assessment evaluate the main metadata elements and are designed to check completeness and coherence of the metadata such that a researcher would be able to capitalize on the available information. The table below provides a summary of the scores. For more information on the scores in a disaggregated form please refer to Annex 2. 4

6 Score Table 1: DDI Assessment Summary of NADA Catalogue of the UBOS RESULTS Regional Ranking 4 Number of statistical projects in NADA 48 SCORE Average Score 57.8% Highest Score 80.1% Lowest Score 9.3% Critical Categories Difficulty to Access Data Version, Data collection, Data processing, Data appraisal, Data access, Data files, Variables 100% of studies documented by UBOS do not have microdata available Main Findings The day and month are often missing from production date Abstract was sometimes too long or contained less relevant information Sampling errors are not often provided Data Access entries do not always provide a citation or copyright Weighting variables are not always identifiable Some variables do not have questions associated with them or repeated the label Figure 1 plots the individual scores for each study ranked from highest to lowest. The pattern can give some indication as to the reasons for decreasing quality. UBOS should review the lowest ranking scores. Figure 1: Assessed studies by score (Under/Above of average score) Studies 57.8% The figure shows that the metadata quality of 35 studies, that is 73% of the total studies, are above the average score line. The remaining 27% of the studies are below the average quality line. Specifically, 6 studies have DDI quality scores below 30% and they need more attention from UBOS to improve their quality. 5

7 ECTION 2: NADA ASSESSMENT The assessment of the NADA catalog site was conducted by applying a Comprehensive Review of the NADA form, which consists of 41 questions grouped into 7 categories. The evaluation was conducted on specific aspects about: Configuration and Visibility, Registration, Search and Filters, Data Dissemination Policy, Data Access, User and Citations, and Innovations (see Annex 3). Table 2 shows the average of each of the seven categories that grouped the 41 questions that assess the content and operation of the NADA catalog site.. Because the maximum score for each category is different, scores are expressed as a percentage of the total possible score for each category..table 2: Score of NADA Assessment by Category Category Score (%) TOTAL 48.2 NADA visibility 6.2 NADA Registration 11.3 Search and Filters 7.8 Data dissemination policy 0.0 Data access 20.0 Innovation Days to respond Uganda NADA visibility Maximum NADA Registration Search and Filters Metadata and Citations 0.0 Innovation 0.0 Days to respond 3.0 Metadata & Citations Data access Data dis. policy The UBOS NADA achieved a relatively low quality score relative to the region in terms of disseminating studies. This is mainly due to either zero or low scores across all categories. Specifically, the Data dissemination policy, Metadata and Citations, and Innovations categories all scored zero. The rest of the categories (except Data access) including NADA visibility, NADA registration, Search and filters and Days to respond also achieved low scores. Particularly, the NADA page is not fully integrated into the main website, Filter by topics is missing, the Collection tab is not working, the NADA home page or the About tab is missing. The microdata dissemination policy is also not linked to the NADA. It may be because the UBOS microdata dissemination policy, which began to be drafted in 2013, is not finalized yet. Likewise, the days to respond users queries on the NADA are also very long at 10 days on average. 6

8 SECTION 3: STATUS ON DISSEMINATION Data Access and User Management As of September 2015, the date on which the UBOS NADA assessment was conducted, there were 48 studies published with two types of data access: Data not available and Data available from external repository. In both cases, the microdata are not directly accessible from the NADA. The Data available from external repository type provides metadata information describing datasets, but the actual microdata is available on another producer repository. A link to the repository is provided from the NSO s NADA. Likewise, the microdata are not available online for user access for the Data not available type. The datasets can, however, be obtained from the NSO premises through direct request onsite. Normally, the policies and procedures tab of the NADA provides detailed information on the process and the conditions under which different types of data are accessible to users. The NADA has a functionality to record the user's request. The information and inventory collected from the NADA users could later be used to promote data use and for user engagement. Figure 2: Studies by type of data access Data not available 77% Data from external repository 23% The UBOS does not provide microdata online through the NADA. The survey datasets are available onsite from the NSO premises when written request to the Executive Director is approved. As per the UBOS dissemination practices, the studies on the NADA are posted as either the Data not available type (77%), or Data from external repository (23%). Regarding user management, the bureau keeps records of the registered users. However, the UBOS is not active in responding the users' queries on time. This may be because the UBOS NADA does not allow data access online. Normally, the NSO gets feedback from users through user-producer dialogues and data dissemination events aimed at improving survey design and dissemination activities in Uganda. 7

9 Table 3: Users Statistics in UBOS NADA Number of registered users (active and non-active) in NADA 290 Number of Active registered users 109 Number of deactivated users (blocked) 181 Number of Licensed Requests (total) 19 Number of pending licensed requests 15 Number of citations on-line 0 Number of surveys with data unavailable in-country but available elsewhere (DHS, MICS) 11 Status of the Dissemination Policy and Statistics Act The UBOS started drafting a microdata dissemination policy in 2013 with support from PARIS21. However, the data dissemination policy is not yet finalized. The data dissemination activities in Uganda are governed by the Uganda Bureau of Statistics Act The Act provides UBOS the legal authority for the collection, compilation, analysis, and publication of statistics and the responsibility to co-ordinate the National Statistical System. Although the dissemination of microdata is not clearly stated, the Act mentions the authority to "organize and maintain a central depository of statistical reports, publications, documents and data from within and outside Uganda" as a primary functions of UBOS. In line with this policy, the UBOS has established a NADA on its website and the microdata are available to users from the NSO premises upon written request to and approval from the Executive Director. Furthermore, the Act provides the UBOS with the authority for "promoting cooperation, coordination and rationalization among users and providers of statistics at national and local levels so as to avoid duplication of effort and ensure optimal utilization of scarce resources". Table 4 presents the general status of dissemination of microdata and the legal authority in Uganda. Table 4: Status of Dissemination Policy and Statistics Act Uganda UBOS NSS COMENTS & PROGRESS Statistics Act allows Microdata Access No Cclause 3, point (e) of the Statistics Act 1998 mentions the maintenance of a central depository of statistical publications and data. Is the Statistics act available on line (provide link) Yes Dissemination Policy allows Microdata No No dissemination policy. Access Is dissemination policy available on line? No Provide link Regulation of Dissemination Policy N/A includes Calendar of Publications, Type of Users, Type of Data Access per survey, NADA & DDI Standard Other channels to Microdata Access Yes UBOS website: 8

10 available % Data Accessible through NADA Catalog Comments and Progress of Dissemination Policy (if not approved/updated) 0% yes A draft version of the microdata access policy has been prepared by the UBOS, but not finalized yet. SECTION 4: MICRODATA OUTREACH AND ADVOCACY PROGRAM With the ADP s support, the UBOS organized a Microdata Outreach Workshop (MOW) in March 2014 in Kampala to engage in dialogue with other data producers and key data users about microdata availability, access and use. The workshop brought together microdata users, researchers and policy evaluators from universities, research centers, INGOs, NGOs and other major data producers in the National Statistical System (NSS) to share and reflect on their experiences, practices and challenges in disseminating other forms of data such as administrative records. The workshop was valued by the microdata users and partner agencies, however, no such promotional events and outreach workshops are planned and budgeted for in the yearly program of the UBOS. SECTION 5: INSTITUTIONAL PROGRESS AND INTERNALIZATION OF THE ADP PROCESSES IN UBOS The Statistics Act 1998 of Uganda provides the legal authority to the UBOS as the principal data collecting and disseminating agency responsible for coordinating, monitoring and supervising the National Statistical System. It also allows the bureau to maintain a central repository of statistical documents and data. Furthermore, the Act provides the UBOS a mandate for promoting and being the focal point of cooperation with statistics users and providers at regional and international levels. In this sense, the bureau has a strong authority to compile, disseminate and promote statistical data use including microdata. In line with the mandates from the statistical act, the bureau established an online repository of microdata, the NADA and conducted a number of activities for archiving and promoting microdata use with support from the ADP. The UBOS NADA shares datasets from other agencies within the NSS. The bureau has a separate team/unit dedicated to microdata documentation and dissemination. The NSO staff have developed expertise to facilitate the data documentation workshop by themselves, and to maintain and update the NADA independently. However, no specific annual budget is allocated for microdata documentation and dissemination events. Likewise, no regular program and budget have been planned for data outreach and NADA promotional events. Furthermore, the drafting of microdata access policy which was started in 2013 has not been completed yet. However, there is the possibility that the bureau will be able to manage internal funding for microdata management and dissemination and that these activities will be institutionalized in Uganda in the near future. 9

11 Table 5: Budget allocation for ADP activities in the UBOS, Uganda Question Yes/No Amount USD Is there a dedicated line in the budget No to documentation in the NSO budget? Is there a dedicated amount in each No survey for documenting? Are consultants hired to document the No surveys using internal sources? Are there dedicated personnel that Yes document as part of their Job Description? If Yes, How many and the amount of time dedicated. No Are there staff who review the DDIs? How many and time dedicated? No Comments The ADP team in the UBOS involving staff and subject matter specialists from other related sections of the agency do participate in specified documentation. The documentation work has received support from the ADP/PARIS21. The review was done by an ADP expert in previous documentation works. Since institutionalization is one of the most important aspects to evaluate the effectiveness of the activities a SWOT analysis was undertaken (Chart 2). On balance, the UBOS has the potential to institutionalize data documentation and archiving, data dissemination policy design and revision, NADA dissemination and promoting data use through outreach workshops. The UBOS has already developed expertise in data documentation and NADA dissemination. Perhaps the biggest challenge to the UBOS will be the ability to sustain the ADP activities and to expand the best practices to other major data producing agencies in Uganda. 10

12 Sustainability of the ADP Chart 2: Strengths and Weakness of ADP Institutionalization in the Country Internalization of Metadata Management Process (Data Curation) STRENGHTS: UBOS has developed in-house expertise in microdata documentation, dissemination and promoting data use. Data dissemination through the NADA is well established and managed. There is a separte unit in the NSO dedicated to microdata documentation and NADA administraion. The UBOS has been developing a specific microdata dissemination policy. WEAKNESSES: Data documentation activity is done on an ad-hoc basis through workshops. No specific programs and funds are allocated to microdata documentation, disseminaton and promotional events in the yearly program. The UBOS metadata and NADA quality scores are poor. OPPORTUNITIES: The Statistical Act 1998 provides a strong authority to the UBOS for archiving, disseminating and promoting data (including microdata) in Uganda. A specific microdata access policy is under construction for instituationizing the microdata managment and dissemination activities. The UBOS has build capacity in microdata management and a specific team/unit has assigned to continue the activities. THREATS: No internal funding for microdata documentation, dissemination and promotional activities which may hamper institutionalization of the work in the UBOS. Discontinuity of ADP support to the UBOS could be a challenge to the UBOS for documenting new studies and the smooth functioning of NADA. SECTION 6: PERFORMANCE INDICATORS Ultimately the objective of the assessment is to evaluate the performance of the country based on key performance indicators (KPIs) constructed by taking 4 dimensions into account: Metadata quality; Data dissemination; Engagement with users; and ownership and internalization of the ADP activities. The analysis of the indicators shows a poor performance of the UBOS NADA. The NADA team is not active in responding to users queries quickly and none of the microdata for any of of the studies are accessible to users through NADA. Similarly to the NADA quality score, the overall DDI quality of the UBOS studies are also poor. The UBOS needs to improve according to both their DDI and NADA quality scores as pointed out in the DDI quality check summary sheet in Annex 2 and the NADA reviews sheet in Annex 3. 11

13 Table 6: Performance indicators, UBOS Particular Score DDI Review score 57.8 NADA Review score 48.2 Number of days to respond to query 10 Number of persons trained per survey 1.5 Percent Accessible Data 0 Days NADA on-line in the last 365 days 353 Days NADA on-line in the last 30 days 30 Number of surveys added last year 23 Number of surveys added last month 1 Documentation included in budget No NSO organized documentation workshop No NADA user statistics reported to management No SECTION 7: INNOVATION AND DATA REVOLUTION In the context of the country's statistical preparation for the post-2015 development agenda, especially for the SDGs, a questionnaire was administered to the NSO which was composed of two parts. In the first part, each of the GSBPM (see Chart 3) phases and sub-processes were listed and the NSOs were asked to indicate which processes posed the most challenges to their organisation, and which were those where support from external agencies and donors is needed. In the second part, questions were more focused on IT technologies that are considered important for the Data Revolution, asking the NSO to indicate which specific technologies required most support. The main purpose of this questionnaire was to gain a detailed understanding of the problems faced by countries in the full life-cycle of statistical data (and metadata) processing. The survey is based around the processes and sub-processes of the Generic Statistical Business Process Model (GSBPM). These processes cover the phases of design and building surveys, and the collection, analysis and dissemination of data. The information collected from NSOs were analyzed to see how new technological innovations, existing available software solutions and other global standards can be used to help overcome these problems. The main findings from the analysis of GSBPM phases for the UBOS Uganda are as follows: 1. Design: Needs assistance to establish an automated Statistical Business Register; develop an Earnings Index; and design a Production system for fixed capital formation. 2. Build: Needs assistance build an instrument for Environment statistics and statistical business process for Food Balance Sheet. 12

14 3. Collect: No assistance needed. 4. Process: Needs assistance for data harmonization and anonymization. 5. Analysis: Needs assistance for quality assurance of outputs. 6. Dissemination: Requires assistance for integrating data dissemination platforms; Info-graphics and Data visualization; and management and analysis of social media platforms. The main findings from the analysis of issues related to IT for Uganda are as follows: 1. IT infrastructure: Needs assistance from an external consultant for most of the applications. The annual budget investment for IT infrastructure in 2015 is UGX. 500,000, Data Management: In most cases, needs occasional assistance. Budget allocated for training is UGX. 10,000, Statistical Packages: Proficient in SPSS and STATA, but not in SAS and R. No budget is allocated for training in such packages. 4. Software tools: The UBOS has about 4 internal staffs who can use the tools PHP, Python, Perl and.net for programing. The annual budget allocated for training in the use of such tools is about UGX. 20,000, Web development: Able to manage intranet and setting up institutional website, but needs external assistance for exploiting tools for social media, using Google analytics, and web data collection. Annual allocated budget for training in web development is UGX. 10, Remote data collection: Tablets are already used for data collection. The NSO has staff proficient in the use of CS Pro,but needs assistance in using other devices and applications for remote data collection. SECTION 8: CONCLUSIONS AND RECOMMENDATIONS 1. Metadata quality assessment On average, the metadata quality of the UBOS studies are poor. Needs further improvements. The day and month are often missing from production date Abstract was sometimes too long or contained less relevant information Data Access entries do not always provide a citation or copyright The data collection, data processing and data appraisal sections of many studies are incomplete. The Sampling Error information should be added to the Data Appraisal section - most surveys did not provide any sampling error information. 13

15 2. Assessment of functionality of NADA and quality of service to microdata users Overall, the UBOS NADA performance is poor. Microdata are not accessible to users from the NADA. The microdata dissemination policy is not available; the Data Access information is misleading; the NADA page is not fully integrated into the main website; Filter by topics is missing; the Collection tab is not working and the NADA home page or About tab is missing. There is a need to improve NADA quality and functionality and provide online data access to users, at least as Licensed data files. 3. Status of Statistical act and Microdata dissemination policy The Uganda Statistics Act 1998 did not clearly mention the dissemination of microdata, and it does not restrict the dissemination of data at any form aggregated or microdata. The Act provides legal authority to the UBOS to define the data types and access conditions for promoting data use. It is necessary to finalize the drafting of the microdata access policy as soon as possible and improve online data dissemination processes to promote access of statistics to users in the most usable and friendly formats. 4. Data outreach and engagement with users Increase frequency and manage adequate internal funding for NADA promotional events and microdata outreach workshops. 5. Institutionalization of ADP activities The UBOS has developed expertise in data management and dissemination, but internal funding is still not ensured for these activities. A separate team/unit is in place in the UBOS for microdata management and NADA maintenance. The NADA is active on the UBOS website with metadata information of major surveys and censuses. The UBOS shows potential and the desire to fully internalize the ADP activities, but lacks a formal data dissemination policy and commitments from management. 6. Innovations and Data revolution GSBPM: the analysis of the UBOS s responses on GSBPM phases and sub-processes shows that the UBOS requires assistance in all phases of GSBPM, particularly for establishing an automated Statistical Business Register; building an instrument for Environment statistics and Food Balance Sheet; for data harmonization and anonymization; for data harmonization and anonymization; for integrating data dissemination platforms; and analysis and use of Big data. IT: Like GSBPM processes, the UBOS also needs external assistance for most IT related issues, particularly for using new technologies and applications like web data collection, use of new tools for social media, using new packages such as R, etc. On the other hand, the bureau also 14

16 Priority has internal expertise in using some applications such as SPSS, STATA, PHP, Python, Pearl,.net, and CS Pro. It has given importance to developing IT infrastructure which can be reflected in the annual budget investment from the UBOS to IT infrastructure development in 2015, which is about UGX. 500,000, Post2015 data development priorities NSDS data module and survey costing; SDMX and Big data training; managing citations and Google analytics, and harmonizing census, survey and civil registration data are on the top priorities of UBOS for post-2015 activities. SECTION 9: LOOKING FORWARD As part of the forward looking component of the assessment, a questionnaire was sent to each NSO to express their priorities for data development activities in view of the post-2015 development agenda. The questionnaire contained 14 options ranging from Data curation, Data harmonization, Dissemination policy design, User engagement, Promoting data use, Big data issues and the use of mobile data collection technologies among others (see Annex 4). The analysis of the UBOS report reveals that NSDS data module and survey costing; SDMX and Big data training; managing citations and Google analytics, and harmonizing census, survey and civil registration data are on their top priorities for post-2015 activities. On the other hand, a nodal analysis in data production chain and evaluating portal management, and using innovation inventory for problem solving are lower on their priority list. Chart 4: Activity prioritization for 2016 Activities NSDS data module and survey costing; SDMX training; Managing users and how to use citations and Google analytics; Harmonizing census, survey and civil registration data; Big data workshop. Data curation process; Promoting data use & portal management; Mobile data entry; Data visualization. Data dissemination policy design and revision; Approaching SDGs. Nodal analysis in data production and evaluating portal management; Innovation inventory for problem solving. 15

17 Annex 1: Summary of ADP implementation in Uganda ADP activities UBOS Year/no. Year ADP Started 2007 Number ADP interventions in the Country Metadata Production Workshops 2 National Data Archive (NADA) 1 User Outreach Workshops 1 Number of Institutions Trained in Data Documentation 7 Number of Institutions attending User Outreach Workshops 24 Number of persons attending ADP training events 74 Number of women trained in documentation 4 Number of Surveys Documented (Available on NADA) 48 Number of Microdata available in NADA 1 16

18 Annex 2: DDI quality score by metadata category Metadata category Average score Main comment for improvement Identification 78% ID did not always follow the specified convention Version 40% Overview 72% Coverage 74% Producers and Sponsors 89% Sampling 61% Data collection 54% Data processing 32% The day and/or month was often missing from production date Abstract was sometimes too long or contained less relevant information Universe was sometimes inaccurate or referred to units of analysis Some national surveys did not list a government entity as the primary investigator Sampling information was sometimes missing, particularly pertaining to sampling frame and weighting Information about pilot surveys and the basis of questionnaire design was sometimes missing Information about how questionnaires were received to be processed was sometimes not available Data appraisal 39% Sampling errors were not often provided Data access 27% NADA entries did not always provide a citation or copyright Data files 51% Weighting variables were not always identifiable Variables 54% Some variables did not have questions associated with them or repeated the label External resources 1 72% Questionnaires or reports were sometimes not available External resources 2 64% Descriptions of some resources were missing Metadata citation and use 63% The PDF version of the metadata was sometimes missing IHSN catalog 72% Some surveys were not available in the IHSN catalog 17

19 Annex 3: Comprehensive review of NADA # Question Yes = 1 No = 0 NA = - NADA visibility NADA Version: Is the NADA version 4.3? 0 2 Does the URL have a proper name? 1 3 URL Does the NADA link (target folder) display a name other than NADA? 1 The NADA link should be displayed prominently on the 4 main site. 1 5 Links from main website homepage to the NADA site: Links from the NADA site back to the home page: Integration with main website: The main website s link should be prominent on the NADA site. 1 6 The NADA page is fully integrated into the main website, matching the design and colors of the main site? 0 7 Branding: Is the institution brand prominently displayed on the NADA site? 0 8 Is NADA on the home page? 0 9 Is there a tab for policies and procedures? 1 10 Is there a tab which contains innovative ways to describe how to use NADA? 0 11 Does the policy and procedures tab contain information NADA tabs: on access? 1 12 Is there other tabular content that is useful? 1 13 The texts on the static pages should be grammatically correct and spelled correctly Is the formatting on the static pages clean and conducive to highlighting information? 1 15 Home Page Slideshow: Default slideshow on home page must be modified as per NSO NADA, or needs to be removed from home page 0 Check if the central data catalog image is available and 16 Catalog images: should not be default. Central data catalog and collections 1 must have images 17 About Menu Check if the about page information is available or tab information: before datasets must be removed 1 18 Is the contact address available? 1 19 Is there a telephone number available? 1 20 Contact Is the main NSO web site referenced? 0 21 Is there an institutional contact available? 1 NADA registration Registration links, & procedure: When you register did you get an approving your registration? Were you able to reset your password under the "lost password" option?

20 24 25 Login Page Header & footer: Login Page Access Policy: Login page header and footer must be same as rest of the pages. Login page access policy must be modified as per NSO privacy policy and link must be provided to the same. Search/Filter Does the NADA display a search by keyword? 1 Keyword search 27 Does the search by keyword work? 1 28 Does the NADA display a filter by year? 1 29 Does the filter work? 1 30 Does the NADA display a filter by Data Access? 1 31 Filters Does the filter work? 1 32 Does the NADA display a filter by topic? 0 33 Does the filter work? 0 34 Can you confirm that there is no filter by country? 1 Data dissemination policy 0 35 Data Dissemination policy Does the agency have a "Data Dissemination Policy" link on NADA? Data access 1 36 Data access type (DA/PUFs/Licensed/Data enclave): Check if the types of access are consistent with the institution's dissemination policy, access conditions and services provided. 37 Response Has the NSO responded to your ? 38 Response How many days to respond? Metadata & Citations 0 39 Is there a citations page? 0 Citations page: 40 Does the citation page actually display citations? 0 Innovation 0 Are there innovative additions to the NADA to help 41 Innovations 0 introduce a user to the catalog?

21 Annex 4: Country prioritization of data development activities in post 2015 agenda # Activity Priority (5 being the highest priority) NSDS Data Module and Survey Planning x 2 Nodal Analysis in data production chain and evaluating portal management 3 Innovation inventory for problem solving x 4 Principles of SDMX and training workshop x x 5 Data Curation Process Manual and Institutionalization of documentation 6 Comprehensive (General) data dissemination policies x x 7 8 Managing Users and how to use citations and Google Analytics Harmonizing data between Census, Survey, and Civil Registration x x 9 Harmonizing survey data and administrative data x 10 Promoting data use and portal use x 11 Using mobile data entry (Tablets) for surveys x Big Data Workshop (How to use Mobile phone data for migration) Data Visualization workshops using R and visualization libraries 14 Approaching the SDGs x Note: Put cross ( ) in the appropriate box of your selection. x x 20

22