Registry 9 Data and Management System Registry 9 is a complete and fully integrated statistical data and metadata management system using. Whether you require a metadata repository supporting a highperformance data dissemination system, data portal, or a fully managed collection system, Registry 9 Enterprise Edition provides the holistic data and metadata management needed. Registry 9 Community Edition focuses on structural metadata management making it ideal for organisations that require a single source of these metadata, whilst managing their own data repositories separately. And it s free to use. What is? stands for Statistical Data and Exchange. It is the international standard (ISO 17369) for describing and exchanging official statistics, although it can also be used in business domains where time-series statistics are involved. For instance, business analytics and predictive forecasting. What is? In this context, refers to two things: Structural principally defines how the statistical data is structured, providing an unambiguous description for its creation and interpretation. Reference provides additional information about the data which may help in its interpretation. Examples include details of the data collection methods used, and information about the data quality. 1
Product Overview Registry 9 provides a fully integrated solution for organisations needing to collect, store, manage and exchange statistical data and metadata using the standard. versions 1.0, 2.0 and 2.1 as well as legacy -EDI (GESMES) are supported. Registry 9 is implemented as a Java web application making it platform agnostic and allowing it to run equally well on both Windows and Unix environments. It is also highly scalable allowing installations from a single instance running on a desktop PC up to a multipleinstance load balanced cluster deployed on a high-availability cloud infrastructure. Figure 1: Registry 9 Core Functions Key Benefits Fully compliant with the standards designed to be backwardly compatible, and always compliant with the latest standard Complete integrated solution Platform agnostic - Java web application runs on both Windows and Unix Web GUI users need only a standard web browser Highly scalable Mission-critical support options 2
Registry 9 Detailed Functional Specification Structural Management Web Services API Structural Storage Security Integration Excel Data Reporting Templates Data Validation Data Transformation Structure Mapping Logging Command Line Interface Reference Collection and Dissemination Data Storage Web Developer API Web Services API Additional Data Formats Enterprise Deployment and Performance Structural metadata input / output (, EDI) Structural metadata maintenance Structure comparison Validation of structural integrity Time dependent constraints Subscription / notification API Data validation and data transformation API In-memory (volatile, but with option of loading structures from flatfile on boot) MySQL database support Microsoft SQL Server database support Oracle database support Security support Microsoft Active Directory support driven generation and validation of Excel data reporting templates Support for formats (plus completed Excel data reporting templates) Semantic compliance Structural compliance Conformance of data values with DSD Constraint conformance Detection of duplicate observations or series Mandatory attributes Transformation between formats Transformation between DSDs using Structure Mapping Structure mapping Standard application logging for diagnostic and debug purposes Registry Command Line command line interface for scripting and batch processing Reference metadata management Authoring of metadata Sets Reference metadata repository Data collection management Multiple connectors for linked data repositories ( web service, web hosted file, MySQL Microsoft SQL Server, Oracle) Data virtualisation (data portalling) Revisions to observations (vintages) Ability to publish data to different target environments (e.g. TEST, STAGING, PRODUCTION) MySQL database support Microsoft SQL Server database support Data Store (fast in-memory database) IM-JS JavaScript API Data submission, data deletion and reference metadata API Support for additional non- standard data formats (CSV, XSLX, RDF) Detailed auditing of changes to the data and metadata Server-side caching support Client-side caching support Horizontal scaling - load balance support Registry 9 Community Edition Registry 9 Enterprise Edition Security User authentication directory service Security Microsoft Excel Plugin browsing, creation and maintenance Data browsing, authoring and publication to the Registry XL Security and XL are bundled with both the Registry 9 Community and Enterprise Editions. 3
Key Use Cases structural metadata repository creating a controlled central source for structural metadata definitions Automated data collection automated electronic collection of data from one or more providers Manual data collection manual data collection using Excel spreadsheets or other flat-file formats Data validation data validation against the relevant Data Structure Definitions Data transformation to different formats transformation of data between versions and flat-file formats Data transformation between structures transformation of data to another Data Structure Definition Simple data dissemination dissemination of statistical data to a local or small-scale audience High performance data dissemination dissemination of statistical data to a global audience with demanding service availability and performance requirements Use Case Example: Simple Data Dissemination Here s an example of how Registry 9 Enterprise Edition can be used for simple data dissemination. User Authentication OR Security Data and metadata administrator Users may optionally access the API directly to query for data and metadata Power Users Public Dissemination Website General Users Data Production Data collection and aggregation CSV XSLX HTTPS Registry 9 Web Services Internet IM-JS IM-JS is a JavaScript library to help web application developers build rich dissemination sites without needing a detailed understanding of to drive data production repository database Virtual data warehouse MATLAB Public licence connectors are Statisticians available for R, Matlab, STATA and Data and other statistics package Scientists Figure 2: Using Registry 9 for simple data dissemination Data is collected, validated and loaded into Registry s virtual data warehouse. The Registry s web services API provides the flexibility to disseminate through a range of different channels. For general users, a public website can be built using Technology s IM-JS JavaScript library. IM-JS is included with the Registry Enterprise Edition and provides the developers with a simple way to build client-side applications without needing a detailed understanding of. Power users may choose to the access the API directly which conforms to the official ful specification (https://github.com/sdmx-twg/sdmx-rest). For statisticians and data scientists, public licence connectors for a range of stats packages including R, Matlab and Stats can be used to import data sets directly from the Registry s API for detailed analysis. 4
Integration with is a light-weight optimised API server that can integrate with Registry 9 Enterprise Edition to create robust distributed data collection and dissemination solutions. Dissemination For dissemination, acts as a optimised edge server that can be geographically distributed to create a highly available and scalable data dissemination system. Collection The Hub-and- architecture is a good solution for automating data collection from multiple providers. Each data provider runs an instance of which reports back to the central Registry hub. 1 Driven connects to the central Registry to pull down the structural metadata relevant to the data provider. The automatically builds a folder structure on its local file system to hold each data set the provider is required to report. Data Provider A Valid data Provider s Dissemination Website Registry 9 Central data and metadata management Hub Valid data Data Provider B Valid data Valid data 2 Simplifying Data Reporting To report data, the provider either drops a flat file into the relevant folder on the s local file system, or uses the s graphical user interface to load new data directly from their database. Data Provider C 4 Data Virtualisation The Registry Hub acts as a virtual data store providing data consumers with a single combined source of information. The Registry responds to queries by retrieving and integrating data on demand from the relevant s a process which is completely transparent to users. 5 Data Provider D 3 Automatic Data Registration validates the data using the structural metadata, and registers the new data with the Registry.
Deployment Options On-premises Registry 9 and Security are Java enterprise web applications that can be deployed on-premises on a variety of platforms A Java Runtime Environment (JRE) 1.7 or higher is required Each application is provided as a single Web Application Archive (WAR) file for deployment to a servlet container Apache Tomcat 7.0 or later is recommended products are tested on Microsoft Windows and Ubuntu Linux, but should also run successfully on other operating platforms that meet the Java and servlet container requirements above, Sun Solaris for instance Cloud hosted software-as-a-service managed by Technology As an alternative to on-premises deployment, Technology can offer a fully managed cloud hosted software-as-a-service solution using Amazon Web Services (AWS) Each client s services run on their own dedicated and purpose designed virtual infrastructure Deployment architectures including multi-geographic region and high-availability can be configured to requirements Licensing and Support Services Registry 9 Community Edition Registry 9 Community Edition is available under public licence. It s free to download and use. No support is provided, but new releases are made periodically which include fix bugs and enhancements. Support contracts are available for the Community Edition. Registry 9 Enterprise Edition Registry 9 Enterprise Edition is licenced per production instance on an annual subscription basis. A production instance is a single copy of the software (the WAR file) deployed in a production environment. If you re running Registry 9 Enterprise Edition in production, you can also deploy non-production instances for staging, testing and experimentation at no additional cost - within certain limits. The Registry 9 Enterprise licence also covers the following components: Security XL Registry 9 Command Line IM-JS In standard configuration, Registry 9 allows automated collection of data from up to three data providers. Additional Data Provider option licences are required if you need to collect data from more than three providers. For the purposes of licencing, a Data Provider is defined as a Data Provider registered in the system that has one or more Provision Agreements attached. Standard support is included which consists of on-demand error correction, plus the supply of regular bug-fix and enhancement software released. Enhanced support packages are also available which include and information modelling expert advice, operational support, on-demand product enhancements and training. 6
For More Information Pricing Registry 9 Community Edition is free to use http://metadatatechnology.com/registry9. If you need a support contract for the Community Edition, please contact us to discuss your requirements and prices. Registry 9 Enterprise Edition solutions are designed to meet clients specific requirements. Please contact us to discuss your requirements, licensing, support options and prices. To learn more about http://metadatatechnology.com/sdmx.php. +44 1483 418 058 info@metadatatechnology.com Technology Ltd Floor 2 Solly s Mill Mill Lane Godalming GU7 1EY United Kingdom Registry and other Technology Ltd product or service names are registered trademarks of Technology Ltd in the United Kingdom. indicates United Kingdom registration. Other brand and product names are trademarks of their respective owners. Copyright 2017, Technology Ltd. All rights reserved. This document is provided for information purposes only and does not constitute a formal specification or offer. Errors and omissions excepted. 20171003 7