Progetto SISSI SAS. Data warehouse on administrative data of enterprises. Giovanna Del Mondo. Roma, 30/4/99 - n 1

Transcription

1 SAS Progetto SISSI Data warehouse on administrative data of enterprises Giovanna Del Mondo Roma, 30/4/99 - n 1

2 Agenda! ISTAT Focus Point.! Approach!Architecture / Process!Data base!web Fruition! Demo!Data warehouse Administration!Fruition WEB using SAS/Intrnet-Dab and AppDevStudio!DW Reporting using Enterprise Reporter Roma, 30/4/99 - n 2

3 ISTAT FOCUS POINT.! Only source of certified data.! Organization of data for the analysis and the distribution according to default criteria of classification.! Extraction of an universe of enterprises in interactive way.! Publication of tables.! Distribuition of datathe data using most modern technologies in checked way. Roma, 30/4/99 - n 3

4 Development of process.! INTEGRATION!USING A UNIQUE WORK ENVIRONMENT.! CONTROL!SUPERVISION OF ALL WORKS USING ONLY ONE CONSOLE.! REPLICABILITY!USING A METHODOLOGY ALSO AVALIABLE FOR OTHERS INVESTIGATIONS, RELEASING THE NECESSARY COMPETENCE TO MANAGE THE PROCESS. Roma, 30/4/99 - n 4

5 Logical architecture of the Datawarehouse Input Data Historical Data Summarized Data Applications Roma, 30/4/99 - n 5

6 Process Management : (SAS Warehouse Administrator) Server SISSI Data base (ORACLE ) Internet Local Uffices : Browser Console Web server SAS IntrNet DB SAS for querry Dataset SAS Mddb(s) Multidmensional Navigation Task Firewall Central Uffices : Browser Web server Intranet SAS IntrNet Roma, 30/4/99 - n 6

7 Management of the Process of Construction of the Datawarehouse.! Access to raw data.! Trasformation.! Storicizzazione! Insertion in a structure of warehouse.! Aggregation for the varius demands. SAS/Warehouse Administrator Roma, 30/4/99 - n 7

8 Roma, 30/4/99 - n 8

9 Roma, 30/4/99 - n 9

10 Data summarizing for fruition! Perfomances ottimization! Wizard for metadata creation(fruition rules) SAS/MDDB Server Roma, 30/4/99 - n 10

11 WEB Fruition! Only requisite: WEB Browser.! Dynamic Query.! Graphics.! Export on environments of individual productivity. SAS/IntrNet Roma, 30/4/99 - n 11

12 Roma, 30/4/99 - n 12

13 Roma, 30/4/99 - n 13

14 Roma, 30/4/99 - n 14

15 Roma, 30/4/99 - n 15

16 Roma, 30/4/99 - n 16

17 Roma, 30/4/99 - n 17

18 Roma, 30/4/99 - n 18

19 Demo! Datawarehouse Administration.! WEB fruition.! Examples. Roma, 30/4/99 - n 19

20 ANY QUESTION? Roma, 30/4/99 - n 20

21 The Date Warehouse for the diffusion of the information on the enterprises Giovanna Del Mondo - Alberto Sorce Italian National Statistic Institute builded but cut out on the specific demands of the consumer. In other terms, it is allowed to the users to analyze data in different ways, without being bounded to a limited series of default prospectuses. Abstract With the globalizzazione of the market the necessity to monitor the rapid transformation of the system of the Italian enterprises becomes more and more strongly. For this the Istat has realized SISSI, the System Informative Statistician On the Enterprises, developed inside the central Direction of the statistics on institutions and enterprises. The introduction of the technologies of date warehousing in the treatment of the contained data in the files Istat intends to offer a tool of job that allows to extract necessary information to understand the fundamental aspects of the productive system to the consumers. The realization of the project follows an approach type incremental that extends of time in time to satisfy the more imminent informative demands, beginning from a sketch global concettule of the date warehouse. On the base of the date warehouse of first level has been created the gives mart (hypercube) necessary for a series of applications of navigation both in formality client/server that street Web, among which: Navigation multidimensional on the structural data of the enterprises with the possibility to extract the information of detail realized with SAS/Intrnet and EIS; Navigation for the stratification of the universe of enterprises realized with AppDev Studio; Reporting and it stamps on the structure you date some warehouse: This type of application allows the exploration of the data not already Introduction The Date Warehouse for the diffusion of the information on the enterprises is based on a wider project named SISSI. SISSI is the Informative Static System on the Enterprises, developed inside the Central Direction of the Statistics on Institutions and Enterprises (DCII) of the ISTAT. It represents a multidimensional and multifunctional structure that covers all the enterprises related information produced by the DCII. The development of an Integrated Informative System is born from the necessity to coordinate the production of the statistic data with the purpose to get the integration of all the available information inside the Direction related to the activity of every single enterprise (or agricultural firm). The existence of a System allows, besides, to avoid the useless duplication of the data, with consequent notable optimization in the process of harvest and analysis of the same. The possibility to have memorized in an only structure logic all the statistics of enterprise opens revolutionary perspectives in the way of conducting the statistic investigations, to check the acquired data, to analyze them and to spread the results both inside the institute and toward the external world. The system SISSI contains an only registry file of information and data on the enterprises, derivante both from the integration of the files registry presents in Istat (Asia, Sirio, Nai), both from the deriving registry data from the investigations; the data have been integrated and normalized in the

22 database Oracle so that to have an only source storicizzata of the enterprises. The DB Oracle has been planned for satisfying the demands of filing of the data, for which the demand was born to reorganize the data in way optimized for the extraction of the information. After an analysis of the base Oracle dates, you/he/she is passed to the planning and the realization, according to an incremental approach, of the date warehouse for the diffusion of the information on the enterprises. I/you/they have finally been realized the Data Mart and the applications that allow client/server both away web. Date Warehouse Construction and management From a scheme report implements her for the database oracle you/he/she is passed to the construction of a star-scheme constituted by an only fact-table on the enterprises container variable of analysis what the billing, employees' number, importation and exports and from the different dimensions type geographical, economic, type and dimension of the enterprise. Beginning from this it dates warehouse of first level, I/you/they have been developed of the date-mart to allow the distribution of the information through the applications described subsequently. The whole process of construction and management of the date warehouse is is realized through the use of the software SAS/Warehouse Administrator and it foresees different phases: Accesso to the data native presents in the db oracle Trasformazione STORICIZZAZIONE Inserimento in a structure of warehouse Aggregazione for the varied demands applicative Analysis and construction of a multidimensional (MDDB) database The realization of a DW is made in forecast of a structure that united statistic data already contain for optimizing the performances in the different phases of analysis. For the realization of a MDDB it is necessary to pick up information related to the model of the data, to identify what the variable of analysis are and what those of classification, to individualize the relationship and the type of representation of it. Further to have query with brief times of answer, the creation of a MDDB driven by the metadatis he/she offers the possibility of an updating incrementake and immediate. Extraction of the enterprises submitted to investigation Using SAS/Intrnet and the toolses of SAS Institute I/you/they have been developed the applications of navigation multidimensional of the data in environment Internet that allow not only to have statistic tables on the enterprises statistics on the enterprises but they also allow the selection and extraction of the information of detail type the address or the telephone of the enterprise through a simple browser without the necessity to install additional software.

23 software Enterprise Reporter that allows the user to manage all the working phases that bring to the final paper publication and, particularly, it allows the elaboration of a lot of information in brief time with the warranty to get a correct information. Roma, 30/4/99 - n 17 Conclusions The ISTAT, in collaboration with SAS Institute, has realized a whole end-to-end process that starts from the building of a Data Warehouse and it ends with web applications of multidimensional navigation, selection and publication of statistic tables. Roma, 30/4/99 - n 18 Stratification and random sample extraction Once extracted the survey population, through an AppDev Study application it is possible to determine the layers, to calculate the sample numerousness and to choose his own enterprises sample, on the base of statistic indicators. Reporting For the data diffusion phase it has been developed some reports using the