Lab Assignment 2. CIS 612 Dr. Sunnie S. Chung. Creating a User Defined Type (UDT) and Create a Table Function Using the UDT Data Type

Transcription

1 CIS 612 Dr. Sunnie S. Chung Lab Assignment 2 Creating a User Defined Type (UDT) and Create a Table Function Using the UDT Data Type In a modern web application such as in a Data Analytic/Big data processing system, Text Data Processing usually requires two (or three) Phases: Phase 1: One of the most common data preprocessing of Big Data is parsing/processing unstructured/semi structured text data such as Web Server Logs or Texts in HTML/XML/JASON to extract information you need to store in a structured data format such as CSV/JASON/XML file format. Creating an Inverted Index or Word Count from webpages/electronic books is another example of such text processing as well. Phase 2: Once extracted information is stored as a structured file in CSV/TSV or Key Value Store (JSON), the second phase of data processing is to create permanent Database Tables or Key Value Store Collections in Parallel Database Systems that will be used for further complex analysis such as Information Retrieval or Data Analytic processes. Most of the existing advanced SQL database systems allow to create databases tables from complex structured objects such as in a CSV/JASON file format using database programming features like UDT, UDF, or Table Function in host languages. In this Lab2, you are exploring such database features by creating your own Data Type and Table Function for Phase 2 processing in a SQL Server from objects like a CSV file. For this Lab2, you can use any language of your choice with any RDBMS Server that supports UDF, UDT, Table Function with any external programming language. Some suggestions would be: 1. C++/C# in MS.NET Framework with MS SQL Server 2. Java/JDBC with Oracle RDBMS Server

2 Part 1: Although most of database servers already have a built in Geo Point Type, we want to study how to make such a built in data type in a database by implementing it your own through a simple example. 1. Creating User Defined Type GeoPoint and Table Function Dept_GeoLocations that Uses GeoPoint type 1. Create User Defined Type named PointType as follow: a) Write the body of UDT PointType in your choice of a language like C# or Java Structure: x // x coordinate y // y coordinate ToString //x:y Methods: Parse an input string x:y, Get each member / Set each Member, Check IsNull Example: if (s.isnull) { return Null; } b) Create UDT PointType to be able to be used in the following two script c) Test with the following two scripts:

3 Example use of PointType: This is a possible test script that uses the UDT you created. Test Script1: CREATE TABLE dbo.tablepoints ( ID int IDENTITY(1,1) PRIMARY KEY, Pnt PointType) INSERT INTO dbo.tablepoints (Pnt) VALUES (CONVERT(PointType, '3:4')) INSERT INTO dbo.tablepoints (Pnt) VALUES (CONVERT(PointType, '-1:5')) INSERT INTO dbo.tablepoints (Pnt) VALUES (CAST ('1:99' AS PointType)) SELECT ID, Pnt.ToString() as StringPoint, Pnt.X as X, Pnt.Y as Y FROM dbo.tablepoints Test Script2: CREATE TABLE Locations (grid_location dbo.pointtype) INSERT INTO Locations (grid_location) VALUES ('3:2') INSERT INTO Locations (grid_location) VALUES ('-1:1') INSERT INTO Locations (grid_location) VALUES ('-1:-1') INSERT INTO Locations (grid_location) VALUES ('-8:-9') INSERT INTO Locations (grid_location) VALUES ('4:-9') view the data SELECT * FROM dbo.locations SELECT grid_location.x AS "X", grid_location.y AS "Y",

4 grid_location.tostring() AS "Point" FROM Locations update some rows UPDATE dbo.locations SET grid_location.x = 5 WHERE grid_location.y < 0 SELECT grid_location.x AS "X", grid_location.y AS "Y", grid_location.tostring() AS "Point" FROM Locations;

5 Part 2: 2. Create Table Function that returns a table Dept_GeoLocations as follow: Dept_GeoLocations (Dnumber int, Dlocation varchar(15), Geolocation PointType) has a) All the data from the table Company.Dept_Locations in your database Company and b) One more additional column named GeoLocation and its type is PointType you created in 1). c) GeoLocation column has ('3:2') ('-1:1') ('-1:-1') ('-8:-9') ('4:-9') for each corresponding tuple in Company.Dept_Locations table Useful Resources: Creating UDT function Registering UDT function Other References 3. Lab OUTPUT for Part 1 and Part 2: - For the Lab Output for 1) UDT, Submit Screen Shots of each result of each test script given above - For the Lab Output for 2) Table Function, Submit Screen Shots of each result of the following query: Select * From Dept_GeoLocation;

6 Extra Credit Lab An application tool built with such complex data type is ArcGIS. Implement a visualization map using ArcGIS API for the Crime Location data set (the first data set given on the class webpage) from the NIJ site. ecastingchallenge#data ArcGIS: You can use any language of your choice for this. Submit your report with your codes and the output - visualized map.