Lesson 3 Ways of Organising the Data. Chapter-5 L03: "Internet of Things ", Raj Kamal, Publs.: McGraw-Hill Education

Transcription

1 Lesson 3 Ways of Organising the Data 1

2 Data Organising Flat file Spreadsheet Database Relational database (only one scheme) 2

3 Data Organising Multiple schemas Data SQL Database Not Only SQL or NOSQL Relational Time Series service database 3

4 Internet Firewall Assemble events from the IoT into logic flows in Database Firewall Internet Firewall Database Firewall (Collect + Assemble +Manage) for analytics and Intelligence) Informix Time series service Device Register and connect Cloud Infrastructure Data Centre Mgmt. Big Data Store Server Mgmt Analytics and Intelligence Manage Device Identity Mgmt & access Mgmt. Acquire, Organize and Analyse applications, services, enterprise and business processes and Intelligence Data Centre Mgmt. Big Data Store Server Mgmt In-memory Analytics and Business Intelligence Collect from things. Manage time-series view of data Manage connections and Subscriptions NoSQL Relational Time Series service Spatial Storage and Real Time Analytics Mgmt. Device Access Mgmt Device Identity Mgmt Device Mgmt. Data Routing & Analysis Key Value Data Store Database RDBMS Enterprise Integration Complex Applicati ons Integratio n and SoA Consumer/Business (a) SoA: Service Oriented Architecture (b) Fig. 5.1 (a) Connect + Collect + Assemble +Manage IBM conceptual framework (b) Manage, Acquire, Organise and Analyse Oracle s framework in the IoT Architecture 4

5 A collection of data Database and Relational Database The collection organised into tables Relational database: a collection of data into multiple tables which relates to each other through special fields. 5

6 An Example of Application, service and process common relational database RDB AVCM tables Table A for ACVMs information, and pending service requests Num1, Num 2, Num2, Num 3 and Num 4 for the five flavours available at an ACVM. Table B is for ACVMs Fill Request Information, and C for chocolates Fill service actions 6

7 RDB AVCM Table A ACVMs information Machine ID Add -ress Region Installation Date Maintenance Schedule Fill Service Addr -ess Pending Req. Num 1 Pending Req. Num 2 Pending Req. Num 3 Pending Req. Num 4 7

8 RDB AVCM Table B ACVMs fill request information Service Request Num Machi ne ID Request Receipt DateTi me Num. FL1 Req. Num. FL 2 Req. Num. FL 3 Req. Num. FL 4 Req. Num. FL5 Req. 8

9 RDB AVCM Table C ACVMs fill service actions Service Request Num. Service DateTime Num. FL1 Sent Num. FL 2 Sent Num. FL 3 Sent Num. FL 4 Sent Num. FL5 Sent 9

10 Object oriented database (OODB) Object oriented database (OODB) is collection of objects Saved objects in objected oriented design 10

11 Database Management System A software system, which contains a set of programs specially designed for creation and management of Data stored in a DB. 11

12 Database transaction The execution of a specific set of operations on a DB Transactions performed on a DB. 12

13 DB Transaction Models The transactions must maintain the transaction atomicity Consistency, Isolation and Durability. 13

14 Relational Database transaction The execution of interrelated instructions using relations A sequential execution of a specific set of relational operations on relational DB 14

15 Query and Query Processing An Application/Service/Process seeking a specific data set from a database/relational database Query processing means using a process Getting the results of the query made from a DB 15

16 Distributed DB A collection of logically interrelated, cooperating databases over a computer network. Distributed DB system has ability to access remote sites and transmit queries. 16

17 Distributed Query Processing Query processing operations in distributed databases on same system or networked systems 17

18 Structured Query Language (SQL) A language for data access control, schema creation and modifications. Language for managing the RDBMS. Language for data definition, data manipulation and data control instructions 18

19 Not Only SQL or NOSQL No integration with applications that are based on SQL Used in Cloud Data Store NOSQL consists of Classes of non-relational data storage systems Flexible data models, and Multiple schemas. 19

20 Time series data An array of numbers indexed with time (date-time or a range of date-time) 20

21 Decision on Real Time Data Fast when query processing in live data (streaming) has low latency The decision on historical data is fast when interactive query processing has low latency. 21

22 Summary We learnt Flat File Spreadsheet DBMS, RDBMS and OODB SQL or NOSQL Time Series Data Real Time Data 22

23 End of Lesson 3 on Ways of Organising the Data 23