SolarCloud Rapid Data Loggingfrom a Solar Power Plant

Size: px
Start display at page:

Download "SolarCloud Rapid Data Loggingfrom a Solar Power Plant"

Transcription

1 SolarCloud Rapid Data Loggingfrom a Solar Power Plant AUTHOR: TEODOR TALOV COP 4908 Independent Study Instructor: Janusz Zalewski Florida Gulf Coast University Fort Myers, FL July25, 2013 Final Draft SolarCloud Rapid Data Logging 1

2 1. Introduction The objective of this project is to provide an overview of a non relational database using MongoDB as an example, compare its performance with MySQL, and test its operations for data storage from the solar panel node, as a case study. The rest of the document is structured as follows: Section 2 describes the principles of storing data in MongoDB; Section 3 presents the comparison methodology, and Section 4 describes a case study of the Solar Plant. Section 5 describes some comparison in performance between MongoDB and MySQL. Both databases are compared with different length of records as well as different number of records 10, 100, 1000, respectively. Finally, Section 6 outlinessome conclusions. SolarCloud Rapid Data Logging 2

3 2. MongoDB 2.1. Overview of MongoDB MongoDB is a shared nothing, document oriented database management system. Unlike relational database systems, which store all data in tables defined by a schema, MongoDB stores data in schema less JSON documents (Fig 1). Users perform queries against the database using procedural API calls, rather than using a declarative language like SQL. It combines the ability to scale out with many of the post powerful features of relational databases, such as secondary indexes, range queries, and sorting. MongoDB is also incredibly featureful: it has tons of useful features such as built in support for MapReduce style aggregation and geospatial indexes. Fig 1. Example of MongoDB document structure Mongo is a document oriented database, not a relational one. The primary reason for moving away from the relational model is to make scaling out easier, but there are some other advantages as well. In a relational database scaling out becomes challenging once the cluster reaches capacity and adding more storage becomes necessary. Additional complexity is introduced by adding more servers because in a relational database is not able to determine how to interact with multiple servers. Most common scenario is masterslave replication, which works very well for applications relaying heavily on Read operations, but it is not very effective for Write heavy applications, simply because there SolarCloud Rapid Data Logging 3

4 must be only one node, the master node, containing the complete database, which gets copied over to all slave nodes. In contrast, MongoDB, and most NoSQL databases for that matter, come with built in scalability. Specifically, once capacity is reached, more servers can be added to the cluster, but MongoDB will handle how they are used automatically. It can balance data and load across a cluster, redistributing documents automatically. When they need more capacity, they can just add new machines to the cluster and let the database figure out how to organize everything. The basic idea is to replace the concept of a row with more flexible model, the document. By allowing embedded documents and arrays, the document oriented approach makes it possible to represent complex hierarchical relationships with a single record. This fits very naturally into the way developers in modern object oriented languages think about their data. MongoDB is also schema free: a document s keys are not predefined or fixed in any way. Being schema free does not mean that there is no schema to the database. To the contrary, there is schema to the database, but it is not strictly enforced by MongoDB. Without a schema to change, massive data migrations are usually unnecessary. New or missing keys can be dealt with at the application level, instead of forcing all data to have the same shape. This gives developers a lot of flexibility in how they work with evolving data models. MongoDB was designed from the beginning to scale out. [4] MongoDB also provides most if not all features that a relational databases provides such as indexing, stored procedures, aggregation, etc. Specifically, indexing supported by MongoDB is generic secondary indexes, allowing a variety of fast queries and it provides unique, compound, and geospatial indexing capabilities as well. Furthermore, the stored SolarCloud Rapid Data Logging 4

5 procedures that MongoDB supports are simply JavaScript functions. For aggregation MongoDB supports MapReduce amongst many other features such as aggregate, group, etc. Concerning security MongoDB has provided multiple mechanisms such as, Access Control and Network Security. Furthermore, 10gen [3] provides a security guide which takes a Defense in Depth approach to securing MongoDB deployments and addresses a number of different methods for managing risk and reducing risk exposure.the intent of a Defense In Depth approach is to ensure there are no exploitable points of failure in the deployment that could allow an intruder or untrusted party to access the data stored in the MongoDB database. The easiest and most effective way to reduce the risk of exploitation is to run MongoDB in a trusted environment, limit access, follow a system of least privilege, and follow best development and deployment practices Installation Guide to MongoDB [3] To install MongoDB the following steps have to be followed: Add 10gen package to source.list.d by running the following commands: sudo apt-cache search mongodb mongodb mongodb-clients mongodb-dev mongodb-server Add the following line to /etc/apt/sources.list.d/mongo.list: deb dist 10gen SolarCloud Rapid Data Logging 5

6 Note: If the file does not exist, create it Add GPG Key in order to verify the authenticity of the MongoDB repository by running the following command: sudo apt-key adv --keyserver keyserver.ubuntu.com --recv 7F0CEB Update Ubuntu by running the following command: sudo apt-get update Install MongoDB by running the following command: sudo apt-get install mongodb-10gen Verify that MongoDB is running by executing the following command: mongo If MongoDB is running, the screen is shown on Fig. 2 SolarCloud Rapid Data Logging 6

7 Fig. 2 MongoDB Shell The application is hosted on the Key West server, which has Ubuntu 12 installed as operating system. The serverr can be accessed using the following credentials: or keywest.cs.fgcu.edu/ username: keywest password: same as VMWARE host password Note: keywest user has administrative privileges (sudoer) SolarCloud Rapid Data Logging 7

8 3. MongoDB vs. MySQL comparison methodology General concepts have to be evaluated in both MongoDB and MySQL. Additionally, features in MongoDB need to be compared to their respective features in MySQL and then their performance evaluated. Performance is evaluated by running heavy database queries, , , records respectively, for each of the features outlined below. Finally, operators and syntax such as > and $gthave to be compared in both MySQL and MongoDB 3.1. General Concepts Database Database is an organized collection of data. Both MySQL and MongoDB use databases to store data. MySQL MySQL is an open source relational database management system. Information in a MySQL database is stored in the form of related tables. MySQL does have multiple storage engines such as MyISAM and InnoDB. MongoDB A physical container for collections. Each database gets its own set of files on the file system. A single MongoDB server typically servers multiple databases. MongoDB does not support different storage engines Table vs. Collection MySQL Since MySQL is relational database management system (RDMS) all the data is stored in tables, which are organized according to the relation model. The relational model for database management is a database model based on first order predicate logic, first formulated and proposed in 1969 by Edgar F. Codd. In the relational model of SolarCloud Rapid Data Logging 8

9 a database, all data is represented in terms of tuples, grouped into relations. A database organized in terms of the relational model is a relational database. MongoDB Unlike MySQL MongoDB does not use tables, but it uses COLLECTIONS. Collections are groupings of BSON documents (A serialization format used to store documents and make remote procedure calls in MongoDB. BSON is a portmanteau of the words binary and JSON. Think of BSON as a binary representation of JSON (JavaScript Object Notation) documents). Collections do not enforce a schema, but they are otherwise mostly analogous to RDBMS tables. The documents within a collection may not need the exact same set of fields, but typically all documents in a collection have a similar or related purpose for an application. All collections exist within a single database. The namespace within a database for collections are flat Row vs. Document MySQL Since MySQL is a relational databases, it uses rows. In the context of a relational database, a row also called a record or tuple represents a single, implicitly structured data item in a table. In simple terms, a database table can be thought of as consisting of rows and columns or fields. Each row in a table represents a set of related data, and every row in the table has the same structure. For example, in a table that represents companies, each row would represent a single company. Columns might represent things like company name, company street address, whether the company is publicly held, its VAT number, etc.. In a table that represents the association of employees with departments, each row would associate one employee with one department. [5] SolarCloud Rapid Data Logging 9

10 MongoDB stores structured data as JSON like documents, using dynamic schemas (called BSON), rather than predefined schemas. In MongoDB, an element of data is called a document, and documents are stored in collections. One collection may have any number of documents. [3] Column vs. Field MySQL MySQL uses columns. In the context of a relational database table, a column is a set of data values of a particular simple type, one for each row of the table. The columns provide the structure according to which the rows are composed. [5] MongoDB On the other hand MongoDB uses fields. A name value pair in a document. Documents have zero or more fields. Fields are analogous to columns in relational databases. [3] Indexes Index is a data structure that improves the speed of data retrieval operations on a database table at the cost of slower writes and the use of more storage space. Indexes can be created using one or more columns of a database table, providing the basis for both rapid random lookups and efficient access of ordered records. Both MySQL and MongoDB index data in the same way Table joins vs. embedded documents and linking Traditional SQL databases use table joins. A table join combines records from two or more tables in a database. It creates a set that can be saved as a table or used as it is. A JOIN is a means for combining fields from two tables by using values common to each.mysql resolves all joins using a single sweep multi join method. This means that MySQL reads a row from the first table, and then finds a matching row in the second SolarCloud Rapid Data Logging 10

11 table, the third table, and so on. When all tables are processed, MySQL outputs the selected columns and backtracks through the table list until a table is found for which there are more matching rows. The next row is read from this table and the process continues with the next table.mongodb does not support joins. In MongoDB some data is denormalized, or stored with related data in documents to remove the need for joins. However, in some cases it makes sense to store related information in separate documents, typically in different collections or databases Primary key The PRIMARY KEY constraint uniquely identifies each record in a database table.a record s unique, immutable identifier. In anmysql, the primary key is typically an integer stored in each row s id field. In MongoDB, the _id field holds a document s primary key which is usually a BSON ObjectId Aggregation Aggregate functions perform a calculation on a set of values and return a single value. The data that needed is not always stored in the tables. However, it can obtain by performing the calculations of the stored data when you select it. Except for COUNT, aggregate functions ignore null values. Aggregate functions are frequently used with the GROUP BY clause of the SELECT statement. Both MongoDB and MySQL use aggregation similarly. However, MongoDB performs aggregation via its aggregation framework Programming Features This section is a side by side comparison of MySQL versus MongoDB. It compares their SolarCloud Rapid Data Logging 11

12 functions such as Select vs. Find, Update, Delete, and other operations. It also provides syntax comparison for both database types MySQL and MongoDB Select vs. Find operations MySQL the SQL select statement returns a result set of records from one or more tables [5]. A select query looks like: SELECT * FROM users MongoDB uses find in order to retrieve data sets by given criteria. A find statement looks like: db.users.find() Insert operations MySQL uses its insert statement in order to add rows to a table. An insert statement as follows: INSERT INTO users(user_id, age, status) VALUES ("bcd001", 45, "A") MongoDB uses its insert statement in order to insert a record to a document. An insert statement looks like this: db.users.insert( { user_id: "bcd001", age: 45, status: "A } ) Update operations SolarCloud Rapid Data Logging 12

13 MySQL uses its update statement in order to update existing records in a table. An update statement looks like this: UPDATE users SET status = "C" WHERE age > 25 MongoDB uses its update statement in order to update existing records in a document. An update statement looks like this: db.users.update({ age: { $gt: 25 }},{$set:{ status: "C" }},{ multi: true }) Delete operations MySQL uses its delete statement in order to delete existing records from a table. An delete statement looks like this: DELETE FROM users WHERE status = "D" MongoDB uses its delete statement in order to delete existing records from a document. An delete statement looks like this: db.users.remove( { status: "D" } ) 3.3. Operators Logical Operator AND MySQL logical AND operator compares two expressions and returns true if both of the expressions are true. In MongoDB a logical AND joins two clauses and returns all documents that match the conditions of two clauses Logical Operator OR MySQL OR operator compares two expressions and returns TRUE if either of the SolarCloud Rapid Data Logging 13

14 expressions is TRUE. In MongoDB a logical ORoperator, joins query clauses with all documents that match the conditions of either clause Logical Operator NOT MySQL NOT operator reverses or negates the input. In MongoDB NOT inverts the effect of a query expression and returns documents that do notmatch the query expression 3.4. Essential Functions Order By vs. Sort In MySQL the SQL ORDER BY clause allows sorting records in a result set. The SQL ORDER BY clause can only be used in SQL SELECT statements. In MongoDB sort() is returns a cursor with documents sorted according to a sort specification Where In MySQL SQL WHERE clause allows you to filter the results from an SQL statement SQL SELECT statement, SQL INSERT statement, SQL UPDATE statement, or SQL DELETE statement. In MongoDB $where returns that match documents that satisfy a JavaScript expression Max In MySQL MAXfunction returns the maximum value of an expression. In MongoDB max() specifies a minimum exclusive upper limit for the index to use in a query SolarCloud Rapid Data Logging 14

15 Min In MySQL MINfunction returns the maximum value of an expression. In MongoDB min() specifies a minimum exclusive upper limit for the index to use in a query SolarCloud Rapid Data Logging 15

16 4. Case Study 4.1. Overview FGCU s Solar Plant (Fig. 3) takes up 760 acres of its campus, which makes it the second larges solar installation located in a University campus in the U.S. [1]. The plant began its operations in 2009 and it is expected that the 2 megawatt Solar Plant will generate 15% of the electricity that the University consumes [2]. Fig 3: Solar Plant Eagle View Additionally, the Solar Plant includes a separate small site where different panels can be tested and demonstrated (Fig. 4). SolarCloud Rapid Data Logging 16

17 Fig 4. Experimental Solar Plant at FGCU The smaller installation is very safe and convenient for experiments, since it does not interfere with the main solar plant, but provides the same exact configuration as the main plant. This is, indeed, the site where all upcoming experiments can be conducted [6]. 4.2 Problem Description The power current generated by the Solar Plant is not steady, thus energy fluctuations occur. It is mandated by the State of Florida that power current must be steady at all times. Becausee of its mandate, the Solar Plant cannot contribute power to the power grid without installing additional hardware (back up that problem, data must be analyzed at much higher frequency than it is generators), which willl kick in whenever the current is not steady. In order to solve currently supported by the existing system. The current system has the ability to acquire data from the Solar Plant every 1 minute. However, the desired frequency for data analyses is every 1 second. Therefore, a software application has to be developed that will acquire data with the SolarCloud Rapid Data Logging 17

18 desired frequency. Fig. 5Solar Plant data acquisition diagram The primary objective of the project is to acquire data from the experimental solar plant in 1 second intervals and record these data into a database. Furthermore, the data have to available on the Internet and accessible upon successful authentication. The proposed system outlined in Fig. 5, acquires data every second.the SolarCloud softwareresiding on the webserver sends a request to the CR 1000 data logger via its Ethernet Interface NL 120.As a response the CR 1000 sends back a JSON or XML object containing a data structure with measurement results, which is stored in a database by SolarCloud software. The end user (public client) will be able to generate reports based on the data that are already stored in the database. 4.3Project Objective and Technology Data Logger SolarCloud Rapid Data Logging 18

19 To acquire data from the solar plant every second as opposed to every minute as in current system. For data acquisition from the Solar Plant a Campbell Scientific CR Data logger (Fig. 6) will be used [7]. Fig 6: Campbell Scientific CR 1000 Data logger The CR1000's module acquires measurement from sensors, drives direct communications and telecommunications, reduces amount of data, controls external devices, and stores data and programs in on board, non volatile by the sealed, stainless steel canister. A battery backed clock assures storage. The electronics are shielded from RF interference and glitch protected accurate timekeeping. The module can simultaneously provide measurement and communication functions[7]. Campbell Scientific CR 1000 Data logger has a built in Application Programming Interface (API) which allows third party applications to authenticate, request data, and receive a response in an XML or JSON format. In order to allow the CR1000 data logger to communicate over a local network or a dedicated Internet connection via TCP/IP a NL 120 Ethernet (Fig. 7) interfacee is used [6]. The NL120 uses a 10baseT Ethernet straight through cable when the cable is run from a hub to the NL120. A 10baseT Ethernet crossover cable is used if the cable is run directly from the computer to the SolarCloud Rapid Data Logging 19

20 NL120. For cable lengths longer than 9 feet, either a shielded 10baseT Ethernet cable or the surge protector needs to be used [6]. Fig 7: NL 120 Ethernet interface Running the App (Fig. 13). Usage of available channels of CR 1000 data logger are shown on Fig 8. There are 5 channels currently in use as follows: Channel 1: System Volts Channel 2: Shunt Volts Channel 3: Shunt Tem Sensor Channel 4: Panel Temperature Sensor Channel 5: Tilt Sensor SolarCloud Rapid Data Logging 20

21 Fig. 8 Proposed use of data channels Configuration of CR 1000 data logger. To interface with the CR 1000 Campbell Scientific s PC200W supplied software (Fig. 9) must be used. SolarCloud Rapid Data Logging 21

22 Fig. 9 PC200W user interface The data logger must be connected to a Microsoft Windows PC via serial cable via its serial port RS 232 (shown in Fig 10). Fig 10 Port RS 232 of the data logger. After the data logger is successfully connected with the cable and the software to the PC, the program found in Appendix A must be uploaded to the data logger. This will reconfigure the data logger with the appropriate tables. In this Case Study the parameters are shown in Table 1. Each row corresponds to a channel of the Data Logger. Voltage1 Voltage2 Voltage2 Voltage4 Voltage5 Table 1. Table used by the Data Logger in this Case Study. Additionally, a static IP must be assigned to the data logger in order for other devices to be able to request data from it. This is done via the Device Configuration Utility within the PC200Wprogram as shown on Fig 11 below. SolarCloud Rapid Data Logging 22

23 Fig 11. Device Configurationn Utility by Campbell Scientific Assign the following measurements to each channel: Bind Average Voltage to Channel 1 (more to come heree once we install the data logger) Database platform SolarCloud The software application has been developed which acquires the data from the Solar Plant at 1 second intervals and records the readings in a database. Finally, the data have to be presented SolarCloud Rapid Data Logging 23

24 to the end user. The following technology stack shown in Fig 12 is suitable for use in this case: Solar Cloud Application MongoDB NodeJS Linux Fig 12. Technology stack Installation of the Server Environment The following technologies have to be installed on the server in this order (admin privileges required) Operating System: Ubuntu 12.x [6] Installation notes: Isntall Ubuntu using a LiveCD with the following network configuration: auto eth0 face eth0 inet static address netmask network broadcast gateway dnssearch cs.fgcu.edu dns-nameservers SolarCloud Rapid Data Logging 24

25 Web Server: Apache 2.2x [6] Run the following commands to install Apache sudo apt-get install tasksel sudotasksel install lamp-server Database: MongoDB [6] See section 2 for installation notes: Back end technologies: NodeJS [6] Run the following commands in order to install NodeJS sudo apt-get install python-software-properties python g++ make sudo add-apt-repository ppa:chris-lea/node.js sudo apt-get update sudo apt-get install nodejs Version control: Git Installation notes: Run the following command in order to install Git sudo apt-get install git SolarCloud Installation Solar Cloud software has been developed in the Spring 2013 project [6]. The general design is SolarCloud Rapid Data Logging 25

26 shown in Fig 13. Execute the following stepss in order to install SolarCloud Createe a solarcolud directory under /etc/www by running the following command sudomkdir /etc/www/solarcloud Navigate to the SolarCloud directory by running the following command cd /etc/www/solarcloud Clone the GitHubrepositorygit@github.com:teodortalov/data- acquisition-nodejs-mongodb.gitby running the following command sudogit clone git@github.com:teodortalov/data-acquisition- nodejs-mongodb.git.. If port 22 is blocked the repostiroy could be cloned via HTTPS by running the following command: git clone nodejs-mongodb.git. SolarCloud Rapid Data Logging 26

27 Install Express Framework by running the following command: sudonpm install SolarCloud Startt In order to start the Fetcher run the following commands: cd /etc/www/solarcloud node fetcher In order to start the App, run the following commands: cd /etc/www/solarcloud node app(shown on Fig 12) 4.4 Troubleshooting There are multiple known issues with the current configuration. All known issues are listed below as well as suggested resolutions for each of them Data logger does not respond with the expected JSON data structure. Example of the issue is shown on Fig 14 Fig 14. Incorrect response from data logger SolarCloud Rapid Data Logging 27

28 This issue might be a result of the internal memory of the data logger being full. Suggested resolution is reconfiguring the data logger to its initial state using the program included in Appendix A. If when connecting to MongoDB the following error is thrown: JavaScript execution failed: Error: couldn't connect to server :27017 at src/mongo/shell/mongo.js:l112 exception: connect failed run the following command to resolve the issue: sudorm /var/lib/mongodb/mongod.lock SolarCloud Rapid Data Logging 28

29 5. Experiements Experiments are ran on two separate servers, a development server and production server (Key West server). Both have Ubuntu 12.4 with PHP 5.4, MySQL 5.5 and MongoDB 2.4. Some experiementation was conducted with READ and WRITE operations for both MySQL and MongoDB. Also experimentation was done with the following number of records: 10, 100, 1 000, Each experiment is ran with two different record lenghts, 10 characters and 100 characters. Diagram of server infrastructure for both MongoDB and MySQL is shown on Fig 15 Ubuntu Ubuntu Apache webserver Apache webserver PHP PHP MySQL MongoDB Fig 15 Server Infrastructure for MySQL and MongoDB PHP was used as a mid ware and InnoDB was used as MySQL s storage engine. The experiments were run on two servers with indentical configuration but different server resources. Server 1 Processor 2.4GHz and RAM: 16.00GB Server 2 (Key West) Processor 1.98GHz and RAM: 1.96GB The resutls from WRITE are shown on below: SolarCloud Rapid Data Logging 29

30 Server 1 10 characters record lenght: WRITE operations Number of records MongoDB execution time (sec) MySQL execution time (sec) Table 2 Timing WRITE operations of Server 1 with 10 characters record lenght READ operations Number of records MongoDB execution time (sec) MySQL execution time(sec) Table 3 Timing of READ operationsof Server 2 with 10 characters record lenght SolarCloud Rapid Data Logging 30

31 100 characters record lenght: WRITE operations Number of records MongoDB execution time (sec) MySQL execution time (sec) Table 4 Timing WRITE operations of Server 1 with 100 characters record lenght READ operations Number of records MongoDB execution time (sec) MySQL execution time(sec) Table 5 Timing of READ operations of Server 2 with 100 characters record lenght SolarCloud Rapid Data Logging 31

32 Server 2 10 characters record lenght: WRITE operations Number of records MongoDB execution time (sec) MySQL execution time (sec) Table 2 Timing WRITE operations of Server 1 with 10 characters record lenght READ operations Number of records MongoDB execution time (sec) MySQL execution time(sec) Table 3 Timing of READ operations of Server 2 with 10 characters record lenght SolarCloud Rapid Data Logging 32

33 100 characters record lenght: WRITE operations Number of records MongoDB execution time (sec) MySQL execution time (sec) Table 4 Timing WRITE operations of Server 1 with 100 characters record lenght READ operations Number of records MongoDB execution time (sec) MySQL execution time(sec) Table 5 Timing of READ operations of Server 2 with 100 characters record lenght Interpreatation of the resutls: Clearly MongoDB outperfomed MySQL by far in WRITE SolarCloud Rapid Data Logging 33

34 operations, however MySQL slightly outperformed MongoDB in READ operations.results are somewhat inconsistent which is probalby due to other processes running on the operating system. However, MySQL performance could also be affected by the storage engine used. In the experiments InnoDB is used as a storage engine, but other storage engines are available such as MyISAM, ARCHIVE, BLACKHOLE, etc. Each storage engine would perform differently because it provides different features. The code used in the experimentation can be found in Appendix B 6. Conclusion The primary objective of the project was achieved, namely the new system is up and running at the Experimental Solar Plan. The separation of concerns data collection and analyses provides robust interface for continues data collection and on demand data analyses. Specifically, the fetcher (data collection) and be run at any given point in time for as long as needed; on the other hand, the data analysis works independently so data could be analyzed in both real time and/or at a later point. The system could be extended by adding robust data analyses functionality, but the current graphics interfaces could be reused. Also, in experiments showed that MongoDB has better overall performance than MySQL, since the MySQL writes are very slow compared than MongoDB writes, but MySQL reads were slightly faster. However, MongoDB provided better optimal performance. SolarCloud Rapid Data Logging 34

35 7. References: [1] Brown University Data Managment and Reserach Group, "MongoDB Database Design Research," Brown University, [Online]. Available: [2] Canonical Ltd., "Home Ubuntu," [Online]. Available: [Accessed ]. [3] 10gen, Inc., "MongoDB," 10gen, Inc., [Online]. Available: [Accessed ]. [4] Wikipedia, "Row (database)," [Online]. [5] K. Chodorow and M. Dirolf, MongoDB The Definitive Guide, O'Reilly, [6] T. Talov, "Solar Plant Data Logging," [7] Campbell Scientific. Available: SolarCloud Rapid Data Logging 35

36 Appendix A Experimentation <?php echo'<!--- INSERT ---->'; echotime_elapsed(); // Configuration $dbhost = 'localhost'; $dbname = 'test'; // Connect to test database $m = new Mongo("mongodb://$dbhost"); $db = $m->$dbname; // Get the users collection $c_users = $db->users; // Insert this new document into the users collectionf for($i=0; $i<1000; $i++){ // $c_users->save($user) $users = array( 'first_name' => $i, 'last_name' =>'Fan'.$i ); $c_users->save($users); } echotime_elapsed(); $con=mysqli_connect("localhost","root","","foo"); // Check connection if(mysqli_connect_errno()) { echo"failed to connect to MySQL: ". mysqli_connect_error(); } for($i=0; $i<1000; $i++){ mysqli_query($con,"insert INTO persons (first_name, last_name) VALUES ('Peter', 'Griffin')"); } echotime_elapsed2().'\n'; echotime_elapsed(); echo'\n<!-- SELECT -->'; $db = $m->selectdb('test'); $collection = new MongoCollection($db, 'users'); SolarCloud Rapid Data Logging 36

37 echotime_elapsed(); mysqli_query($con,"select * FROM persons"); echotime_elapsed2(); functiontime_elapsed() { static$last = null; $now = microtime(true); if($last!= null) { echo'<!-- MongoDB: '. ($now - $last).' -->'; } $last = $now; } functiontime_elapsed2() { static$last = null; $now = microtime(true); if($last!= null) { echo'<!-- MySQL: '. ($now - $last).' -->'; } } $last = $now; SolarCloud Rapid Data Logging 37

Solar Plant Data Acquisition Maintenance

Solar Plant Data Acquisition Maintenance Solar Plant Data Acquisition Maintenance Instructions on installing and running the software Christian Paulino Teodor Talov Instructor: Dr. Janusz Zalewski CEN 4935 Senior Software Engineering Project

More information

FLORIDA DEPARTMENT OF TRANSPORTATION PRODUCTION BIG DATA PLATFORM

FLORIDA DEPARTMENT OF TRANSPORTATION PRODUCTION BIG DATA PLATFORM FLORIDA DEPARTMENT OF TRANSPORTATION PRODUCTION BIG DATA PLATFORM RECOMMENDATION AND JUSTIFACTION Executive Summary: VHB has been tasked by the Florida Department of Transportation District Five to design

More information

MongoDB Tutorial for Beginners

MongoDB Tutorial for Beginners MongoDB Tutorial for Beginners Mongodb is a document-oriented NoSQL database used for high volume data storage. In this tutorial you will learn how Mongodb can be accessed and some of its important features

More information

Oral Questions and Answers (DBMS LAB) Questions & Answers- DBMS

Oral Questions and Answers (DBMS LAB) Questions & Answers- DBMS Questions & Answers- DBMS https://career.guru99.com/top-50-database-interview-questions/ 1) Define Database. A prearranged collection of figures known as data is called database. 2) What is DBMS? Database

More information

Understanding basics of MongoDB and MySQL

Understanding basics of MongoDB and MySQL Understanding basics of MongoDB and MySQL PSOSM summer school @ IIITH Divyansh Agarwal - Research Associate 3rd July, 2017 Precog Labs, IIIT-Delhi What is a Database? Organized collection of data. Collection

More information

MongoDB Schema Design

MongoDB Schema Design MongoDB Schema Design Demystifying document structures in MongoDB Jon Tobin @jontobs MongoDB Overview NoSQL Document Oriented DB Dynamic Schema HA/Sharding Built In Simple async replication setup Automated

More information

Big Data Exercises. Fall 2016 Week 11 ETH Zurich

Big Data Exercises. Fall 2016 Week 11 ETH Zurich Big Data Exercises Fall 2016 Week 11 ETH Zurich Introduction This exercise will cover document stores. As a representative of document stores, MongoDB was chosen for the practical exercises. You can install

More information

Online Multimedia Winter semester 2015/16

Online Multimedia Winter semester 2015/16 Multimedia im Netz Online Multimedia Winter semester 2015/16 Tutorial 09 Major Subject Ludwig-Maximilians-Universität München Online Multimedia WS 2015/16 - Tutorial 09-1 Today s Agenda Discussion: Intellectual

More information

Course Content MongoDB

Course Content MongoDB Course Content MongoDB 1. Course introduction and mongodb Essentials (basics) 2. Introduction to NoSQL databases What is NoSQL? Why NoSQL? Difference Between RDBMS and NoSQL Databases Benefits of NoSQL

More information

Document stores using CouchDB

Document stores using CouchDB 2018 Document stores using CouchDB ADVANCED DATABASE PROJECT APARNA KHIRE, MINGRUI DONG aparna.khire@vub.be, mingdong@ulb.ac.be 1 Table of Contents 1. Introduction... 3 2. Background... 3 2.1 NoSQL Database...

More information

MongoDB Web Architecture

MongoDB Web Architecture MongoDB Web Architecture MongoDB MongoDB is an open-source, NoSQL database that uses a JSON-like (BSON) document-oriented model. Data is stored in collections (rather than tables). - Uses dynamic schemas

More information

Using the MySQL Document Store

Using the MySQL Document Store Using the MySQL Document Store Alfredo Kojima, Sr. Software Dev. Manager, MySQL Mike Zinner, Sr. Software Dev. Director, MySQL Safe Harbor Statement The following is intended to outline our general product

More information

MongoDB w/ Some Node.JS Sprinkles

MongoDB w/ Some Node.JS Sprinkles MongoDB w/ Some Node.JS Sprinkles Niall O'Higgins Author MongoDB and Python O'Reilly @niallohiggins on Twitter niallo@beyondfog.com MongoDB Overview Non-relational (NoSQL) document-oriented database Rich

More information

What is database? Types and Examples

What is database? Types and Examples What is database? Types and Examples Visit our site for more information: www.examplanning.com Facebook Page: https://www.facebook.com/examplanning10/ Twitter: https://twitter.com/examplanning10 TABLE

More information

NoSQL Injection SEC642. Advanced Web App Penetration Testing, Ethical Hacking, and Exploitation Techniques S

NoSQL Injection SEC642. Advanced Web App Penetration Testing, Ethical Hacking, and Exploitation Techniques S SEC642 Advanced Web App Penetration Testing, Ethical Hacking, and Exploitation Techniques S NoSQL Injection Copyright 2012-2018 Justin Searle and Adrien de Beaupré All Rights Reserved Version D01_01 About

More information

CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( )

CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( ) Guide: CIS 601 Graduate Seminar Presented By: Dr. Sunnie S. Chung Dhruv Patel (2652790) Kalpesh Sharma (2660576) Introduction Background Parallel Data Warehouse (PDW) Hive MongoDB Client-side Shared SQL

More information

The course modules of MongoDB developer and administrator online certification training:

The course modules of MongoDB developer and administrator online certification training: The course modules of MongoDB developer and administrator online certification training: 1 An Overview of the Course Introduction to the course Table of Contents Course Objectives Course Overview Value

More information

VMware AirWatch Content Gateway for Linux. VMware Workspace ONE UEM 1811 Unified Access Gateway

VMware AirWatch Content Gateway for Linux. VMware Workspace ONE UEM 1811 Unified Access Gateway VMware AirWatch Content Gateway for Linux VMware Workspace ONE UEM 1811 Unified Access Gateway You can find the most up-to-date technical documentation on the VMware website at: https://docs.vmware.com/

More information

State of the Dolphin Developing new Apps in MySQL 8

State of the Dolphin Developing new Apps in MySQL 8 State of the Dolphin Developing new Apps in MySQL 8 Highlights of MySQL 8.0 technology updates Mark Swarbrick MySQL Principle Presales Consultant Jill Anolik MySQL Global Business Unit Israel Copyright

More information

NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY

NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY WHAT IS NOSQL? Stands for No-SQL or Not Only SQL. Class of non-relational data storage systems E.g.

More information

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy * Towards NewSQL Overview * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy *TowardsNewSQL NoSQL

More information

DATABASE SYSTEMS. Database programming in a web environment. Database System Course, 2016

DATABASE SYSTEMS. Database programming in a web environment. Database System Course, 2016 DATABASE SYSTEMS Database programming in a web environment Database System Course, 2016 AGENDA FOR TODAY Advanced Mysql More than just SELECT Creating tables MySQL optimizations: Storage engines, indexing.

More information

SQL, NoSQL, MongoDB. CSE-291 (Cloud Computing) Fall 2016 Gregory Kesden

SQL, NoSQL, MongoDB. CSE-291 (Cloud Computing) Fall 2016 Gregory Kesden SQL, NoSQL, MongoDB CSE-291 (Cloud Computing) Fall 2016 Gregory Kesden SQL Databases Really better called Relational Databases Key construct is the Relation, a.k.a. the table Rows represent records Columns

More information

Advanced Database Project: Document Stores and MongoDB

Advanced Database Project: Document Stores and MongoDB Advanced Database Project: Document Stores and MongoDB Sivaporn Homvanish (0472422) Tzu-Man Wu (0475596) Table of contents Background 3 Introduction of Database Management System 3 SQL vs NoSQL 3 Document

More information

CIB Session 12th NoSQL Databases Structures

CIB Session 12th NoSQL Databases Structures CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is

More information

MongoDB An Overview. 21-Oct Socrates

MongoDB An Overview. 21-Oct Socrates MongoDB An Overview 21-Oct-2016 Socrates Agenda What is NoSQL DB? Types of NoSQL DBs DBMS and MongoDB Comparison Why MongoDB? MongoDB Architecture Storage Engines Data Model Query Language Security Data

More information

davinci: Solarems Data Extraction Christian Paulino Teodor Talov Instructor: Dr. Januz Zalewski CEN 4935 Software Project in Computer Networks

davinci: Solarems Data Extraction Christian Paulino Teodor Talov Instructor: Dr. Januz Zalewski CEN 4935 Software Project in Computer Networks davinci: Solarems Data Extraction Christian Paulino Teodor Talov Instructor: Dr. Januz Zalewski CEN 4935 Software Project in Computer Networks Florida Gulf Coast University 10501 FGCU Blvd. S. Fort Myers,

More information

API Gateway Version September Key Property Store User Guide

API Gateway Version September Key Property Store User Guide API Gateway Version 7.5.2 15 September 2017 Key Property Store User Guide Copyright 2017 Axway All rights reserved. This documentation describes the following Axway software: Axway API Gateway 7.5.2 No

More information

MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM

MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM About us Adamo Tonete MongoDB Support Engineer Agustín Gallego MySQL Support Engineer Agenda What are MongoDB and MySQL; NoSQL

More information

Ebook : Overview of application development. All code from the application series books listed at:

Ebook : Overview of application development. All code from the application series books listed at: Ebook : Overview of application development. All code from the application series books listed at: http://www.vkinfotek.com with permission. Publishers: VK Publishers Established: 2001 Type of books: Develop

More information

ITG Software Engineering

ITG Software Engineering Introduction to MongoDB Course ID: Page 1 Last Updated 12/15/2014 MongoDB for Developers Course Overview: In this 3 day class students will start by learning how to install and configure MongoDB on a Mac

More information

Document Object Storage with MongoDB

Document Object Storage with MongoDB Document Object Storage with MongoDB Lecture BigData Analytics Julian M. Kunkel julian.kunkel@googlemail.com University of Hamburg / German Climate Computing Center (DKRZ) 2017-12-15 Disclaimer: Big Data

More information

VMware AirWatch Content Gateway Guide for Linux For Linux

VMware AirWatch Content Gateway Guide for Linux For Linux VMware AirWatch Content Gateway Guide for Linux For Linux Workspace ONE UEM v9.7 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com.

More information

DIGIT.B4 Big Data PoC

DIGIT.B4 Big Data PoC DIGIT.B4 Big Data PoC GROW Transpositions D04.01.Information System Table of contents 1 Introduction... 4 1.1 Context of the project... 4 1.2 Objective... 4 2 Technologies used... 5 2.1 Python... 5 2.2

More information

DATABASE SYSTEMS. Database programming in a web environment. Database System Course,

DATABASE SYSTEMS. Database programming in a web environment. Database System Course, DATABASE SYSTEMS Database programming in a web environment Database System Course, 2016-2017 AGENDA FOR TODAY The final project Advanced Mysql Database programming Recap: DB servers in the web Web programming

More information

Example Azure Implementation for Government Agencies. Indirect tax-filing system. By Alok Jain Azure Customer Advisory Team (AzureCAT)

Example Azure Implementation for Government Agencies. Indirect tax-filing system. By Alok Jain Azure Customer Advisory Team (AzureCAT) Example Azure Implementation for Government Agencies Indirect tax-filing system By Alok Jain Azure Customer Advisory Team (AzureCAT) June 2018 Example Azure Implementation for Government Agencies Contents

More information

Intro to Couchbase Server for ColdFusion - Clustered NoSQL and Caching at its Finest

Intro to Couchbase Server for ColdFusion - Clustered NoSQL and Caching at its Finest Tweet Intro to Couchbase Server for ColdFusion - Clustered NoSQL and Caching at its Finest Brad Wood Jul 26, 2013 Today we are starting a new blogging series on how to leverage Couchbase NoSQL from ColdFusion

More information

Open source, high performance database. July 2012

Open source, high performance database. July 2012 Open source, high performance database July 2012 1 Quick introduction to mongodb Data modeling in mongodb, queries, geospatial, updates and map reduce. Using a location-based app as an example Example

More information

Topics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL

Topics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL Databases Topics History - RDBMS - SQL Architecture - SQL - NoSQL MongoDB, Mongoose Persistent Data Storage What features do we want in a persistent data storage system? We have been using text files to

More information

Kollaborate Server. Installation Guide

Kollaborate Server. Installation Guide 1 Kollaborate Server Installation Guide Kollaborate Server is a local implementation of the Kollaborate cloud workflow system that allows you to run the service in-house on your own server and storage.

More information

<Insert Picture Here> MySQL Cluster What are we working on

<Insert Picture Here> MySQL Cluster What are we working on MySQL Cluster What are we working on Mario Beck Principal Consultant The following is intended to outline our general product direction. It is intended for information purposes only,

More information

NoSQL Databases MongoDB vs Cassandra. Kenny Huynh, Andre Chik, Kevin Vu

NoSQL Databases MongoDB vs Cassandra. Kenny Huynh, Andre Chik, Kevin Vu NoSQL Databases MongoDB vs Cassandra Kenny Huynh, Andre Chik, Kevin Vu Introduction - Relational database model - Concept developed in 1970 - Inefficient - NoSQL - Concept introduced in 1980 - Related

More information

MEAN Stack. 1. Introduction. 2. Foundation a. The Node.js framework b. Installing Node.js c. Using Node.js to execute scripts

MEAN Stack. 1. Introduction. 2. Foundation a. The Node.js framework b. Installing Node.js c. Using Node.js to execute scripts MEAN Stack 1. Introduction 2. Foundation a. The Node.js framework b. Installing Node.js c. Using Node.js to execute scripts 3. Node Projects a. The Node Package Manager b. Creating a project c. The package.json

More information

CIS 612 Advanced Topics in Database Big Data Project Lawrence Ni, Priya Patil, James Tench

CIS 612 Advanced Topics in Database Big Data Project Lawrence Ni, Priya Patil, James Tench CIS 612 Advanced Topics in Database Big Data Project Lawrence Ni, Priya Patil, James Tench Abstract Implementing a Hadoop-based system for processing big data and doing analytics is a topic which has been

More information

NoSQL Databases Analysis

NoSQL Databases Analysis NoSQL Databases Analysis Jeffrey Young Intro I chose to investigate Redis, MongoDB, and Neo4j. I chose Redis because I always read about Redis use and its extreme popularity yet I know little about it.

More information

MySQL for Developers. Duration: 5 Days

MySQL for Developers. Duration: 5 Days Oracle University Contact Us: 0800 891 6502 MySQL for Developers Duration: 5 Days What you will learn This MySQL for Developers training teaches developers how to develop console and web applications using

More information

Load Balancing Censornet USS Gateway. Deployment Guide v Copyright Loadbalancer.org

Load Balancing Censornet USS Gateway. Deployment Guide v Copyright Loadbalancer.org Load Balancing Censornet USS Gateway Deployment Guide v1.0.0 Copyright Loadbalancer.org Table of Contents 1. About this Guide...3 2. Loadbalancer.org Appliances Supported...3 3. Loadbalancer.org Software

More information

MySQL for Developers. Duration: 5 Days

MySQL for Developers. Duration: 5 Days Oracle University Contact Us: Local: 0845 777 7 711 Intl: +44 845 777 7 711 MySQL for Developers Duration: 5 Days What you will learn This MySQL for Developers training teaches developers how to develop

More information

Comparing SQL and NOSQL databases

Comparing SQL and NOSQL databases COSC 6397 Big Data Analytics Data Formats (II) HBase Edgar Gabriel Spring 2014 Comparing SQL and NOSQL databases Types Development History Data Storage Model SQL One type (SQL database) with minor variations

More information

VMware AirWatch Content Gateway Guide For Linux

VMware AirWatch Content Gateway Guide For Linux VMware AirWatch Content Gateway Guide For Linux AirWatch v9.2 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com. This product

More information

ETL Transformations Performance Optimization

ETL Transformations Performance Optimization ETL Transformations Performance Optimization Sunil Kumar, PMP 1, Dr. M.P. Thapliyal 2 and Dr. Harish Chaudhary 3 1 Research Scholar at Department Of Computer Science and Engineering, Bhagwant University,

More information

Data Validation Option Best Practices

Data Validation Option Best Practices Data Validation Option Best Practices 1993-2016 Informatica LLC. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without

More information

VMware AirWatch Content Gateway Guide for Windows

VMware AirWatch Content Gateway Guide for Windows VMware AirWatch Content Gateway Guide for Windows AirWatch v9.1 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com. This product

More information

CSE 544 Principles of Database Management Systems. Magdalena Balazinska Winter 2015 Lecture 14 NoSQL

CSE 544 Principles of Database Management Systems. Magdalena Balazinska Winter 2015 Lecture 14 NoSQL CSE 544 Principles of Database Management Systems Magdalena Balazinska Winter 2015 Lecture 14 NoSQL References Scalable SQL and NoSQL Data Stores, Rick Cattell, SIGMOD Record, December 2010 (Vol. 39, No.

More information

MongoDB. History. mongodb = Humongous DB. Open-source Document-based High performance, high availability Automatic scaling C-P on CAP.

MongoDB. History. mongodb = Humongous DB. Open-source Document-based High performance, high availability Automatic scaling C-P on CAP. #mongodb MongoDB Modified from slides provided by S. Parikh, A. Im, G. Cai, H. Tunc, J. Stevens, Y. Barve, S. Hei History mongodb = Humongous DB Open-source Document-based High performance, high availability

More information

Big Data Exercises. Fall 2018 Week 11 ETH Zurich

Big Data Exercises. Fall 2018 Week 11 ETH Zurich Big Data Exercises Fall 2018 Week 11 ETH Zurich Introduction This exercise will cover document stores. As a representative of document stores, MongoDB was chosen for the practical exercises. Instructions

More information

Cassandra- A Distributed Database

Cassandra- A Distributed Database Cassandra- A Distributed Database Tulika Gupta Department of Information Technology Poornima Institute of Engineering and Technology Jaipur, Rajasthan, India Abstract- A relational database is a traditional

More information

CIS-CAT Pro Dashboard Documentation

CIS-CAT Pro Dashboard Documentation CIS-CAT Pro Dashboard Documentation Release 1.0.0 Center for Internet Security February 03, 2017 Contents 1 CIS-CAT Pro Dashboard User s Guide 1 1.1 Introduction...............................................

More information

MONGODB INTERVIEW QUESTIONS

MONGODB INTERVIEW QUESTIONS MONGODB INTERVIEW QUESTIONS http://www.tutorialspoint.com/mongodb/mongodb_interview_questions.htm Copyright tutorialspoint.com Dear readers, these MongoDB Interview Questions have been designed specially

More information

VMware AirWatch Content Gateway Guide for Windows

VMware AirWatch Content Gateway Guide for Windows VMware AirWatch Content Gateway Guide for Windows AirWatch v9.2 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com. This product

More information

VMware AirWatch Content Gateway Guide for Windows

VMware AirWatch Content Gateway Guide for Windows VMware AirWatch Content Gateway Guide for Windows AirWatch v9.3 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com. This product

More information

Database Solution in Cloud Computing

Database Solution in Cloud Computing Database Solution in Cloud Computing CERC liji@cnic.cn Outline Cloud Computing Database Solution Our Experiences in Database Cloud Computing SaaS Software as a Service PaaS Platform as a Service IaaS Infrastructure

More information

Optimizing Testing Performance With Data Validation Option

Optimizing Testing Performance With Data Validation Option Optimizing Testing Performance With Data Validation Option 1993-2016 Informatica LLC. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording

More information

VMware AirWatch Content Gateway for Windows. VMware Workspace ONE UEM 1811 Unified Access Gateway

VMware AirWatch Content Gateway for Windows. VMware Workspace ONE UEM 1811 Unified Access Gateway VMware AirWatch Content Gateway for Windows VMware Workspace ONE UEM 1811 Unified Access Gateway You can find the most up-to-date technical documentation on the VMware website at: https://docs.vmware.com/

More information

MySQL Views & Comparing SQL to NoSQL

MySQL Views & Comparing SQL to NoSQL CMSC 461, Database Management Systems Fall 2014 MySQL Views & Comparing SQL to NoSQL These slides are based on Database System Concepts book and slides, 6 th edition, and the 2009/2012 CMSC 461 slides

More information

Big Data Exercises. Fall 2017 Week 11 ETH Zurich

Big Data Exercises. Fall 2017 Week 11 ETH Zurich Big Data Exercises Fall 2017 Week 11 ETH Zurich Introduction This exercise will cover document stores. As a representative of document stores, MongoDB was chosen for the practical exercises. You can install

More information

Installing MediaWiki using VirtualBox

Installing MediaWiki using VirtualBox Installing MediaWiki using VirtualBox Install VirtualBox with your package manager or download it from the https://www.virtualbox.org/ website and follow the installation instructions. Load an Image For

More information

Everything You Need to Know About MySQL Group Replication

Everything You Need to Know About MySQL Group Replication Everything You Need to Know About MySQL Group Replication Luís Soares (luis.soares@oracle.com) Principal Software Engineer, MySQL Replication Lead Copyright 2017, Oracle and/or its affiliates. All rights

More information

Relational to NoSQL: Getting started from SQL Server. Shane Johnson Sr. Product Marketing Manager Couchbase

Relational to NoSQL: Getting started from SQL Server. Shane Johnson Sr. Product Marketing Manager Couchbase Relational to NoSQL: Getting started from SQL Server Shane Johnson Sr. Product Marketing Manager Couchbase Today s agenda Why NoSQL? Identifying the right application Modeling your data Accessing your

More information

Infoblox Kubernetes1.0.0 IPAM Plugin

Infoblox Kubernetes1.0.0 IPAM Plugin 2h DEPLOYMENT GUIDE Infoblox Kubernetes1.0.0 IPAM Plugin NIOS version 8.X August 2018 2018 Infoblox Inc. All rights reserved. Infoblox Kubernetes 1.0.0 IPAM Deployment Guide August 2018 Page 1 of 18 Overview...

More information

MongoDB Step By Step. By B.A.Khivsara Assistant Professor Department of Computer Engineering SNJB s COE,Chandwad

MongoDB Step By Step. By B.A.Khivsara Assistant Professor Department of Computer Engineering SNJB s COE,Chandwad MongoDB Step By Step By B.A.Khivsara Assistant Professor Department of Computer Engineering SNJB s COE,Chandwad Outline Introduction to MongoDB Installation in Ubuntu Starting MongoDB in Ubuntu Basic Operations

More information

What is Drupal? What is this Drew-Paul thing you do?

What is Drupal? What is this Drew-Paul thing you do? What is Drupal? Or What is this Drew-Paul thing you do? Drupal for the average person Drupal lets me build websites that help people build their own websites without needing to know anything about programming

More information

Jargons, Concepts, Scope and Systems. Key Value Stores, Document Stores, Extensible Record Stores. Overview of different scalable relational systems

Jargons, Concepts, Scope and Systems. Key Value Stores, Document Stores, Extensible Record Stores. Overview of different scalable relational systems Jargons, Concepts, Scope and Systems Key Value Stores, Document Stores, Extensible Record Stores Overview of different scalable relational systems Examples of different Data stores Predictions, Comparisons

More information

1Z MySQL 5 Database Administrator Certified Professional Exam, Part II Exam.

1Z MySQL 5 Database Administrator Certified Professional Exam, Part II Exam. Oracle 1Z0-874 MySQL 5 Database Administrator Certified Professional Exam, Part II Exam TYPE: DEMO http://www.examskey.com/1z0-874.html Examskey Oracle 1Z0-874 exam demo product is here for you to test

More information

B.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1

B.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1 Basic Concepts :- 1. What is Data? Data is a collection of facts from which conclusion may be drawn. In computer science, data is anything in a form suitable for use with a computer. Data is often distinguished

More information

IT Service Delivery and Support Week Three. IT Auditing and Cyber Security Fall 2016 Instructor: Liang Yao

IT Service Delivery and Support Week Three. IT Auditing and Cyber Security Fall 2016 Instructor: Liang Yao IT Service Delivery and Support Week Three IT Auditing and Cyber Security Fall 2016 Instructor: Liang Yao 1 Infrastructure Essentials Computer Hardware Operating Systems (OS) & System Software Applications

More information

Making MongoDB Accessible to All. Brody Messmer Product Owner DataDirect On-Premise Drivers Progress Software

Making MongoDB Accessible to All. Brody Messmer Product Owner DataDirect On-Premise Drivers Progress Software Making MongoDB Accessible to All Brody Messmer Product Owner DataDirect On-Premise Drivers Progress Software Agenda Intro to MongoDB What is MongoDB? Benefits Challenges and Common Criticisms Schema Design

More information

Brad Dayley. Sams Teach Yourself. NoSQL with MongoDB. SAMS 800 East 96th Street, Indianapolis, Indiana, USA

Brad Dayley. Sams Teach Yourself. NoSQL with MongoDB. SAMS 800 East 96th Street, Indianapolis, Indiana, USA Brad Dayley Sams Teach Yourself NoSQL with MongoDB SAMS 800 East 96th Street, Indianapolis, Indiana, 46240 USA Table of Contents Introduction 1 How This Book Is Organized 1 Code Examples 2 Special Elements

More information

Installing and Configuring VMware Identity Manager Connector (Windows) OCT 2018 VMware Identity Manager VMware Identity Manager 3.

Installing and Configuring VMware Identity Manager Connector (Windows) OCT 2018 VMware Identity Manager VMware Identity Manager 3. Installing and Configuring VMware Identity Manager Connector 2018.8.1.0 (Windows) OCT 2018 VMware Identity Manager VMware Identity Manager 3.3 You can find the most up-to-date technical documentation on

More information

MongoDB - a No SQL Database What you need to know as an Oracle DBA

MongoDB - a No SQL Database What you need to know as an Oracle DBA MongoDB - a No SQL Database What you need to know as an Oracle DBA David Burnham Aims of this Presentation To introduce NoSQL database technology specifically using MongoDB as an example To enable the

More information

Real Life Web Development. Joseph Paul Cohen

Real Life Web Development. Joseph Paul Cohen Real Life Web Development Joseph Paul Cohen joecohen@cs.umb.edu Index 201 - The code 404 - How to run it? 500 - Your code is broken? 200 - Someone broke into your server? 400 - How are people using your

More information

Part 1: Installing MongoDB

Part 1: Installing MongoDB Samantha Orogvany-Charpentier CSU ID: 2570586 Installing NoSQL Systems Part 1: Installing MongoDB For my lab, I installed MongoDB version 3.2.12 on Ubuntu 16.04. I followed the instructions detailed at

More information

MySQL as a Document Store. Ted Wennmark

MySQL as a Document Store. Ted Wennmark MySQL as a Document Store Ted Wennmark ted.wennmark@oracle.com Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and

More information

InterConnect. Global initiative on gene environment interactions in diabetes / obesity in specific populations. Grant agreement no:

InterConnect. Global initiative on gene environment interactions in diabetes / obesity in specific populations. Grant agreement no: Global data for diabetes and obesity research InterConnect Global initiative on gene environment interactions in diabetes / obesity in specific populations Grant agreement no: 602068 Study IT set up Standard

More information

3 / 120. MySQL 8.0. Frédéric Descamps - MySQL Community Manager - Oracle

3 / 120. MySQL 8.0. Frédéric Descamps - MySQL Community Manager - Oracle 1 / 120 2 / 120 3 / 120 MySQL 8.0 a Document Store with all the benefits of a transactional RDBMS Frédéric Descamps - MySQL Community Manager - Oracle 4 / 120 Save the date! 5 / 120 Safe Harbor Statement

More information

RavenDB & document stores

RavenDB & document stores université libre de bruxelles INFO-H415 - Advanced Databases RavenDB & document stores Authors: Yasin Arslan Jacky Trinh Professor: Esteban Zimányi Contents 1 Introduction 3 1.1 Présentation...................................

More information

9581SST CONFIGURE OPERATION MANUAL

9581SST CONFIGURE OPERATION MANUAL 9581SST CONFIGURE OPERATION MANUAL Company Profile Trilithic, Inc. was founded in 1986 as an engineering and assembly company providing customized communications and routing systems for business and government

More information

Scaling with mongodb

Scaling with mongodb Scaling with mongodb Ross Lawley Python Engineer @ 10gen Web developer since 1999 Passionate about open source Agile methodology email: ross@10gen.com twitter: RossC0 Today's Talk Scaling Understanding

More information

Internet Technology. 06. Exam 1 Review Paul Krzyzanowski. Rutgers University. Spring 2016

Internet Technology. 06. Exam 1 Review Paul Krzyzanowski. Rutgers University. Spring 2016 Internet Technology 06. Exam 1 Review Paul Krzyzanowski Rutgers University Spring 2016 March 2, 2016 2016 Paul Krzyzanowski 1 Question 1 Defend or contradict this statement: for maximum efficiency, at

More information

Mastering phpmyadmiri 3.4 for

Mastering phpmyadmiri 3.4 for Mastering phpmyadmiri 3.4 for Effective MySQL Management A complete guide to getting started with phpmyadmin 3.4 and mastering its features Marc Delisle [ t]open so 1 I community experience c PUBLISHING

More information

Internet Technology 3/2/2016

Internet Technology 3/2/2016 Question 1 Defend or contradict this statement: for maximum efficiency, at the expense of reliability, an application should bypass TCP or UDP and use IP directly for communication. Internet Technology

More information

Real Time Marketing and Sales Data

Real Time Marketing and Sales Data Real Time Marketing and Sales Data 6/21/2016 Chase West Eric Sheeder Marissa Renfro 1 Table of Contents Introduction... About JumpCloud Product Vision Requirements.. Functional Requirements Non Functional

More information

CS193X: Web Programming Fundamentals

CS193X: Web Programming Fundamentals CS193X: Web Programming Fundamentals Spring 2017 Victoria Kirst (vrk@stanford.edu) CS193X schedule Today - MongoDB - Servers and MongoDB Friday - Web application architecture - Authentication MongoDB installation

More information

Hustle Documentation. Release 0.1. Tim Spurway

Hustle Documentation. Release 0.1. Tim Spurway Hustle Documentation Release 0.1 Tim Spurway February 26, 2014 Contents 1 Features 3 2 Getting started 5 2.1 Installing Hustle............................................. 5 2.2 Hustle Tutorial..............................................

More information

VMware AirWatch Content Gateway Guide for Windows

VMware AirWatch Content Gateway Guide for Windows VMware AirWatch Content Gateway Guide for Windows Workspace ONE UEM v1810 Have documentation feedback? Submit a Documentation Feedback support ticket using the Support Wizard on support.air-watch.com.

More information

MySQL High Availability

MySQL High Availability MySQL High Availability And other stuff worth talking about Peter Zaitsev CEO Moscow MySQL Users Group Meetup July 11 th, 2017 1 Few Words about Percona 2 Percona s Purpose To Champion Unbiased Open Source

More information

Verteego VDS Documentation

Verteego VDS Documentation Verteego VDS Documentation Release 1.0 Verteego May 31, 2017 Installation 1 Getting started 3 2 Ansible 5 2.1 1. Install Ansible............................................. 5 2.2 2. Clone installation

More information

MongoDB. copyright 2011 Trainologic LTD

MongoDB. copyright 2011 Trainologic LTD MongoDB MongoDB MongoDB is a document-based open-source DB. Developed and supported by 10gen. MongoDB is written in C++. The name originated from the word: humongous. Is used in production at: Disney,

More information

A Review to the Approach for Transformation of Data from MySQL to NoSQL

A Review to the Approach for Transformation of Data from MySQL to NoSQL A Review to the Approach for Transformation of Data from MySQL to NoSQL Monika 1 and Ashok 2 1 M. Tech. Scholar, Department of Computer Science and Engineering, BITS College of Engineering, Bhiwani, Haryana

More information

Implementing the Twelve-Factor App Methodology for Developing Cloud- Native Applications

Implementing the Twelve-Factor App Methodology for Developing Cloud- Native Applications Implementing the Twelve-Factor App Methodology for Developing Cloud- Native Applications By, Janakiram MSV Executive Summary Application development has gone through a fundamental shift in the recent past.

More information