Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases

Transcription

1 Enhancement of Open Source Monitoring Tool for Small Footprint Databases Sukh Deo Under the guidance of Prof. Deepak B. Phatak Dept. of CSE IIT Bombay June 22, 2014 Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

2 Table of contents Motivation Literature Survey on Small Footprint Databases Literature Survey on Monitoring Tool SQLite and Journal Mode MobiBench Monitoring Tool Performance Testing of Aakash2 using MobiBench Problems in MobiBench Enhancement in MobiBench Performance Testing of Aakash2 after Modification in MobiBench Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

3 Motivation Figure : Smart-phone s Users Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

4 Motivation Todays mobile devices are multi-functional devices Mobile devices are siblings of personal computers People want to use many applications on mobile device Mobile device has some limitations Limited memory Battery issues Enhance the performance of small footprint databases and monitoring tool Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

5 Small footprint databases Called lightweight databases or embedded databases Specially designed for mobile devices People want to use many applications on mobile device Mobile devices require such types of database that uses small memory and low power Example, Berkeley DB, Perst DB, and SQLite Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

6 Monitoring Tool In mobile device, each application generates the specific load Measures the load of each application that are running on mobile device For finding the correct load of application, we have to analyze data types and file system of executing application. For measure the performance of mobile device, we need mobile benchmarking tool Example, IOzone, AndroBench, and MobiBench Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

7 Literature Survey on Small Footprint Databases

8 Berkeley Database Berkeley DB is an embedded database Open source and written in C language Used to store the data, key/value technique Example, to store the user name and password Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

9 Access method in Berkeley DB B+tree Hash Fixed or variable length record Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 22, / 58

10 Limitations It does not support RDBMS It has no schema It stores only the record key/value technique, so that we cannot compare the data other than key value Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

11 Perst DB Perst Database is an open source embedded databases, based on Java object oriented architecture Feature are: B.tree R-tree index Specialized versions of collections for thick indices and bit indices Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

12 Limitation It is application specific database for storing real object information Example, we can use Perst DB for restaurant searching application, because we can access and store information using making object Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

13 SQLite DB Due to limitation of small memory, it does not provides all the feature of RDBMS Some other features that are not present in RDBMS are zero configuration, self-content, and server-less database It has a schema, thus we can design our own tables as we want Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

14 Comparison among Berkeley DB, Perst DB, and SQLite DB SQLite is a native database. It has a schema, so that we can design our own tables as we want Berkeley DB is an embedded database. It stores the data by key/value schema Perst DB is an object oriented, application specific database for storing real object information We cannot really compare properly, because each has some special property Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

15 Android Framework Figure : Android Framework Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

16 Loads on SQlite Application SQLite Device driver emmc/sd card Figure : Simple architecture of Android framework Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

17 Journal Mode of SQLite Rollback journal( Delete Mode) Persist Mode Write-Ahead Log(WAL) Mode Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

18 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

19 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

20 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

21 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

22 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

23 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

24 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

25 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

26 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

27 Rollback journal Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

28 Persist Mode Persist mode does not delete the journal file after committing. Instead, the header of the journal is overwritten with zeros. This will prevent other database connections from rolling. This is useful when deleting or truncating is much expensive than overriding Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

29 Write-Ahead Log(WAL) Mode The WAL approach inverts of Rollback journal The original content is preserved in the database file and the changes are appended into a separate WAL file COMMIT can happen without ever writing to the original database Allows readers to continue operating from the original unaltered database while changes are simultaneously being committed into the WAL Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

30 Write-Ahead Log(WAL) Mode Advantage WAL provides more concurrency as readers do not block writers and a writer does not block readers WAL uses fewer fsync() operations and is thus less vulnerable to problems on systems where the fsync() system call is broken Disadvantage All processes using a database must be on the same host computer. WAL does not work over a network file system WAL might be very slightly slower than the traditional rollback-journal approach in applications that do mostly reads and seldom write There is the extra operation of check pointing Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

31 Literature Survey on Monitoring Tool

32 Literature Survey on Monitoring Tool IOzone AndroBench MobiBench Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

33 IOzone IOzone is benchmark tool for file system It is not open source tool Used by computer vendors to measures the IO performance of accessing read, write, fread, and fwrite operations of a single file Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

34 Limitations It does not include fsync(). So, that we cannot measure the performance of SQLite In Android devices, there is no way of getting the superuser permission in user level for remounting and unmounting file, but IOzone need to superuser permission. So, it cannot measure the performance of Android devices Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

35 AndroBench AndroBench is a storage benchmarking tool for Android mobile devices It is not open source tool It measures the sequential and random IO performance and throughput of various SQLite transaction, i.e., insert, delete, and update Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

36 Limitations It has no method to measure the performance of fsync() call It does not allow changing synchronization option such as O SYNC, O DIRECT, and Mmap Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

37 MobiBench Mobibench is a storage performance benchmarking tool It combines both characteristics of IOzone and AndroBench It is implemented in two versions, first one shell application and second one is Android application It is implemented in C Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

38 Measure Tab of MobiBench Figure : measure tab Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

39 Setting Tab of MobiBench Figure : Measure tab Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

40 MobiBench Since, MobiBench is opensource Monitoring Tool We can enhance the performance of Mobibench Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

41 Testing on Aakash2 tablet Testing on Aakash2 tablet Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

42 Test Cases of Databases Performance Measurement Test Cases No. of Threads No. of Transactions Journal Mode Delete Delete Delete Persist Persist Persist WAL WAL WAL Table : Test cases for SQLite Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

43 Test result of the Aakash2 tablet Test. Case Throughput of Throughput of Throughput of Insert Update Delete Table : Database Performance of Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

44 Test result of the Aakash2 tablet Figure : Database performance of Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

45 Sourse Code Analysis of MobiBench Figure : Default table schema #define INSERT STR aaaaaaaaaabbbbbbbbbbccccccccccddddddddddeeeeeeeeeeffffffffffgggggggggghhhhhhhhhhiiiiiiiiiijjjjjjjjjj #define UPDATE STR ffffffffffgggggggggghhhhhhhhhhiiiiiiiiiijjjjjjjjjjaaaaaaaaaabbbbbbbbbbccccccccccddddddddddeeeeeeeeee Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

46 Source code analysis result of MobiBench MobiBench uses only one table and it has only three attributes It has macro variable for inserts and updates operations It does not perform any random string generation for inserting the data Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

47 Conclusion of Source code Analysis MobiBench is very simple and not realistic When we talk about the real application, there might be many tables for single application and might be many attribute for single table To make more realistic, we can provide many table to users based on real life application s table We can use random generation string for insertion and updation Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

48 Table Added in MobiBench Figure : system table schema Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

49 Table Added in MobiBench Figure : Bowser history table schema Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

50 Table Added in MobiBench Figure : WhatsApp table schema Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

51 Table Chooser option in Setting tab Figure : Choose table Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

52 Test result after Modification in MobiBench on Aakash2 Figure : Database performance of Browser table in Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

53 Test result after Modification in MobiBench on Aakash2 Figure : Database performance of System in Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

54 Test result after Modification of MobiBench on Aakash2 Figure : Database performance of WhatsApp in Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

55 Battery Consumption I installed batterychecker application Battery consumption of database performance on Aakash2 using the given the test cases is approximately 11% When we performed test on new added table, it consumed approximate 40% of battery of Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

56 Conclusion We added three table based on real life application in MobiBench We added random generation string function in MobiBench Now, user can able to measure the performance using different table We found WAL mode give best throughput among available mode Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

57 Future work We can add more tables related to a single database, so that a single transaction is required to access more than one table We can give a file import option to the user, so that they can import their own table schema to perform any test Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

58 Thank You Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58

59 Enhancement of Open Source Monitoring Tool for Small Footprint June 22, Databases / 58