Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases

Transcription

1 Enhancement of Open Source Monitoring Tool for Small Footprint Databases Sukh Deo Under the guidance of Prof. Deepak B. Phatak Dept. of CSE IIT Bombay June 23, 2014 Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

2 Introduction and Motivation Table of Contents 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

3 Motivation Introduction and Motivation Motivation Todays mobile devices are multi-functional devices Mobile devices are siblings of personal computers People want to use many applications on mobile device Mobile device has some limitations Limited memory Battery issues Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

4 Motivation Introduction and Motivation Motivation Figure : Smart-phone s Users Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

5 Introduction and Motivation Small footprint databases What is Small footprint databases? Scale down of usual databases Called lightweight databases or embedded databases Specially designed for mobile devices Example, Berkeley DB, Perst DB, and SQLite Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

6 SQLite DB Introduction and Motivation SQLite and Journaling Due to limitation of small memory, it does not provides all the feature of RDBMS Some other features that are not present in RDBMS are zero configuration, self-content, and server-less database It has a schema, thus we can design our own tables as we want If we enable all the features of SQLite, size will be 500Kb If we disable WAL mode or Delete Mode, the size of SQLite library will be 300KB Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

7 Android Framework Introduction and Motivation SQLite and Journaling Figure : Android Framework Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

8 Loads on SQlite Introduction and Motivation SQLite and Journaling Application SQLite Device driver emmc/sd card Figure : Simple architecture of Android framework Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

9 Introduction and Motivation Journal Mode of SQLite SQLite and Journaling Rollback journal( Delete Mode) Persist Mode Write-Ahead Log(WAL) Mode Enhancement of Open Source Monitoring Tool for Small Footprint JuneDatabases 23, / 53

10 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

11 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

12 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

13 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

14 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

15 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

16 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

17 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

18 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

19 Rollback journal Introduction and Motivation SQLite and Journaling Figure : commit process Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

20 Persist Mode Introduction and Motivation SQLite and Journaling Persist mode does not delete the journal file after committing. Instead, the header of the journal is overwritten with zeros. This will prevent other database connections from rolling. This is useful when deleting or truncating is much expensive than overriding Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

21 Introduction and Motivation Write-Ahead Log(WAL) Mode SQLite and Journaling The WAL approach inverts of Rollback journal The original content is preserved in the database file and the changes are appended into a separate WAL file COMMIT can happen without ever writing to the original database Allows readers to continue operating from the original unaltered database while changes are simultaneously being committed into the WAL Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

22 Table of Contents Monitoring Tools 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

23 Literature Survey on Monitoring Tool

24 Monitoring Tools Literature Survey on Monitoring Tool IOzone AndroBench MobiBench Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

25 IOzone Monitoring Tools IOzone is benchmark tool for file system Used by computer vendors to measures the IO performance of accessing read, write, fread, and fwrite operations of a single file Limitations: It does not include fsync(). So, that we cannot measure the performance of SQLite In Android devices, there is no way of getting the superuser permission in user level for remounting and unmounting file, but IOzone need to superuser permission to clear the cache. So, it cannot portable for Android devices Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

26 IOzone Monitoring Tools IOzone is benchmark tool for file system Used by computer vendors to measures the IO performance of accessing read, write, fread, and fwrite operations of a single file Limitations: It does not include fsync(). So, that we cannot measure the performance of SQLite In Android devices, there is no way of getting the superuser permission in user level for remounting and unmounting file, but IOzone need to superuser permission to clear the cache. So, it cannot portable for Android devices Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

27 AndroBench Monitoring Tools It measures the sequential and random IO performance and throughput of various SQLite transaction, i.e., insert, delete, and update Limitation: It has no method to measure the performance of fsync() call It does not allow changing synchronization option such as O SYNC, O DIRECT, and Mmap Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

28 AndroBench Monitoring Tools It measures the sequential and random IO performance and throughput of various SQLite transaction, i.e., insert, delete, and update Limitation: It has no method to measure the performance of fsync() call It does not allow changing synchronization option such as O SYNC, O DIRECT, and Mmap Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

29 MobiBench Monitoring Tools Mobibench is a storage performance benchmarking tool It combines both characteristics of IOzone and AndroBench It is implemented in two versions, first one shell application and second one is Android application It is implemented in C Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

30 Monitoring Tools Measure Tab of MobiBench Figure : measure tab Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

31 Monitoring Tools Setting Tab of MobiBench Figure : Measure tab Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

32 Test Result of MobiBench on Aakash Tablet Table of Contents 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

33 Test Result of MobiBench on Aakash Tablet Testing on Aakash2 tablet Testing on Aakash2 tablet Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

34 Test Result of MobiBench on Aakash Tablet Test Cases of Databases Performance Measurement Test Cases No. of Threads No. of Transactions Journal Mode Delete Delete Delete Persist Persist Persist WAL WAL WAL Table : Test cases for SQLite Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

35 Test Result of MobiBench on Aakash Tablet Test result of the Aakash2 tablet Test. Case Throughput of Throughput of Throughput of Insert Update Delete Table : Database Performance of Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

36 Test Result of MobiBench on Aakash Tablet Test result of the Aakash2 tablet Figure : Database performance of Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

37 Sourse Code Analysis of MobiBench Table of Contents 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

38 Sourse Code Analysis of MobiBench Sourse Code Analysis of MobiBench Figure : Default table schema #define INSERT STR aaaaaaaaaabbbbbbbbbbccccccccccddddddddddeeeeeeeeeeffffffffffgggggggggghhhhhhhhhhiiiiiiiiiijjjjjjjjjj #define UPDATE STR ffffffffffgggggggggghhhhhhhhhhiiiiiiiiiijjjjjjjjjjaaaaaaaaaabbbbbbbbbbccccccccccddddddddddeeeeeeeeee Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

39 Sourse Code Analysis of MobiBench Source code analysis result of MobiBench MobiBench uses only one table and it has only three attributes It has macro variable for inserts and updates operations It does not perform any random string generation for inserting the data Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

40 Sourse Code Analysis of MobiBench Conclusion of Source code Analysis MobiBench is very simple and not realistic When we talk about the real application, there might be many tables for single application and might be many attribute for single table To make more realistic, we can provide many table to users based on real life application s table We can use random generation string for insertion and updation Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

41 Modification on MobiBench Table of Contents 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

42 Modification on MobiBench Table Added in MobiBench Figure : system table schema Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

43 Modification on MobiBench Table Added in MobiBench Figure : Bowser history table schema Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

44 Modification on MobiBench Table Added in MobiBench Figure : WhatsApp table schema Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

45 Modification on MobiBench Table Chooser option in Setting tab Figure : Choose table Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

46 Test Result after Modification of MobiBench on Aakash tablet Table of Contents 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

47 Test Result after Modification of MobiBench on Aakash tablet Database performance of Browser table Figure : Database performance of Browser table in Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

48 Test Result after Modification of MobiBench on Aakash tablet Database performance of System Figure : Database performance of System in Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

49 Test Result after Modification of MobiBench on Aakash tablet Database performance of WhatsApp Figure : Database performance of WhatsApp in Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

50 Test Result after Modification of MobiBench on Aakash tablet Battery Consumption Battery consumption during testing I installed batterychecker application Battery consumption of database performance on Aakash2 using the given the test cases is approximately 11% When we performed test on new added table, it consumed approximate 40% of battery of Aakash2 Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

51 Conclusion and Future Work Table of Contents 1 Introduction and Motivation Motivation What is Small footprint databases? SQLite and Journaling 2 Monitoring Tools 3 Test Result of MobiBench on Aakash Tablet 4 Sourse Code Analysis of MobiBench 5 Modification on MobiBench 6 Test Result after Modification of MobiBench on Aakash tablet Battery consumption during testing 7 Conclusion and Future Work Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

52 Conclusion Conclusion and Future Work We added three table based on real life application in MobiBench We added random generation string function in MobiBench Now, user can able to measure the performance using different table We found WAL mode give best throughput among available mode Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

53 Future work Conclusion and Future Work We can add more tables related to a single database, so that a single transaction is required to access more than one table We can give a file import option to the user, so that they can import their own table schema to perform any test Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

54 Conclusion and Future Work Thank You Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53

55 Conclusion and Future Work /dokuwiki/images/5/5d/stage2report.pdf Enhancement of Open Source Monitoring Tool for Small Footprint June 23, Databases / 53