TABLE OF CONTENTS CHAPTER NO. TITLE PAGE NO. ABSTRACT 5 LIST OF TABLES LIST OF FIGURES LIST OF SYMBOLS AND ABBREVIATIONS xxi

Size: px

Start display at page:

Download "TABLE OF CONTENTS CHAPTER NO. TITLE PAGE NO. ABSTRACT 5 LIST OF TABLES LIST OF FIGURES LIST OF SYMBOLS AND ABBREVIATIONS xxi"

Sheryl Edwards
5 years ago
Views:

1 ix TABLE OF CONTENTS CHAPTER NO. TITLE PAGE NO. ABSTRACT 5 LIST OF TABLES xv LIST OF FIGURES xviii LIST OF SYMBOLS AND ABBREVIATIONS xxi 1 INTRODUCTION INTRODUCTION WEB CACHING Classification of Web Cache Cache Replacement Algorithms Properties of WWW Caching System PREFETCHING Classification of Prefetching Algorithms CO-OPERATIVE CACHING OBJECTIVES PROPOSED SYSTEM ARCHITECTURE Access Log Manager (ALM) with SVM Classifier Cluster Based Proxy Cache Manager (PCM) Dynamic Hash Table (DHT) Based Co-operative Client Cache Manager System (CCM) PERFORMANCE METRICS 15

2 x CHAPTER NO. TITLE PAGE NO Web Caching Performance Metrics Prefetch Metrics THESIS ORGANIZATION 18 2 LITERATURE REVIEW INTRODUCTION WEB CACHING Web Caching Algorithms Studies Based on Web Caching PREFETCHING Types of Web Prefetching Approaches to Web Prefetching Studies on Web Prefetching Techniques Clustering Based Prefetching INTEGRATING WEB CACHING AND PREFETCHING TECHNIQUES CO-OPERATIVE CACHING Co-operative Caching Mechanisms Co-operative Caching Algorithms Studies Based on Co-operative Caching SUMMARY 44 3 ACCESS LOG MANAGER (ALM) INTRODUCTION INTRODUCTION TO ACCESS LOG MANAGER ACCESS LOG MANAGER PROCESS SVM CLASSIFIER FRAMEWORK FOR GENERATING INPUT DATASET USING ALM 50

3 xi CHAPTER NO. TITLE PAGE NO Raw Data Collection OFFLINE COMPONENT OF ACCESS LOG MANAGER Sample Log File Log File Contents DATA PRE-PROCESSING DATA CLEANING TRAINING PHASE ALM PERFORMANCE Classifier Metrics Web Cache Performance Measures SUMMARY 64 4 CLUSTER BASED PROXY CACHE MANAGER INTRODUCTION FRAMEWORK OF PROXY CACHE MANAGER Authentication Manager for Proxy Cache System Constructing Web Navigational Graph (WNG) Association Rule Mining Inter Custer Creation Algorithm for Proxy Cache System IMPACT OF SVM FOR VARIOUS CONFIDENCES AND SUPPORT THRESHOLDS CLUSTER BASED PREDICTION AND PREFETCHING 76

4 xii CHAPTER NO. TITLE PAGE NO Hybrid CRF Algorithm for Cache Replacement Performance Evaluation of CRF Algorithm IMPACT OF CACHE SIZE ON PERFORMANCE MEASURES SUMMARY 82 5 CO-OPERATIVE CLIENT CACHE MANAGER SYSTEM INTRODUCTION CO-OPERATIVE HYBRID ARCHITECTURE DHT BASED CO-OPERATIVE CLIENT CACHE MANAGER SYSTEM (CCM) Identifier Creation by Hashing Algorithm Finger table Key value pair table Node Create and Join Procedures Routing Algorithm Node Stabilize Algorithm Resource Searching Algorithm Node Exit Algorithm QUERY INTEGRATOR CLIENT CACHE MANAGEMENT SUMMARY PERFORMANCE EVALUATION AND ANALYSIS 116

5 xiii 6.1 INTRODUCTION 116 CHAPTER NO. TITLE PAGE NO. 6.2 EXPERIMENTAL SETUP AND IMPLEMENTATION ACCESS LOG MANAGER PERFORMANCE ANALYSIS CLASSIFIER EVALUATION EFFECTIVENESS OF THE WEB CACHING SOS Management through Hybrid Algorithm Cluster Based Proxy Server Cache Management through Combined LRU and LFU Algorithm Efficiency improvement by CRF in sample data sets THE EFFECTIVENESS OF PREFETCHING AVERAGE NETWORK TRAFFIC IMPACT OF CONFIDENCE AND SUPPORT THRESHOLD Analysis of Precision and Recall for Different Support Values IMPACT OF CACHE SIZE ON PERFORMANCE MEASURES PERFORMANCE ANALYSIS OF SIMULATION COMPARISON OF DEVELOPED APPROACH WITH EXISTING APPROACHES SUMMARY 143

6 xiv CHAPTER NO. TITLE PAGE NO. 7 CONCLUSION AND FUTURE WORKS SUMMARY MAJOR FINDINGS CONCLUSION SCOPE FOR FUTURE WORK 147 APPENDIX APPENDIX REFERENCES 156 LIST OF PUBLICATIONS 162

7 xv LIST OF TABLES TABLE NO. TITLE PAGE NO. 3.1 Details of proxy server Resultant preprocessed data Algorithm for removing irrelevant records SVM efficiency for various values of C and SVM classification algorithm Classifier measures of testing datasets Statistics of proxy datasets after SVM classification No. of web objects Vs classification efficiency Algorithm for cluster creation Impact of cache size on hit ratio for support 2 and confidence Impact of cache size on hit ratio for support 4 and confidence Impact of cache size on hit ratio for support 6 and confidence Impact of cache size on hit ratio for support 8 and confidence Pseudo-code for prediction and prefetching CRF algorithm Impact of cache size on hit ratio for proxy data set UC Impact of cache size on hit ratio for proxy data set BO Impact of cache size on hit ratio for proxy data 81

8 xvi TABLE NO. TITLE PAGE NO. set SV 4.11 Impact of cache size on hit ratio for proxy data set SD Impact of cache size on hit ratio for proxy data set NY Object ID Table with sample clients Finger Table for node C Finger Table for node C Finger Table for node C Finger Table for node C Finger Table for node C Finger Table for node C Finger Table for node C Finger Table for node C Key Value Pair Table for Node C Key Value Pair Table for Node C Key Value Pair Table for Node C Key Value Pair Table for Node C Key Value Pair Table for Node C Key Value Pair Table for Node C Key Value Pair Table for Node C Key Value Pair Table for Node C Object ID table after joining node C Object ID table after deleting node C Comparison of recency and frequency wise retrieval with proposed system Average network traffic CPU utilization and server load based on proxy 129

9 xvii TABLE NO. TITLE PAGE NO. presence 6.3 Improvement ratio comparison of SVM hybrid with other methods Performance analysis of proposed system Cache performance results 142

10 xviii LIST OF FIGURES FIGURE NO. TITLE PAGE NO. 1.1 Storage hierarchy Classification of web cache Classification of prediction algorithms Co-operative web caching system System architecture for information retrieval Access Log Manager Process Classifications of data by SVM Training data classification by machine learning Technique Snapshot of sample proxy server log Framework of cluster based proxy cache manager Client registration Client registration failure Snapshot of sample proxy cache content Snapshot of frequency updated sample cache content optimization Example Web Navigational Graph Client Cache Manager Modules integration process Hybrid architeuctue uesd in the system Co-operative chord network for shared objects with finger table Co-operative chord network after joining C Co-operative chord network after relieving C8 106

11 xix FIGURE NO. TITLE PAGE NO. 5.6 Snapshot of query integrator SOS object creation Work break down structure Classification efficiency Comparison Redundancy rate comparison with web objects Analysis of hit ratio Analysis of byte hit ratio Comparison of cache hit ratio in uc data set Comparison of cache hit ratio in bo2 data set Comparison of cache hit ratio in sv data set Comparison of cache hit ratio in sd data set Comparison of cache hit ratio in ny data set Precision and Recall percentages for all five data sets Hit ratio Vs cache size for Support :2 Confidence: Hit ratio Vs cache size for Support :4 Confidence: Hit ratio Vs cache size for Support :6 Confidence: Hit ratio Vs cache size for Support :8 Confidence: Byte hit ratio Vs cache size for Support :2 Confidence: Byte hit ratio Vs cache size for Support :4 Confidence: Byte hit ratio Vs cache size for Support :6 Confidence: Byte hit ratio Vs cache size for Support :8 134

12 xx FIGURE NO. TITLE PAGE NO. Confidence: Analysis of access latency Precision and Recall analysis Breakdown of request handling Comparison of access latency Vs number of Peers Performance comparison of client server and developed system Performance analysis of proposed system 142

13 xxi LIST OF SYMBOLS AND ABBREVIATIONS APACS - A Proxy Agent for Client System ALM - Access Log Manager AI - Artificial Network ANN - Artificial Neural Network ANFIS - Artificial Neuro Fuzzy Information System AS - Autonomous System BPNN - Back Propagation Neural Network BHR - Byte Hit Ratio CCM - Client Cache Manager CRF - Combined Recency Frequency CCN - Content Centric Network CON - Content Oriented Network CP - Content Provider CCR - Correct Classification Rate DG - Dependency Graph DNS - Domain Name Server DDG - Double Dependency Graph DHT - Dynamic Hash Table EC - End Consumer XML - Extensible Markup Language FFS - Fast Frequency server FI - Finite Inductive FIFO - First In First Out GA - Genetic Algorithm GM - Geometric Mean GDS - Greedy Dual Size

14 xxii GDFS - Greedy Dual Size Frequency HR - Hit Ratio HTML - Hyper Text Markup Language ID - Identifier IP - Internet Protocol ISP - Internet Service Provider LFU - Least Frequently Used LRU - Least Recently Used LAC - Local Access Counter MRU - Most Recently Used NLANR - National Laboratory of Applied Network Research NN - Neural Network PSO - Particle Swarm Optimization P2P - Peer to Peer PPE - Prediction Prefetching Engine PCM - Proxy Cache Manager RR - Random Replacement RS - Rough Set RTT - Round Trip Time SHA1 - Secure Hashing Algorithm 1 SAC - Sharable Access Counter SOS - Sharable Object Space SWNET - Social Wireless Network SV - Support Vector SVM - Support Vector Machine TTL - Time To Live TNR - True Negative Rate TPR - True Positive Rate URL - Uniform Resource Locator

15 xxiii WNG - Web Navigational Graph WSE - Web Search Engine WAN - Wide Area Network WWW - World Wide Web

TABLE OF CONTENTS CHAPTER NO. TITLE PAGENO. LIST OF TABLES LIST OF FIGURES LIST OF ABRIVATION

TABLE OF CONTENTS CHAPTER NO. TITLE PAGENO. LIST OF TABLES LIST OF FIGURES LIST OF ABRIVATION vi TABLE OF CONTENTS ABSTRACT LIST OF TABLES LIST OF FIGURES LIST OF ABRIVATION iii xii xiii xiv 1 INTRODUCTION 1 1.1 WEB MINING 2 1.1.1 Association Rules 2 1.1.2 Association Rule Mining 3 1.1.3 Clustering