UNIVERSITI PUTRA MALAYSIA CUSTOM WINDOWS PERFORMANCE COUNTERS MONITORING MECHANISM FOR MEASURING QUALITY OF SERVICE ATTRIBUTES AND STABILITY COEFFICIENT IN SERVICE- ORIENTED ARCHITECTURE BAHAREH SADAT ARAB FSKTM 2010 7
CUSTOM WINDOWS PERFORMANCE COUNTERS MONITORING MECHANISM FOR MEASURING QUALITY OF SERVICE ATTRIBUTES AND STABILITY COEFFICIENT IN SERVICE-ORIENTED ARCHITECTURE By BAHAREH SADAT ARAB Thesis Submitted to the School of Graduate Studies, Universiti Putra Malaysia, in Fulfilment of the Requirements for the Degree of Master of Science December 2010
To my family ii
Abstract of thesis presented to the Senate of Universiti Putra Malaysia in fulfilment of the requirement for the degree of Master of Science CUSTOM WINDOWS PERFORMANCE COUNTERS MONITORING MECHANISM FOR MEASURING QUALITY OF SERVICE ATTRIBUTES AND STABILITY COEFFICIENT IN SERVICE-ORIENTED ARCHITECTURE By BAHAREH SADAT ARAB December 2010 Chairman: Professor Abdul Azim Abd. Ghani, PhD Faculty: Computer Science and Information Technology Service-Oriented Architecture (SOA) has been widely used for different types of systems as their underlying architecture. The most popular technology that implements the SOA is web service. When several web services provide same functionalities, Quality of Service (QoS) of web services turn to be an important issue. In this study, monitoring is used in order to measure QoS attributes of web services in SOA. Several monitoring mechanisms have been proposed. Windows Performance Counters (WPC) is one of approaches for monitoring services at provider-side. However, WPC monitoring approach has a limitation and it can be employed just for WCF services. Moreover, predefined system counter values do not map to QoS values properly. iii
In this research, a new provider-side monitoring mechanism which is based on Custom Windows Performance Counters (CWPC) is proposed in order to overcome current limitations. CWPC will be set to measure QoS attributes of web services such as response time, throughput and reliability properly. The results of CWPC monitoring are useful in taking decision in adjusting suitable monitoring interval for the system. Additionally, the result verifies that CWPC is an accurate monitoring approach for measuring QoS attributes. Besides that, this study also focuses on variability of QoS values which are obtained by monitoring of web services at different service invocation time. QoS values are variable and service consumers may experience various QoS values due to the fact that web services run in a distributed, dynamic, and unreliable environment which makes them exposed to faults and failures. In this research, a new Stability Coefficient is introduced to measure stability of a service based on historical QoS values that were obtained by monitoring the web service. Such a measure enables service consumers to find a stable and trustable service based on QoS attributes and it can increase consumer s satisfaction. In this study, the Stability Coefficient is defined based on an average of different QoS attributes of service stability. The results confirm that the proposed Stability Coefficient is a proper criterion for determining stability of services in terms of their QoS attributes and a stable service with less QoS values variation has a high Stability Coefficient which may lead to more satisfaction to service consumer. iv
Abstrak tesis yang dikemukakan kepada Senat Universiti Putra Malaysia sebagai memenuhi keperluan untuk ijazah Master Sains PEMBILANG PRESTASI TETINGKAP MENGIKUT KEADAAN SEBAGAI MEKANISMA PEMANTAUAN UNTUK MENGUKUR ATRIBUT KUALITI PERKHIDMATAN DAN KOEFFISYEN KESTABILAN DALAM SENIBINA BERORIENTASI PERKHIDMATAN Oleh BAHAREH SADAT ARAB Disember 2010 Pengerusi: Prof. Abdul Azim Abd. Ghani, PhD Fakulti: Sains Komputer dan Teknologi Maklumat Senibina Berorientasikan Perkhidmatan (SBP) telah digunakan secara meluas untuk sistem yang berlainan jenis sebagai senibina asas. Teknologi yang paling popular mengimplementasi SBP ialah perkhidmatan web. Apabila beberapa perkhidmatan web menyediakan fungsi yang sama, Kualiti Perkhidmatan (KP) perkhidmatan web menjadi isu penting. Dalam kajian ini, pemantauan digunakan untuk mengukur atribut perkhidmatan web dalam SBP. Beberapa mekanisma pemantauan telah dicadangkan. Pembilang Prestasi Tetingkap (PPT) ialah salah satu pendekatan untuk memantau perkhidmatan di pihak pembekal. Walaubagaimana pun, pendekatan pemantauan PPT menpunyai kekurangan dan ianya hanya boleh digunakan untuk perkhidmatan WCF. Tambahan pula nilai pembilang sistem pratertakrif tidak dipeta ke nilai Kualiti Perkhidmatan sewajarnya. v
Dalam penyelidikan ini, mekanisma baharu pemantauan pihak pembekal berdasarkan Pembilang Prestasi Tetingkap Mengikut Keadaan (PPTMK) dicadangkan untuk mengatasi kekurangan semasa. PPTMK akan disetkan sewajarnya untuk mengukur atribut KP perkhidmatan web seperti masa tindak balas, daya pemprosesan, dan kebolehpercayaan. Keputusan pemantauan PPTMK adalah berguna dalam mengambil keputusan untuk melaraskan interval pemantauan sistem yang sesuai. Selain itu, keputusan mengesahkan bahawa PPTMK ialah pendekatan pemantauan yang tepat untuk mengukur atribut KP. Disamping itu, kajian ini juga memfokus kepada keberubahan nilai KP yang diperoleh melalui pemantauan perkhidmatan web di waktu panggilan berbeza perkhidmatan. Nilai KP adalah berubah dan pengguna perkhidmatan mungkin mengalami perubahan pelbagai nilai KP yang disebabkan oleh larian perkhidmatan web dalam suasana teragih, dinamik, dan tidak boleh dipercayai menyebabkan ianya terdedah kepada kegagalan dan kerosakan. Dalam penyelidikan ini, Koefisien Kestabilan diperkenalkan untuk mengukur kestabilan perkhidmatan berdasarkan kepada nilai sejarah KP yang diperoleh melalui pemantauan perkhidmatan web. Ukuran tersebut membenarkan pengguna perkhidmatan mencari perkhidmatan yang stabil dan boleh dipercayai berdasarkan atribut KP dan ia dapat menambahkan kepuasan pengguna. Dalam kajian ini, Koefisien Kestabilan ditakrif berdasarkan kepada purata kestabilan perkhidmatan atribut KP yang berbeza. Keputusan mengesahkan bahawa koefisien kestabilan yang dicadangkan ialah kriteria wajar untuk menentukan kestabilan perkhidmatan dalam sebutan nilai KP dan vi
perkhidmatan stabil dengan perbezaan nilai KP yang kecil mempunyai Koefisien Kestabilan tinggi yang menyebabkan lebih kepuasan kepada pengguna perkhidmatan. vii
ACKNOWLEGEMENTS I would like to extend my sincerest thanks to my supervisor, Prof.Dr. Abdul Azim Abdul. Ghani, for his excellent guidance and precious advice during the course of this research. I truly appreciate the time he devoted in advising me and showing me the proper directions to continue this research. I would like to extend my gratitude to my co-supervisor, Dr Rodziah Binti Atan, for her advices and insightful comments. I am indebted for her knowledge and helpful contributions on this thesis. I would like to express my deep gratefulness to my parent for providing me the opportunity to continue my master s program and financial support. Specially, I owe gratitude to my mother, Zohreh for her patients, love and support during my whole life. Finally, I would like to thank my lab mates and friends who have provided endless inspiration during my study. viii
APPROVAL I certify that a Thesis Examination Committee has met on 13 December 2010 to conduct the final examination of Bahareh Sadat Arab on her thesis entitled Custom Windows Performance Counters Monitoring Mechanism for Measuring Quality of Service Attributes and Stability Coefficient in Service-Oriented Architecture" in accordance with the Universities and University Colleges Act 1971 and the Constitution of the Universiti Putra Malaysia [P.U. (A) 106] 15 March 1998. The Committee recommends that the student be awarded the Master of Science. Members of the Examination Committee are as follows: Ali Mamat, PhD Associate Professor Faculty of Computer Science and Information Technology Universiti Putra Malaysia (Chairman) Abu Bakar b Md Sultan, PhD Associate Professor Faculty of Computer Science and Information Technology Universiti Putra Malaysia (Internal Examiner) Masrah Azrifah binti Azmi Murad, PhD Lecturer Faculty of Computer Science and Information Technology Universiti Putra Malaysia (External Examiner) Wan Mohd. Nasir Wan Kadir, PhD Associate Professor Universiti Teknologi Malaysia (External Examiner) SHAMSUDDIN SULAIMAN, PhD Professor and Deputy Dean School of Graduate Studies Universiti Putra Malaysia Date: 18 January 2011 ix
This thesis was submitted to the Senate of Universiti Putra Malaysia and has been accepted as fulfilment of the requirements for the degree of Master of Science. The members of the Supervisory Committee were as follows: Abdul Azim Abdul. Ghani, PhD Professor Faculty of Computer Science and Information Technology Universiti Putra Malaysia (Chairman) Rodziah binti Atan, PhD Lecturer Faculty of Computer Science and Information Technology Universiti Putra Malaysia (Member) HASANAH MOHD GHAZALI, PhD Professor and Dean School of Graduate Studies Universiti Putra Malaysia Date: x
DECLARATION I declare that the thesis is my original work except for quotations and citations which have been duly acknowledged. I also declare that it has not been previously, and is not concurrently, submitted for any other degree at Universiti Putra Malaysia or at any other institutions. BAHAREH SADAT ARAB Date: 13 December 2010 xi
TABLE OF CONTENTS Page DEDICATION ABSTRACT ABSTRAK ACKNOWLEDGEMENT APPROVAL DECLARATION LIST OF TABLES LIST OF FIGURES LIST OF ABRIVATIONS ii iii v viii ix xi xiv xv xvii CHAPTER 1 INTRODUCTION 1 1.1 Background 1 1.2 Problem Statement 4 1.3 Research Objectives 6 1.4 Research Scope and Limitation 6 1.5 Research Contribution 7 1.6 Overview of Thesis 8 2 LITERATURE REVIEW 10 2.1 Introduction 10 2.2 Quality of Services 10 2.3 QoS Model for Web Services 14 2.3.1 QoS Models for QoS Measurement 15 2.3.2 QoS Models for Service Selection 16 2.3.3 QoS Models for Service Composition 18 2.4 Stability 18 2.4.1 Stability for Service 19 2.4.2 Stability for Quality of Service 19 2.5 Monitoring of Web Services 20 2.5.1 Consumer-side Monitoring 21 2.5.2 Provider-side Monitoring 23 2.5.3 Third-party Monitoring 30 2.6 QoS and Web Services Discovery 37 2.7 Summary 41 3 RESEARCH METHODOLOGY 43 3.1 Introduction 43 3.2 General Steps of Methodology 45 3.3 Literature Review 46 xii
3.4 Design Web Service Architecture 46 3.5 Monitoring Mechanism 47 3.6 Stability Coefficient 49 3.7 Evaluation Parameters 49 3.8 Implementation Set up 51 3.9 Experimental Design 53 3.10 Summary 57 4 CUSTOM WINDOWS PERFORMANCE COUNTER MONITORING MECHANISM IN SOA 58 4.1 Introduction 58 4.2 Design Web Service Architecture 58 4.2.1 Service Consumer 59 4.2.2 Discovery Manager 59 4.2.3 UDDI Registry and QoS Information 60 4.2.4 Publish Manager 62 4.2.5 Service Provider 63 4.2.6 QoS Manager 64 4.3 Monitoring Mechanism 64 4.3.1 Defining the Counters to Windows 65 4.3.2 Setting the Value of the Counters 68 4.3.3 Setting and Scheduling Performance Logs 71 4.3.4 Analyzing Performance Logs 78 4.4 Stability Coefficient 79 4.5 Summary 80 5 EXPERIMENT RESULTS AND DISCUSSIONS 81 5.1 Introduction 81 5.2 Experiment 1: Nondeterministic QoS and Monitoring 81 5.2.1 Experiment Setups 82 5.2.2 Results and Discussions 82 5.3 Experiment 2: Accuracy of the CWPC monitoring 87 5.3.1 Experiment Setups 87 5.3.2 Results and Discussions 88 5.4 Experiment 3: Nondeterministic QoS and Stability coefficient 93 5.4.1 Experiment Setups 93 5.4.2 Results and Discussions 93 5.5 Summary 98 6 CONCLUSION AND FUTURE WORKS 100 6.1 Conclusion 100 6.2 Future Works 102 REFERENCES 104 BIODATA OF STUDENT 109 LIST OF PUBLICATIONS 110 xiii