Copyright 2011 please consult the authors

Similar documents
Data Mining with Oracle 10g using Clustering and Classification Algorithms Nhamo Mdzingwa September 25, 2005

People Recommendation Based on Aggregated Bidirectional Intentions in Social Network Site

Comment Extraction from Blog Posts and Its Applications to Opinion Mining

A Survey on Various Techniques of Recommendation System in Web Mining

Asia Top Internet Countries June 30, 2012 China 538 India Japan Indonesia Korea, South Philippines Vietnam Pakistan Thailand Malaysia

Evaluating Three Scrutability and Three Privacy User Privileges for a Scrutable User Modelling Infrastructure

Domain Specific Search Engine for Students

An Efficient Clustering Method for k-anonymization

Repositorio Institucional de la Universidad Autónoma de Madrid.

A Constrained Spreading Activation Approach to Collaborative Filtering

The Comparative Study of Machine Learning Algorithms in Text Data Classification*

Factors Influencing the Quality of the User Experience in Ubiquitous Recommender Systems

Collaborative Filtering using Euclidean Distance in Recommendation Engine

Supplementary file for SybilDefender: A Defense Mechanism for Sybil Attacks in Large Social Networks

Music Recommendation with Implicit Feedback and Side Information

Exploiting Index Pruning Methods for Clustering XML Collections

A Hybrid Recommender System for Dynamic Web Users

5 An Adaptive Implicit Feedback Model

Hybrid Recommendation System Using Clustering and Collaborative Filtering

Social Interaction Based Video Recommendation: Recommending YouTube Videos to Facebook Users

Ranking Web Pages by Associating Keywords with Locations

A probabilistic model to resolve diversity-accuracy challenge of recommendation systems

A Constrained Spreading Activation Approach to Collaborative Filtering

Making social interactions accessible in online social networks

Advances in Natural and Applied Sciences. Information Retrieval Using Collaborative Filtering and Item Based Recommendation

A Feature Selection Method to Handle Imbalanced Data in Text Classification

Bayesian Spam Detection System Using Hybrid Feature Selection Method

Taking Advantage of Semantics in Recommendation Systems

Multi-Stage Rocchio Classification for Large-scale Multilabeled

Introducing Partial Matching Approach in Association Rules for Better Treatment of Missing Values

Content-Based Filtering Algorithm for Mobile Recipe Application

Keywords Hadoop, Map Reduce, K-Means, Data Analysis, Storage, Clusters.

Enhanced Performance of Database by Automated Self-Tuned Systems

Fast Efficient Clustering Algorithm for Balanced Data

WEB SEARCH, FILTERING, AND TEXT MINING: TECHNOLOGY FOR A NEW ERA OF INFORMATION ACCESS

Social Navigation Support through Annotation-Based Group Modeling

Open-Corpus Adaptive Hypermedia. Adaptive Hypermedia

Acquisition & Retention through Mobile. Brian D Arcy Commercial Director O2 Media

Flight Recommendation System based on user feedback, weighting technique and context aware recommendation system

QUERY RECOMMENDATION SYSTEM USING USERS QUERYING BEHAVIOR

Open-Corpus Adaptive Hypermedia. Peter Brusilovsky School of Information Sciences University of Pittsburgh, USA

Link Prediction for Social Network

Create a Profile for User Using Web Usage Mining

A PERSONALIZED RECOMMENDER SYSTEM FOR TELECOM PRODUCTS AND SERVICES

IMPLEMENTATION OF INFORMATION RETRIEVAL (IR) ALGORITHM FOR CLOUD COMPUTING: A COMPARATIVE STUDY BETWEEN WITH AND WITHOUT MAPREDUCE MECHANISM *

Research and Application of E-Commerce Recommendation System Based on Association Rules Algorithm

Independent Study Report IS2970, Fall How Your Users Help You: A Survey of Feedback Mechanism in Social Network Sites.

EVALUATION OF THE USABILITY OF EDUCATIONAL WEB MEDIA: A CASE STUDY OF GROU.PS

COMP6237 Data Mining Making Recommendations. Jonathon Hare

To Study the Usage & Awareness of M- Commerce and its services with reference to Nagpur City

Search Costs vs. User Satisfaction on Mobile

Ericsson Mobility Report

Axiomatic Approaches to Information Retrieval - University of Delaware at TREC 2009 Million Query and Web Tracks

Enhancing Cluster Quality by Using User Browsing Time

COMMUNITY SHELL S EFFECT ON THE DISINTEGRATION OF SOCIAL NETWORKS

Empowering People with Knowledge the Next Frontier for Web Search. Wei-Ying Ma Assistant Managing Director Microsoft Research Asia

A Weighted Majority Voting based on Normalized Mutual Information for Cluster Analysis

Enhancing Cluster Quality by Using User Browsing Time

How Social Is Social Bookmarking?

Using Data Mining to Determine User-Specific Movie Ratings

Video annotation based on adaptive annular spatial partition scheme

A study of Video Response Spam Detection on YouTube

Mining for User Navigation Patterns Based on Page Contents

An Algorithm of Parking Planning for Smart Parking System

The Effect of Word Sampling on Document Clustering

Case-based Recommendation. Peter Brusilovsky with slides of Danielle Lee

Effect of log-based Query Term Expansion on Retrieval Effectiveness in Patent Searching

An Empirical Analysis of Communities in Real-World Networks

Finding Hubs and authorities using Information scent to improve the Information Retrieval precision

User Exploration of Slider Facets in Interactive People Search System

SEQUENTIAL PATTERN MINING FROM WEB LOG DATA

JAPAN CYBER-SAVVINESS REPORT 2016 CYBERSECURITY: USER KNOWLEDGE, BEHAVIOUR AND ATTITUDES IN JAPAN

Enhancing K-means Clustering Algorithm with Improved Initial Center

Statistical Performance Comparisons of Computers

A New Technique to Optimize User s Browsing Session using Data Mining

System For Product Recommendation In E-Commerce Applications

A Modified Mean Shift Algorithm for Visual Object Tracking

FOUNDATIONS OF A CROSS-DISCIPLINARY PEDAGOGY FOR BIG DATA *

Similarity Joins in MapReduce

Recommendation System for Location-based Social Network CS224W Project Report

Social Information Filtering

R. R. Badre Associate Professor Department of Computer Engineering MIT Academy of Engineering, Pune, Maharashtra, India

Link Analysis in Weibo

Available online at ScienceDirect. Procedia Technology 17 (2014 )

A User Study on Features Supporting Subjective Relevance for Information Retrieval Interfaces

Applying the KISS Principle for the CLEF- IP 2010 Prior Art Candidate Patent Search Task

NON-CENTRALIZED DISTINCT L-DIVERSITY

Social Network Mining An Introduction

Relevance Feature Discovery for Text Mining

Internet Traffic Classification Using Machine Learning. Tanjila Ahmed Dec 6, 2017

Personalized Information Retrieval by Using Adaptive User Profiling and Collaborative Filtering

Michele Gorgoglione Politecnico di Bari Viale Japigia, Bari (Italy)

Explore Co-clustering on Job Applications. Qingyun Wan SUNet ID:qywan

Parallel Merge Sort with Double Merging

Results and Discussions on Transaction Splitting Technique for Mining Differential Private Frequent Itemsets

Business Intelligence

Collaborative Filtering using a Spreading Activation Approach

Flash Eurobarometer 468. Report. The end of roaming charges one year later

AN INTERACTIVE FORM APPROACH FOR DATABASE QUERIES THROUGH F-MEASURE

Contour-Based Large Scale Image Retrieval

Transcription:

Alsaleh, Slah, Nayak, Richi, Xu, Yue, & Chen, Lin (2011) Improving matching process in social network using implicit and explicit user information. In: Proceedings of the Asia-Pacific Web Conference (APWeb 2011) Lecture Notes in Computer Science, Apr 18, 2011 - Apr 20, 2011, Beijing, China. Copyright 2011 please consult the authors

Improving Matching Process in Social Network Using Implicit and Explicit User Information Slah Alsaleh, Richi Nayak, Yue Xu and Lin Chen Computer Science Discipline, Queensland University of Technology Brisbane, Australia s.alsaleh@qut.edu.au, r.nayak@qut.edu.au, xu.yue@qut.edu.au and l33.chen@student.qut.edu.au Abstract: Personalised social matching systems can be seen as recommender systems that recommend people to others in the social networks. However, with the rapid growth of users in social networks and the information that a social matching system requires about the users, recommender system techniques have become insufficiently adept at matching users in social networks. This paper presents a hybrid social matching system that takes advantage of both collaborative and content-based concepts of recommendation. The clustering technique is used to reduce the number of users that the matching system needs to consider and to overcome other problems from which social matching systems suffer, such as cold start problem due to the absence of implicit information about a new user. The proposed system has been evaluated on a dataset obtained from an online dating website. Empirical analysis shows that accuracy of the matching process is increased, using both user information (explicit data) and user behavior (implicit data). Keywords: social matching system, recommender system, clustering users in social network 1. INTRODUCTION AND RELEATED WORK A social matching system can be seen as a recommender system that recommends people to other people instead of recommending products to people. Recommending people is more complicated and sensitive compared with recommending products (Tobias, 2007). The reason behind this is the special nature of the relationship between the users in social matching systems like online dating networks. Analysis of an underlying online dating network shows that it is not always true when two users share the same attributes (such as values that describe themselves including age, personality, and smoking habit), then they can be recommended to each other. As a result, the standard recommendation techniques may not be appropriate to match people in online dating networks. Another issue is the increasing numbers of social network members along with their information, which builds up the computational complexity. In Facebook, for example, there are more than 500 million active users, with 50% of the active users logging on in any given day (www.facebook.com, 2010). Another example is RSVP which considered as the largest dating network in Australia, with more than 2 million members and an average of 1,000 new members every day (http://www.rsvp.com.au/, 2010). In such social networks, a lot of personal information about users is required. This information can be divided into explicit and implicit information. The explicit information is collected by asking the user to answer a series of questions which represent his/her characteristics and preferences. Many social networks also record user s behaviour on the network (such as sending messages, watching profiles). A user s online activities are referred to as his/her implicit information. Three learning approaches are widely used in social matching systems: rules-based approach, content-based approach and collaborative approach (Brusilovsky, Kobsa, & Nejdl, 2007). Even though social matching systems are increasingly used and attract more attention from both academic and industrial researchers, many aspects still need to be explored and developed. A major issue is the accuracy of matching users in social networks. A two-way matching process is needed to deal with the compatibility between users whom have been recommended. The majority of existing social matching systems consider the similarity between user x and user y and produce the recommendation without checking that user y is also compatible with user x. Terveen and McDonald (2005) have also raised some general questions, namely: what is the information that should be used to achieve high quality matching? How does the system make a good match? Is it possible to evaluate the matching process and then use the evaluation outcome as a feedback? The authors argue that data mining techniques can be used to improve recommendation in social networks (Terveen & McDonald, 2005). Clustering is one of the data mining techniques that can be used to improve the matching process in social networks (Eirinaki & Vazirgiannis, 2003). It reduces the data size and cuts down the complexity that the matching process has. Moreover, a clustering technique assists the

recommendation process in social networks by overcoming some existing problems such as cold start and sparsity. For example, cold start problem occurs when a new user joins a social networks and the system has not gather enough information about the user to be matched. Assigning this user to an existing cluster which already has been matched with the appropriate opposite gender cluster allows him\her to receive recommendation instantly. For these reasons, clustering is used in this paper to group together users who have similar characteristics. This paper proposes a social matching system that considers both explicit data (information that users provide about themselves) and implicit data (user activities on the social networks) to improve the matching process in social networks. It utilizes the dating type of social matching system in which opposite gender users are recommended to each other. Explicit data are used to cluster male and female users into homogonous groups. Then the male clusters are matched with the female clusters using implicit data and users are recommended to each other. The proposed system is evaluated on a dataset obtained from an online dating website. Empirical analysis demonstrated that the proposed system improves the accuracy of the recommendations from 13.9% to 50.32%, reduces the matching complexity by 93.95% and overcomes cold-start problem. The matching process in a majority of social networks is based on explicit data that users provide to describe themselves (Boyd & Ellison, 2008). However, the proposed system proved that using implicit data that represents the users activities in the matching process increases the recommendation accuracy by36.42%. 2. THE PROPOSED METHOD A. Preliminaries There are many types of social networks according to their purpose of use. An online dating system is a type of social network that aims to introduce people to their potential partners. Online dating systems usually keep two different types of data about their users; implicit data and explicit data. The implicit data are collected by recording the users activities while they are interacting with the system. These data include profiles that a user has seen and messages that they have sent. The explicit data are usually obtained through an online questionnaire; the users are asked to answer a number of questions which represent their personality traits and interests. The explicit data can be divided into two subsets, data about the user and data about the preferred partner. Let U be the users in a social network, U = {u 1, u 2, u n }, where u i is either a male or a female user. Each user has a set of attributes attr(u i ) = {o 1, o 2, o x,p 1, p 2, p g } where o i is an attribute that specifically describes the user (such as age, height, education, etc) and p i is an attribute that describes the preferred partner. Users are allowed to have one value for each o i attribute; however, they may have a null, single or multiple values for each p i attribute. A user u i also performs some activities on the network such as viewing another user s profile V(u 1, u 2 ) where u 1 viewed the profile of u 2. This activity shows that u 1 may be interested in contacting u 2. Other activities usually include communicating with short pre-defined messages (kiss) 1 and long free-text messages (email) 2. Sending a kiss K(u 1, u 2, k t, k r ) is another activity that confirms further interest where u 1 sends a kiss k t that contains a pre-defined message to u 2. Users can select one of a variety of k t that represents the users feelings. u 2 can reply to the kiss sent by u 1 by using one of several pre-defined messages k r which vary between a positive and a negative reply. k r may be null indicating the target user has not responded to the sender s request. Furthermore, u 1 is allowed to send emails E(u 1, u 2 ) to another user u 2. 1 In this paper, we call the pre-defined message as kiss. 2 In this paper, the long free-text messages are called as email.

In this paper, both the user profiles and user activities are employed to improve the recommendations in the proposed system. User profiles are used to cluster similar users in groups according to their profiles similarities. Clustering users into groups overcomes two major problems in the matching process, which are cold start problem and the data sparsity, and results in increasing the matching accuracy and efficiency, as the findings show. Once users are clustered, data obtained from the users activities (implicit data) are used to match the users clusters with each other. The clustering and matching phases are discussed in the following in more detail. B. Clustering users in social networks In order to cluster users in social networks the data need to be pre-processed. The pre-processing includes data integration and transformation. Once the data have been integrated and transformed, they are then divided into two groups: male users denoted as U m = {u 1, u 2, u m }, and female users denoted as U f = {u 1, u 2, u f }. This prepares the data to be clustered in the next phase. The male and female users are clustered separately in order to match the male clusters with the female clusters using the clusters centroid, and then recommend users to each other. The male users are clustered based on their own attributes {o 1, o 2, o x }, while the female users are clustered based on their preferred partners attributes {p 1, p 2, p g }. This is done to ensure high accuracy matching. Using both their own and preferred attributes in clustering the users makes it very difficult to find a male cluster that is similar to a female cluster. For example, while two users are similar in their own attributes, they may be very different in what they are looking for in their partners. C. Matching clusters and recommendation After clustering male and female users, two processes are performed: matching clusters and recommending clusters members to each other. Let C m be the clustering solution grouping the male users containing c clusters, C m = {C m1, C m2, C mc }. Let a m1 be the centroid vector of cluster C m1 represented as {a m11, a m12, a m1x }. Let C f be the clustering solution grouping the female users containing d clusters, C f = {C f1, C f2, C fd }. Let a f1 be the centroid vector of cluster C f1 represented as {a f11, a f12, a f1g }. This process of matching all clusters is based on the communications between clusters members utilizing the implicit data. As mentioned previously, social networks contain some implicit data that can be used to improve the recommendation. Users interact with each other by sending kisses K(u 1, u 2, k t, k r ), emails E(u 1, u 2 ) and by viewing each other s profiles V(u 1, u 2 ). These implicit data can be used to match the users clusters. In the proposed system, the successful kiss interaction K(u 1, u 2, k t, k r ) between a male user s cluster and the rest of female users clusters are assessed to determine the pair of clusters that has more interactions between them; these are then recommended to each other. A kiss is defined as a successful kiss when it received a positive reply k r which means that the opposite party is also interested in this relationship. The communication score can be presented as follows., = (,,, ) # # Where (,,, )= 1, is positive 0, h When the matching process is completed, the recommendation phase takes place. In this phase, recommendations are presented to the users in ranking order of users compatibility scores. The compatibility scores are calculated between the members of the pair of matched (or compatible)

clusters according to members profile and preference similarity. The user profile vector of the male user u m C mc is compared with the preference vector of all female users u f C fd. The compatibility score can be presented as follows. (, ) = (, ) Where sim (, ) = 1, = 0, h Figure 1 explains the proposed matching algorithm Input: Male and female dataset; Output: List of ranked recommendation for each user; Begin 1 Cluster male users based on their own attributes {o 1, o 2, o x } into c number of groups 2 Cluster female user based on their preferences{p 1, p 2, p g } into d number of groups 3 For each male cluster C mi Find a female cluster C fi that has highest successful communication with C mi 4 For each user u m C mi Calculate the compatibility with all user in C fi where C fi is best matched cluster with C mi 5 Present top n recommendations to the users in ranking order of users compatibility scores. Figure 1: High level definition of the proposed method 3. EXPERIMENTS AND DISCUSSTION The proposed system has been tested on a dataset obtained from a real online dating website that contains more than two million users. A subset of data were used showing all the active users in a period of three months, as the data analysis shows that an average user is active for three months and at least initiates one communication channel. Therefore, the proposed system targets the users who are active within three months. A. Evaluation Measures Success rate and recall are used to evaluate the accuracy of the proposed social matching recommendation system. They evaluate the accuracy of recommending users in recommendation systems. The success rate was used to measure the probability of recommendation being successful as indicated by the (positive) kiss returned by the recommended partner. Recall was also used to measure the probability of recommending the right partners. Both are mathematically presented below. Successfull _ Kisses I All _ Kisses B. Experiment Design { } { } Success Rate = { All _ kisses} { Kissed _ partners } I { Re commended _ Partners } Recall = { Kissed _ partners} Experiments were conducted on a machine with 3GB of RAM and a 3.00GHz Intel Cor2Due processor. Experiments were conducted to evaluate the accuracy of recommendation in social network using the proposed method. The results are compared by the baseline results when the

proposed method is not used. The baseline success rate that users achieve in their communications without using the proposed system is 13.9%. The proposed method uses the implicit information to match the clusters. The proposed method is also compared with a variation when the clusters are matched with the explicit information only. The profile and preference similarity are used to compare the clusters centroids for both male and female clustering solutions and matching was done based on their explicit profile information rather than implicit information. In this case, the matching score h is used as follows. h (, ) = (, ) Where sim (a m1i, a f1i ) = 1, = 0, h C. Results and Discussion The first phase of the experiment was clustering male and female users individually into 100 clusters. We selected 100 clusters as this is the most appropriate value where the majority of clusters are homogeneous and have a similar average number of members per group. However, we had several clusters that contain higher number of users which indicates that there are some popular attributes that many users share. Oracle Data Miner (ODM) was used to cluster both male and female users. K-means clustering algorithm was used to cluster both datasets by using the Euclidean distance function. K-means was chosen because of its simplicity and speed which allows it to run on large datasets, as in social networks. The output of the clustering phase is summarized in Table 1. Male users Female users No. of clusters 100 100 Average no. of users per cluster 324 89 Maximum no. of users per cluster 1069 1283 Minimum no. of user per cluster 38 2 Table 1: Clustering output The second phase of the experiment was matching male clusters with the female clusters and then recommending users to each other. In this phase, clusters were matched using successful communication. In this stage, we calculated the success rate when we matched the clusters based on the communication as well as when we matched them based on their similarity. The success rate increased from 0.31 when clusters were matched based on similarity to 0.78 when clusters were matched based on communication. This demonstrate that matching clusters based on the communications is more efficient as the success rate is more than double when compared to matching clusters based on their similarity. The main reason for the low success rate (when considering the similarity) is the sparsity that social network data have. As a result, the proposed system utilizes the communications to match clusters with each other. Once the male clusters are matched with the female clusters, the recommendation task takes place. The top n female recommendation will be presented to each member of the male clusters. The ranking is based on the similarity between male and female users, as explained in Section 2. As shown in Table 2, the proposed system achieves a high success rate compared to the baseline system, especially with the top 1 to top 10 recommendations. In terms of recall, our system gained the best recall when recommending all users with a percentage of 7.18%. The recall then decreases to reach 2.45% with the top 1 recommendation.

Top 1 Top 5 Top 10 Top 20 Top 50 All Success rate 50.32% 38.17% 28.14% 21.52% 17.04% 15.52% Recall 2.45% 3.06% 3.89% 5.14% 5.79% 7.18% Baseline success rate 13.9% Table 2: Success rate and recall Vs baseline With the improvement in success rate, the proposed system also reduces the computational complexity of matching users in social networks. The baseline system has to compare every male user with all the female users. However, the proposed system limits the comparisons to be with an assigned cluster. For the dataset used in this experiment, instead of conducting 1443519630 comparing processes, we were able to reduce the number to be 92466720 which reduces the proposed system computational complexity by 93.95%. 4. CONCLUSION AND FUTURE WORK Many social matching systems are based on recommender system techniques. The difference is that the social matching systems recommend people to each other rather than recommend items to people. Recommending people to each other is much more complicated and challenging. Therefore, current social matching systems suffer from two issues, the computational complexity and the matching accuracy. In this paper, a new hybrid social matching system was presented that uses implicit and explicit data to improve the recommendation process. The clustering technique was also used to reduce the computational complexity in the proposed system. Experimental results showed that the proposed system provides satisfactory and high-quality recommendations with reasonable computational complexity. Matching users in social networks based on their implicit data is a promising research area with many aspects that need to be explored. Furthermore, data mining techniques including clustering and association rules can be employed to develop ways to match users in social networks. REFERENCES Harper, F. M., Sen, S., & Frankowski, D. (2007). Supporting social recommendations with activity-balanced clustering. Paper presented at the The 2007 ACM conference on Recommender systems Oinas-Kukkonen, H., Lyytinen, K., & Yoo, Y. (2010). Social Networks and Information Systems: Ongoing and Future Research Streams. Journal of the Association for Information Systems, 11(2), 3. Terveen, L., & McDonald, D. W. (2005). Social matching: A framework and research agenda. ACM Transactions on Computer-Human Interaction (TOCHI), 12(3), 401-434. Boyd, D. M., & Ellison, N. B. (2008). Social network sites: Definition, history, and scholarship. Journal of Computer-Mediated Communication, 13(1), 210-230. Eirinaki, M., & Vazirgiannis, M. (2003). Web mining for web personalization. ACM Transactions on Internet Technology, 3(1), 1-27. Grcar, M. (2004). User Profiling: Web Usage Mining. Proceedings of the 7 th International Multiconference Information Society IS. Lathia, N., Hailes, S., & Capra, L. (2009). Evaluating collaborative filtering over time. Paper presented at the Workshop on The Future of IR Evaluation (SIGIR), Boston. Mislove, A., Marcon, M., Gummadi, K. P., Druschel, P., & Bhattacharjee, B. (2007). Measurement and analysis of online social networks. Paper presented at the The 7th ACM SIGCOMM conference on Internet measurement. Mobasher, B. (2007). Data mining for web personalization. Lecture Notes in Computer Science, 4321, 90. Morgan, E. M., Richards, T. C., & VanNess, E. M. (2010). Comparing narratives of personal and preferred partner characteristics in online dating advertisements. Computers in Human Behavior, 26(5), 883-88