Qos and Keyword-Aware Service Recommendation Method on Map Reduce for Big Data Applications

Full Text Download |
Abstract
Similar to most big data applications, the big data tendency also poses heavy impacts on service recommender systems. With the growing number of alternative services, effectively recommending services that users preferred has became an important research issue. Service recommender systems have been exposed as valuable tools to help users deal with services overload and provide appropriate recommendations to them. In KASR, keywords are used to indicate users' preferences, and a user-based Collaborative filtering algorithm is adopted to generate appropriate recommendations. More specifically, a keyword-candidate list and domain thesaurus are provided to help obtain users' preferences. The active user gives his/her preferences by selecting the keywords from the keyword-candidate list, and the preferences of the previous users can be extracted from their reviews for services according to the keyword-candidate list and domain thesaurus. The proposed system proposes methods it aims at presenting a personalized service recommendation list and recommending the most appropriate service(s) to the users. To improve the scalability and efficiency of KASR in “Big Data” environment, the proposed system proposes techniques that have been implemented it on a Map Reduce framework in Hadoop platform. It improves the recommendation accuracy by considering the location of the user while recommend the service.
Keywords:recommender system, preference, keyword, Big Data, MapReduce, Hadoop.
INTRODUCTION
In recent years, the amount of data in our world has been increasing explosively, and analyzing large data sets—so-called “Big Data”— becomes a key basis of competition underpinning new waves of productivity growth, innovation, and consumer surplus. Handling of large scale data, to provide recommendation, consequently, traditional service recommender systems often suffer from scalability and inefficiency problems when processing or analyzing such large-scale data. Moreover, most of existing service recommender systems present the same ratings and rankings of services to different users without considering diverse users' preferences, and therefore fails to meet users' personalized requirements. The proposed system provides technique to personalize recommended services. There have been many recommender systems developed in both academia and industry. The authors propose a Bayesian-inference-based recommendation system for on-line social networks. They show that the proposed Bayesian-inference-based recommendation is better than the existing trust-based recommendations and is comparable to Collaborative Filtering recommendation. In Adomavicius and Tuzhilin give an overview of the field of recommender systems and describe the current generation of recommendation methods. They also describe various limitations of current service recommendation methods, and discussed possible extensions that can improve recommendation capabilities and make recommender systems applicable to an even broader range of applications. Most existing service recommender systems are only based on a single numerical rating to represent a service's utility as a whole. In fact, evaluating a service through multiple criteria and taking into account of user feedback can help to make more effective recommendations for the users.
References:
- Adomavicius.G and Kwon.Y (2007), “New Recommendation Techniques for Multi criteria Rating Systems,” IEEE Intelligent Systems, Vol. 22, No. 3, pp. 48-55.
- Chen.Y et al (2012),“Travel Recommendation by Mining People Attributes and Travel Group Types From Community-Contributed Photos”. IEEE Transactions on Multimedia, Vol. 25, No.6, pp. 1283-1295.
- Dean.J and Ghemawat.S (2005),“MapReduce: Simplified data processing on large clusters,” Communications of the ACM, Vol. 51, No.1, pp. 107-113.
- Sarwar.B et al (2001), “Item-based collaborative filtering recommendation algorithms,” Proceedings of the 10th international conference on World Wide Web, pp. 285-295.
- Shunmei Meng et al (2013),“KASR: A Keyword-Aware Service Recommendation Method on Map Reduce for Big Data Applications,” IEEE Transactions on parallel and distributed systems, TPDS.12-1141.
- Yang.X and Guo.Y (2013), “Bayesian-inference based recommendation in online social networks,” IEEE Transactions on Parallel and Distributed Systems, Vol. 24, No. 4, pp. 642-651.
- Zhao.Z.D and Shang.M.S (2010), "User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop," In the third International Workshop on Knowledge Discovery and Data Mining, pp. 478-481.
- Zheng.Z et al (2013), “QoS Ranking Prediction for Cloud Services,” IEEE Transactions on Parallel and Distributed Systems, Vol. 24, No. 6, pp. 1213-1222.