Back to library

Hybrid Recommender Systems: The Review of State-of-the-Art Research

Author: Viktoriia Danilova, Andrew Ponomarev
Source: The 20th Conference of Open Innovations Association FRUCT And ISPIT 2017 seminar, Saint-Petersburg, Russia, 3-7 April 2017

Abstract

To date, recommender systems are a popular instrument to make personalized suggestions and provide information about items for users. There are many techniques that can be applied for personalization in recommender systems. All these techniques have complementary strengths and weaknesses. A hybrid recommender system combines two or more recommendation techniques to gain better system performance and mitigate the weaknesses of individual ones. Classification of hybrid recommender systems used in this paper is based on the classification proposed by Burke [1]. The need of a systematic review in the area arises from the requirement to summarize all the information about actual methods and algorithms that are used in hybrid recommended system. These materials will be used to support further research activities aiming to develop the auto-switching hybrid recommender system.

1. Introduction

Recommender systems (RS) is a tool that suggests items that are useful to a particular user. They have become fundamental applications in electronic commerce and information access. To date, different techniques and different methods are used to perform recommendation. The most known classification includes content-based, collaborative, knowledge-based techniques [2]. Different methods are combined in hybrid recommenders to optimize the prediction quality and resolve the bottlenecks of individual techniques.

Consequently, it is meaningful to classify the research papers according to data mining techniques. Classification of hybrid recommender systems, used in this paper, is based on Burke’s classification of hybridization methods [1]. There are different strategies by which hybridization can be achieved and they are broadly classified into seven categories:

The topic of hybrid methods is still quite actual, therefore, the purpose of this paper is to examine the state-of-the- art directions of their applications and research in this field to obtain information about the most common and ”popular” methods of hybridization in recommender systems as well as to identify methods that lack attention of the community.

This paper surveys the background of actual hybrid recommenders through a review of actual work to:

This report covers three phases of a literature review: planning the review, conducting the review and reporting the review. It is organized as follows: Section 2 describes the review process. Section 3 reports the review results. Section 4 summarizes the research results.

2. Research process

The main objective is to summarize all actual base of theoretical and practical experiments in area of implementation and development of hybrid recommender

Table 1. Summary of relevant review papers on hybrid recommender system

Title

Author(s)

Abstract

Short systematic review

W.M. Chughtai, A.B.

This paper reviews the landscapes of current state-of-art recommender systems in e-learning

on e-learning

Selama, Imran Ghani

environment. This paper is limited to discuss four types of filtering approaches, their benefits,

recommender

limitations and cold-start problem with respect to recommender systems. The review of domain and

system.[69]

previous research improvement provide timely and useful insight about recommender systems and

cold-start issue in e-learning recommender system domain.

A systematic review of

Zohreh Dehghani

The paper provides a review the relevant articles in the field of scholar recommendations, explore

scholar context-aware

Champiria, Seyed Reza

contextual information influential in scholar recommendations, examine recommending approaches.

recommender systems

Shahamirib, Siti Salwah

This review has been conducted to identify the contextual information and methods used for making

[70]

Binti Salima,

recommendations in digital libraries as well as the way researchers understood and used relevant

contextual information from the years 2001 to 2013 based on the Kitchenham systematic review

methodology. The results indicated that contextual information incorporated into recommendations

can be categorised into three contexts, namely users' context, document's context, and environment

context. Researchers have understood and exploited relevant contextual information through four

ways, including citation of past studies, citation of past definitions, self-definitions, and field-query

researches; however, citation of the past studies has been the most popular method.

Recommender System:

Akshita, Smita

This paper discuss various techniques proposed for recommendations including content based,

Review[71]

collaborative based and other techniques. To improve performance, these methods have sometimes

been combined in hybrid recommenders. It also discuss about growing area of research in the area

of recommender systems that is mobile recommender systems.

A literature review and

Deuk Hee Park, Hyea

210 articles on recommender systems from 46 journals published between 2001 and 2010 are

classification of

Kyeong Kim, Il Young

reviewed. These articles are categorized into eight application fields (books, documents, images,

recommender systems

Choi, Jae Kyeong Kim

movie, music, shopping, TV programs, and others) and eight data mining techniques (association

research [74]

rule, clustering, decision tree, k-nearest neighbor, link analysis, neural network, regression, and

other heuristic methods). Research provides information about trends in recommender systems

research by examining the publication years of the articles, and provides practitioners and

researchers with insight and future direction on recommender systems.

Systematic Review of

Cristhian Figueroa, Iacopo

This paper presents a systematic literature review to summarize the state of the art in recommender

Linked Data-based

Vagliano, Oscar Rodriguez

systems that use structured data published as Linked Data for providing recommendations of items

Recommender Systems

Rocha, Maurizio Morisio

from diverse domains. It considers the most relevant research problems addressed and classifies RS

[73]

according to how Linked Data has been used to provide recommendations. Furthermore, it analyzes

contributions, limitations, application domains, evaluation techniques, and directions proposed for

future research.

User and Context

Sergio Inzunza, Reyes

A Systematic Literature Review- This paper present a review conducted to identify what user’s and

Information in Context-

Juarez-Ramirez, Alan

context’s information it’s considered relevant by researchers to generate contextual

Aware Recommender

Ramirez-Noriega

recommendations from 2012 to 2015, based on Kitchenham systematic literature review

Systems [72]

methodology. The results indicated that there is a large set of possible user’s and context’s

information that can be used to do recommendations. This review can be taken as basis for future

context-aware recommender systems development, as well as development of contextual user

models.

The Use of Machine

Ivens Portugal, Paulo

A Systematic Review - This paper presents a systematic review of the literature that analyzes the

Learning Algorithms in

Alencar, Donald Cowan

use of machine learning algorithms in recommender systems and identifies research opportunities

Recommender Systems

for software engineering research. The study concludes that Bayesian and decision tree algorithms

[68]

are widely used in recommender systems because of their relative simplicity, and that requirement

and design phases of recommender system development appear to offer opportunities for further

research.

systems (HRS). To plan the research, we defined the list of research questions:

During research, we used the sciencedirect – search interface for journals and books from Elsevier. It is one of the world's premier publishers in science, technology, proceedings of the ACM Recommender Systems Conference (recsys) – a leading conference "mainly focused" on recommender systems, and IEEE Xplore Digital Library – a powerful resource, delivering full text access to the scientific highest quality technical literature in engineering and technology.

To identify the keywords, we found some relevant topics and defined the relevant words that could be used to describe the topic: “hybrid recommender system”, “combining techniques”, “recommender system”.

From a more general viewpoint, the following papers were included:

x Articles on the topics, published during last 5 years.

The following papers were excluded:

The sciencedirect database search for query “(Hybrid recommender systems)” gave 678 results; to narrow the search, we used the query “(Hybrid recommender system) and

ABSTRACT(combination) AND LIMIT-TO(year, "2017,2016,2015,2014,2013")” that gave 31 results. The second query “(TITLE-ABSTR-KEY (hybrid recommender systems) and TITLE-ABSTR-KEY(combining techniques)” gave 12 more results.

Searching through the recsys conference materials, we used programs of the last conferences to find topic which included the keyword “Hybrid recommender systems”, after the 2013 the all topics in the section «Hybrid recommender systems and cold start problem» was included; that gave 16 additional papers.

In the IEEE Xplore Digital library source we searched for documents containing “hybrid recommender system” in title and published in 2012- 2017, that gave 38 papers. This query was narrow enough, so we decided to learn all of them.

After initial screening, according to the defined criteria and information from abstracts, we left 64 papers of 93 for thorough examination.

In addition, to analyze the need of research, we have found several review papers dedicated to recommender systems in the television domain, scholar context- aware recommender systems, network-based recommendation algorithms etc. None of these reviews considered the field of the hybrid recommender systems or the question of their actual classification. The most appropriate reviews of search are summarized in the Table I.

The papers presented in the table argue the actuality of the review, demand to analyze the area of hybrid recommended system, summarize all information about existing methods and algorithms, used in recommended system.

The main aim of this review is to draw more general conclusions about lack of researches in the area of hybrid recommended systems. These materials will be taken as a prelude to further research activities.

3. Review results

A. Distribution by year of publication

The research papers analysis by year of publication demonstrate that publications related to recommender systems steadily increased in 2013 and 2016. The amount of research papers decrease due to the development of mobile technologies that have began to be used everywhere and recommender systems research apparently extended a new application field.

B. Application area

Distrubution of papers among application areas is shown in Fig. 1. The main application area of the hybrid recommender

systems is e-commerce, but a lot of papers didn’t have any specialization and could be used in different cases. While learning the purposes of recommender systems, we found, that 53% of papers present novel approaches for developing hybrid recommender systems, the other papers are dedicated to the implementation of HRS in some specific areas or for some specific resources, like for example Foursquare[23].

Fig. 1 — The scope of the hybrid recommender system

Fig. 1 — The scope of the hybrid recommender system

C. Hybridization techniques

69% of HRS are Weighted according to the Burke’s classification, i.e. Resulting list of recommendations is calculated by the weighted formula, 16% are based on Feature Combination, several HRS employ Cascading and 2 systems are Switching.

Paper [19] presents a new Inferential Ontology-based Semantic Similarity (IOBSS) measure to evaluate semantic similarity between items in a specific domain of interest by taking into account their explicit hierarchical relationships, shared attributes and implicit relationships. Further, the paper proposes a hybrid semantic enhanced recommendation approach by combining the new IOBSS measure and the standard item-based Collaborative Filtering approach.

Another paper [10] presents the results of learning the influence of the different types of information to the item recommendation. Author defines that tags, social contacts, and user-item interaction data – are more effective to achieve useful recommendations. Aiming to determine whether and how combining such information sources may enhance over individual recommendation approaches. Analyzing the obtained results, the authors of [10] conclude that exploiting social tagging information by content-based recommenders offers high coverage and novelty, and combining social networking and collaborative filtering information by hybrid recommenders provides high diversity. Different approaches – content-based, collaborative filtering, and social – have low overlap and relative diversity values between them, which leads to the conclusion that meta-hybrid recommenders combining the above strategies may provide valuable, balanced item suggestions in terms of performance and non-performance metrics, for different contexts depending on the needed level of personalization.

The literature research allowed to find only 2 papers, connected to these type of hybrid recommender paper: first one [13] proposes a switching hybrid algorithm that combines the conjectured strengths of content-base (CB) and demographics-based (DB) techniques. System uses content-based technique, when it is requested to predict a rating for a new item, while it uses demographics-based technique, when predicting a rating for a new user or a new contextual situation. Second paper [6] propose a method to combine the estimated relevance for a resource along with its quality. In order to generate recommendations they use the switched algorithm (between content-based approach and collaborative filtrating (CF) approach) that depend on the results of matching similarity measures among vectors. Particularly, they use the standard cosine similarity measure, but define it in a linguistic context.

The bottlenecks of the Burke classification of recommender systems consist in the lack of the type for systems, that use different algorithms of recommendations, but all of them have the same type. Authors define their systems as a hybrid, but, for example, the hybrid recommender system proposed in [33] is based on the computing the Relative Feature Frequency and the Modified relative Feature frequency, then computing all the user and all the features for the Relative Feature Score. The hybrid system computes the similarity in preference and the similarity in opinion using different algorithms. According to Burke’s classification this system can be classified as belonging to a Cascading type, or couldn?t be a hybrid recommender system at all.

D. Evaluation

While analyzing the approaches to evaluate systems in presented papers, we found, that the most popular metric to evaluate the results of recommendation is Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) (Fig 3).

Learning of papers gives us the answers to the research questions.

E. Algorithm combination to hybrid recommender systems work

The most popular combination was the collaborative techniques and the different type of the content based methods. Popular are the fuzzy -based personalized recommender systems, for example [2], for ANFIS to extract knowledge (fuzzy rules) from users’ ratings and preferences on items’ features. In this paper, they use fuzzy techniques to handle vagueness, uncertainty, and fuzziness, and to model humans’ behavioral complexity in expressing their opinions.

Fig. 4. Algorithms of hybridization

F. Input data

The most popular input date is the information about users’ preferences and item features. But, to date, all available information, all types of data, are used.

Some systems work with demographic information of users and ontological item-based semantic information, others with geolocation data, frequency of tags applied to item, content (items), annotated with freely chosen words (tags) (the whole set of tags constitutes an unstructured collaborative classification scheme that is commonly known as folksonomy), RDF Dataset, Facebook API to support re-rating of profile items through an array of sliders, Wikipedia, Facebook and Twitter [2],[19],[34],[62],[21].

One of the most actual and complex combination of the input data is presented in the paper [53], a system algorithm that works with Airbnb dataset. Accommodation reviews, descriptions and images, available on the website, are the major factors that are collected through a web crawler program, the review scores are used as a reference to filter out the low quality accommodation prior to the implementation of the proposed recommender system.

The most interesting discovery is Environment External Connector [5]. This connector is responsible for converting the data from the external environment into useful information for the proposed by the authors system called Invenire. Thus, Invenire can abstract representations of the types of information from different data sources.

The second discovery is the algorithm, that computes the accumulated Mean Absolute Error (MAE), Root Mean Squared Error (RMSE) and correlation for each technique. The accumulated values of RMSE for techniques are used to compose the fitness function that is used to evaluate the results. To compute the accumulated RMSE for each technique the proposed algorithm produces a matrix for each user. Predictions are generated for user using some technique applied over the matrix. Thus, the sum of these components guide the algorithm through search space.

Conclusion

In this paper we presented the results of researching the most common and “popular” methods of hybridization systems. We summarized the state-of-the-art recommendation methods and tried to determine their type, according to algorithmic principles and Burke classification.

We showed that hybrid recommender systems are still popular and are used for different problem solutions. We also learned the types of the input date, different logic of work, types of evaluation.

The vast majority of presented papers comply with Burke’s classification of the hybrid recommender systems, but we also found the bottlenecks in classification. The problem is in the comparing the systems, that use the different algorithms of recommendations, but in the same time have one type (for example, different algorithms are combined as a part of Content- based recommender system). According to the same paper of Burke [1], hybrid recommender systems combine two or more recommendation techniques to gain better performance with fewer of the drawbacks of any individual one. This definition doesn’t give us the answer how we can define the systems with different algorithms within one type. If we decide, that such systems are hybrid, we can define the systems as «Cascading».

There are different concepts in order to combine such recommendation algorithms in an efficient way, but contrary

to the area of weighted HRS, the question of switching hybrid approaches is still actual. In future work, the number of sources will be extended to obtain more information.

REFERENCES

  1. R. Burke, “Hybrid recommender systems: Survey and Experiments”, User modeling and User-Adapted Interaction,2002, pp.331-370

  2. N.R. Kermany, Sasan H. Alizadeh, “A hybrid multi-criteria recommender system using ontology and neuro-fuzzy techniques”, 2017, Web: http://www.sciencedirect.com/

  3. N. Tho Thong, Le Hoang Son’, “HIFCF: An effective hybrid model

  4. D. I. Ignatov, S. I. Nikolenko, T.Abaev, J.Poelmans, “Online recommender system for radio station hosting based on information fusion and adaptive tag-aware profiling”, 2016, Web: http://www.sciencedirect.com/

  5. E. Queiroz da Silva, Celso G. Camilo-Junior, L. Mario L. Pascoal, Thierson C. Rosa, “An evolutionary approach for combining results of recommender systems techniques based on collaborative filtering”, 2016, Web: http://www.sciencedirect.com

  6. Ch. Zigkolis, S. Karagiannidis, I. Koumarelas, A. Vakali, “Integrating Quality Criteria in a Fuzzy Linguistic Recommender

  7. System for Digital Libraries”, 2013, Web: http://www.sciencedirect.com

  8. B. Lika, K. Kolomvatsos, S. Hadjiefthymiades, “Facing the cold start

  9. problem in recommender systems”, 2014, http://www.sciencedirect.com

  10. Ch. Zigkolis, S. Karagiannidis, I. Koumarelas, Athena Vakali, Integrating similarity and dissimilarity notions in recommenders, 2013, Web: http://www.sciencedirect.com

  11. Hao Wu, Yijian Pei, Bo Li, Zongzhan Kang, Xiaoxin Liu, Hao Li, “Item recommendation in collaborative tagging systems via uristic+C11:C12 data fusion”, Web: http://www.sciencedirect.com

  12. A.Bellogin, I.Cantador, P.Castells, “A comparative study of heterogeneous item recommendations in social systems”, 2013, Web: http://www.sciencedirect.com

  13. M. Kamisnskas, F. Ricci (Free University of Bozen-Bolzano), Markus Schedl (Johannes Kepler University) “Location-Aware Music Recommendation Using Auto-Tagging and Hybrid Matching”, 2013, Web: http://www.sciencedirect.com

  14. Houda Khrouf , Raphael Troncy, “Hybrid Event Recommendation Using Linked Data and User Diversity”, 2013, Web: http://www.sciencedirect.com

  15. Matthias Braunhofer (Free University of Bolzano), Victor Codina (Technical University of Catalonia), Francesco Ricci (Free University of Bolzano, Switching Hybrid for Cold-Starting Context-Aware Recommender Systems, 2014, Web: http://www.sciencedirect.com

  16. Matthias Braunhofer (Free University of Bolzano), Hybridisation Techniques for Cold-Starting Context-Aware Recommender Systems, 2014, Web: http://www.sciencedirect.com

  17. Fatemeh Vahedian (Depaul University), Weighted Hybrid Recommendation for Heterogeneous Networks, 2014,

  18. Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki, Lise Getoor, “hyper: A Flexible and Extensible Probabilistic Framework

  19. for Hybrid Recommender Systems”, 2015, Web: http://www.sciencedirect.com

  20. Alan Menk dos Santos, “A Hybrid Recommendation System Based on Human Curiosity”, 2015, Web: http://www.sciencedirect.com

  21. Michael R. Lyu, Irwin King “Hybrid Optimization Algorithm for Large-Scale qos-Aware Service Composition”,2015,Web: http://ieeexplore.ieee.org

  22. Malak Al-Hassan, Haiyan Lu, Jie Lu, A semantic enhanced hybrid recommendation approach: A case study of e-Government tourism

  23. service recommendation system, 2015, Web: http://www.sciencedirect.com

  24. Marco Tulio Ribeiro, Anisio Lacerda, Adriano Veloso, Nivio Ziviani “Pareto-Efficient Hybridization for Multi-Objective Recommender Systems”, 2012, Web: http://ieeexplore.ieee.org

  25. Svetlin Bostandjiev, John O'Donovan, Tobias Hollerer (University of California, Santa Barbara), tasteweights: A Visual Interactive

  26. Dmitry I. Ignatov, Sergey I. Nikolenko, Taimuraz Abaev, Jonas Poelmans, “Online recommender system for radio station hosting based on information fusion and adaptive tag-aware profiling”, 2017,

  27. Joan Capdevila, Marta Arias, Argimiro Arratia, geosrs: A hybrid social recommender system for geolocated data, 2016, Web: http://www.sciencedirect.com

  28. Alejandro Montes-Garcia, Jose Maria Alvarez-Rodriguez, Jose Emilio Labra-Gayo, Marcos Martinez-Merino, Towards a journalist-based news recommendation system: The Wesomender approach, 2013, Web: http://www.sciencedirect.com

  29. Ahmad A. Kardan, Mahnaz Ebrahimi, A novel approach to hybrid recommendation systems based on association rules mining for content recommendation in asynchronous discussion groups, 2013, Web: http://ieeexplore.ieee.org

  30. Alberto Huertas Celdran, Manuel Gil Perez, Felix J. Garcia Clemente, Gregorio Martinez Perez “Design of a recommender system based on users’ behavior and collaborative location and tracking” ,2016, Web: http://ieeexplore.ieee.org

  31. Zui Zhang, Hua Lin, Kun Liu, Dianshuang Wu, Guangquan Zhang, Jie Lu,”A hybrid fuzzy-based personalized recommender system for telecom products/services” , 2013, Web: http://ieeexplore.ieee.org

  32. Fatima Rodrigues, Bruno Ferreira, Product Recommendation based

  33. on Shared Customer's Behaviour, 2016, Web: http://www.sciencedirect.com

  34. R/ Ali, M. Afzal, M. Hussain, M. Ali, “Multimodal hybrid reasoning methodology for personalized wellbeing services”, 2016, Web: http://ieeexplore.ieee.org

  35. Simon Dooms (iminds-Ghent University, Dynamic Generation of Personalized Hybrid Recommender Systems, 2013, Web: http://www.sciencedirect.com

  36. Shini Renjith; C. Anjali, “A personalized mobile travel recommender system using hybrid algorithm”, International Journal for Research in Engineering Application & Management, 2014 p.12 – 17,

  37. To Thi Thuan; Sutheera Puntheeranurak Hybrid recommender system with review, 2014, Web: http://www.sciencedirect.com

  38. Vicky Na Zhao; Melody Moh; Teng-Sheng Moh «Contextual-Aware Hybrid Recommender System for Mixed Cold-Start Problems in Privacy Protection», IEEE 2nd International Conference on Big Data Security on Cloud» 2016, p. 400 - 405,

  39. Ade Romadhony; Said Al Faraby; B. Pudjoatmodjo “Online shopping recommender system using hybrid method”, 2013 p.166-169, Web: http://ieeexplore.ieee.org

  40. Chi-Chih Yu; Toru Yamaguchi; Yasufumi Takama A hybrid recommender system based non-common items in social media, 2013 p. 255 – 261, Web: http://ieeexplore.ieee.org

  41. Sakineh Shahriyary; Mohmmad Pourmahmood Aghabab, Recommender systems on web service selection problems using a new hybrid approach, 2014 p. 177 – 182, Web: http://ieeexplore.ieee.org

  42. Zhiyuan Fang; Lingqi Zhang; Kun Chen A behavior mining based hybrid recommender system, 2016, p. 1 - 5, Web: http://ieeexplore.ieee.org

  43. Gilbert Badaro; Hazem Hajj; Wassim El-Hajj; Lama Nachman A hybrid approach with collaborative filtering for recommender systems, 2013, p. 349 – 354, Web: http://ieeexplore.ieee.org

  44. Soultana Karga; Maya Satratzemi Mentor: A Hybrid Recommender System in Order to Support Teachers in Learning Design Authoring Process, 2014, p. 522 – 523, Web: http://ieeexplore.ieee.org

  45. Rahul Katarya; Om Prakash Verma; Ivy Jain User behaviour analysis in context-aware recommender system using hybrid filtering approach, 2013, p. 222 - 227,

  46. Abdul Hamid M Ragab; Abdul Fatah S. Mashat; Ahmed M Khedra HRSPCA: Hybrid recommender system for predicting college admission, 2012, p. 107 - 113,

  47. Hitesh Nirwan; Om Prakash Verma; Ankit Kanojia Personalized hybrid book recommender system using neural network, 2016, p.1281 - 1288

  48. Ehsan Aslanian; Mohammadreza Radmanesh; Mahdi Jalili, Hybrid Recommender Systems based on Content Feature Relationship, 2016, Pages: 1 - 1, Web: http://www.sciencedirect.com

  49. Anant Gupta; B. K. Tripathy A generic hybrid recommender system based on neural networks, 2014, p. 1248 – 1252, Web: http://www.sciencedirect.com

  50. Djallel Bouneffouf; Amel Bouzeghoub; Alda Lopes Gancarski Following the User's Interests in Mobile Context-Aware Recommender Systems: The Hybrid-e-greedy Algorithm, 2012, p. 657 - 662, Web: http://ieeexplore.ieee.org

  51. Yihao Zhang; Xiaoyang Liu; Wanping Liu; Changpeng Zhu Hybrid Recommender System Using Semi-supervised Clustering Based on Gaussian Mixture Model, 2016, p.155 - 158, Web: http://ieeexplore.ieee.org

  52. Sumit Kumar Verma; Namita Mittal; Basant Agarwal Hybrid recommender system based on fuzzy clustering and collaborative filtering, 2013, p. 116 – 120, Web: http://ieeexplore.ieee.org

  53. Zafer Duzen; Mehmet S. Aktas An approach to hybrid personalized recommender systems, 2016, p. 1 – 8, Web: http://ieeexplore.ieee.org

  54. Punam Bedi; Pooja Vashisth; Purnima Khurana; Preeti Modeling user preferences in a hybrid recommender system using type-2 fuzzy sets, 2013, p. 1 - 8, Web: http://www.sciencedirect.com

  55. XL Zheng; Ch. Chen; Jui-Long Hung; Wu He; Fu-Xing Hong; Zhen Lin “A Hybrid Trust-Based Recommender System for Online Communities of Practice”, 2015, p.345 – 356, Web: http://www.sciencedirect.com

  56. Ramesh Naidu Laveti; Janaki Ch; Supriya N Pal; N. Sarat Chandra Babu A Hybrid Recommender System Using Weighted Ensemble Similarity Metrics and Digital Filters, 2016, p. 32 - 38, Web: http://www.sciencedirect.com

  57. Pai Chet Ng; James She; Ming Cheung; Alexander Cebulla An Images-Textual Hybrid Recommender System for Vacation Rental, 2016 pages 60 - 63, Web: http://ieeexplore.ieee.org

  58. Shruthi Bhat; K. Aishwarya Item-based Hybrid Recommender System for newly marketed pharmaceutical drugs, 2013, p. 2107 - 2011, Web: http://ieeexplore.ieee.org

  59. Thomas Hornung; Cai-Nicolas Ziegler; Simon Franz; Martin Przyjaciel-Zablocki; Alexander Schatzle; Georg Lausen Evaluating Hybrid Music Recommender Systems, 2013, p. 57 – 64, Web: http://ieeexplore.ieee.org

  60. Farman Ullah; Ghulam Sarwar; Sung Chang Lee; Yun Kyung Park; Kyeong Deok Moon; Jin Tae Kim Hybrid recommender system with temporal information, 2012, p. 421 - 425, Web: http://ieeexplore.ieee.org

  61. Qian Zhang; Guangquan Zhang; Jie Lu; Dianshuang Wu A Framework of Hybrid Recommender System for Personalized Clinical Prescription, 2015, p. 189 - 195, Web: http://ieeexplore.ieee.org

  62. Thai Thinh Dang; Trang Hai Duong; Hong Son Nguyen A hybrid framework for enhancing correlation to solve cold-start problem in recommender systems, 2014, p. 1 – 5, Web: http://ieeexplore.ieee.org

  63. Amel Ziani; Nabiha Azizi; Yamina Tlili Guiassa Recommender system for sports articles based on Arabic opinions polarity detection with a hybrid approach RSS-SVM, 2015, p. 1 - 5, Web: http://www.sciencedirect.com

  64. Jose Aguilar; Junior Altamiranda; Omar Portilla Hybrid recommender system of biomedical ontologies, 2016, p. 1 – 12, Web: http://www.sciencedirect.com

  65. Mohd Abdul Hameed; M. A. Malik; Syeda Fouzia Sayeedunnisa; Husna Imroze, An Effective Hybrid Algorithm in Recommender Systems Based on Fast Genetic k-means and Information Gain, 2012, p. 860 - 865,

  66. Yang Luo; Boyi Xu; Hongming Cai; Fenglin Bu A Hybrid User Profile Model for Personalized Recommender System with Linked Open Data, 2014, p. 243 - 248,

  67. Jun Zeng; Min Gao; Junhao Wen; Sachio Hirokawa, A Hybrid Trust Degree Model in Social Network for Recommender System,

  68. 2014 p. 37 - 41, Web: http://www.sciencedirect.com

  69. Ana Stanescu; Swapnil Nagar; Doina Caragea A Hybrid Recommender System: User Profiling from Keywords and Ratings, 2013, p. 73 - 80, Web: http://www.sciencedirect.com

  70. Sanya Sharma; Aakriti Sharma; Yamini Sharma; Manjot Bhatia Recommender system using hybrid approach, 2016, p. 219 - 223

  71. P. Sunanda; A. Vineela An agglomerative hierarchical clustering for Hybrid Recommender Systems, 2015,p. 283 - 288, Web: http://www.sciencedirect.com

  72. Do Thi Lien; Nguyen Xuan Anh; Nguyen Duy Phuong, A Graph Model for Hybrid Recommender System; 2015, p.138 - 143, Web: http://www.sciencedirect.com

  73. Ivens Portugal, Paulo Alencar, Donald Cowan, The Use of Machine Learning Algorithms in Recommender Systems, Web: http://www.sciencedirect.com

  74. W.M. Chughtai, A.B. Selama, Short systematic review on e-learning recommender systems, 2013, Web: http://www.sciencedirect.com

  75. Zohreh Dehghani Champiria, Seyed Reza Shahamirib, Siti Salwah Binti Salima, A systematic review of scholar context-aware recommender systems, 2015, p. 1743–1758, Web: http://www.sciencedirect.com

  76. Akshita, Smita, Recommender System: Review, 2013, Web: http://www.sciencedirect.com

  77. Sergio Inzunza, Reyes Juarez-Ramirez, Alan Ramirez-Noriega , User and Context Information in Context-Aware Recommender Systems, 2016, p.649-658, Web: http://www.sciencedirect.com

  78. Cristhian Figueroa, Iacopo Vagliano, Oscar Rodriguez Rocha, Maurizio Morisio, Systematic Review of Linked Data-based Recommender Systems, 2015, Web: http://www.sciencedirect.com

  79. Deuk Hee Park, Hyea Kyeong Kim, Il Young Choi, Jae Kyeong Kim, A literature review and classification of recommender systems research, 2012, 10059-10072, Web: http://www.sciencedirect.com