期刊文献+

基于Hadoop与Mahout的协同过滤图书推荐研究 被引量:15

Research on Collaborative Filtering Book Recommendation Based on Hadoop and Mahout
原文传递
导出
摘要 基于Hadoop开源分布式计算框架和Mahout协同过滤推荐引擎技术构建图书推荐引擎系统,并利用云模型和Pearson系数对传统协同过滤推荐算法进行改进,改善传统单机推荐算法在高维稀疏矩阵上进行运算所导致的系统性能不佳及推荐结果不准确的问题。利用实验对分布式推荐平台的整体性能及改善后的协同过滤推荐算法进行测试评估,发现当虚拟机节点不断增加时,协同过滤推荐引擎的计算时间不断减少,这表明推荐引擎系统的总体性能较传统单机推荐引擎得到提升;利用MAE分别对原始协同过滤推荐效果和改进后的推荐算法进行测评,发现改进后的推荐引擎算法的推荐准确率较改进前提高13.1%。 Firstly, this paper builds a book recommendation engine system based on the Hadoop open source distributed computing framework and mahout collaborative filtering recommendation engine technology. Then it takes advantage of the cloud model and Pearson coefficient to improve the traditional collaborative filtering recommendation algorithm, aml resolves the problems of poor system performance and recommendation results inaccurate of traditional stand -alone recommendation algorithm in high-dimensional sparse matrix operations. Thirdly, it experiments and evaluates the overall performance of the distributed recommendation platform and the improved collaborative filtering algorithm. It finds that: ( 1 ) when the virtual machine nodes are increasing, the computation time of collaborative filtering recommendation engine is declining in the experimental tests, which shows that the overall performance of the system has been improved. (2) it improves the mahout original collaborative filtering recommendation engine with the Pearson coefficient and evaluates the recommended effect with MAE indices of the original collaborative filtering recommendation algorithm, which finds the recommendation accuracy rate increases 13.1% and the subjectivity differences of user ratings have great impact on the recommendation accuracy.
出处 《图书情报工作》 CSSCI 北大核心 2013年第18期116-121,共6页 Library and Information Service
关键词 图书推荐 HADOOP Mahout 推荐引擎 协同过滤 Hadoop Mahout recommendation engine collaborative filtering
  • 相关文献

参考文献14

  • 1Goldberg D, Nichols D, Oki B M, et al. Using collaborative filtering to weave aninformation tapestry. [ J ]. Communications of the ACM.1992,35(12) : 61 -70.
  • 2Breese I S, Heekeman D, Kadie C. Empirical analysis of predictive algorithms tot collaborative filtering[ C]//Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence. San Francisco: ACM Press, 1998:43 -52.
  • 3奉国和,梁晓婷.协同过滤推荐研究综述[J].图书情报工作,2011,55(16):126-130. 被引量:30
  • 4Sarwar B, Karypis G, Konstan J,et al. Item-based collaborative filtering recommendation algorithms [ C ]//Proceedings of the 10th International Worht Wide Web Conference. New York: ACM Press ,2001:285 - 295.
  • 5利用Cloudera实现ttadoop[EB/OL].[2012-09-24]http://wiki.ubuntu.org.cn/利用用Cloudera实现Hadoop.
  • 6Apache Software Foundation [ EB/OL ]. [ 2013 - 08 - 041. http :// www. apache, org/.
  • 7Secure Shell [ EB/OL]. [ 2012 - 09 - 19 ]. http ://zh. wikipedia. org/wiki/Secure_Shell.
  • 8JDK download[ CP/OL]. [ 2012 - 12 - 04 ], http ://www. oracle. com/technetwnrk/java/javase/downloads/jdk - 6u27 - download - 440405. html.
  • 9Ziegler C N, McNee S M, Konstan J A, et al. Improving recommendation lists through topic diversification [ EB/OL ]. [2013 -08 -20 ]. http://dl, acm. org/citation, cfm? id =1060754.
  • 10Book-Crossing Dataset [ EB/OL ]. [ 2012 - 12 - 09 ]. http ://www. infonnatik, uni-freiburg, de/- cziegler/BX/.

二级参考文献77

  • 1张光卫,康建初,李鹤松,刘常昱,李德毅.面向场景的协同过滤推荐算法[J].系统仿真学报,2006,18(z2):595-601. 被引量:27
  • 2邓爱林,左子叶,朱扬勇.基于项目聚类的协同过滤推荐算法[J].小型微型计算机系统,2004,25(9):1665-1670. 被引量:148
  • 3李德毅,刘常昱,杜鹢,韩旭.不确定性人工智能[J].软件学报,2004,15(11):1583-1594. 被引量:416
  • 4曾艳,麦永浩.基于用户评分的关联规则挖掘协同推荐[J].计算机工程,2005,31(15):87-89. 被引量:3
  • 5孙小华,陈洪,孔繁胜.在协同过滤中结合奇异值分解与最近邻方法[J].计算机应用研究,2006,23(9):206-208. 被引量:30
  • 6Shardanand U,Maes P.Social information filtering:algorithms for automating "word of mouth"[C]//Proceedings of ACM CHI'95 Conference on Human Factors in Computing Systems.New York:ACM Press,1995,210-217.
  • 7Herlocker J,Konstan J A,Terveen L,et al.Evaluating collaborative filtering recommender systems[J].ACM Transactions on Information Systems,2004,22(1):5-53.
  • 8Geyer-Schulz A,Hahsler M,Wien W,et al.Evaluation of recommender algorithms for an internet information broker based on simple association rules and on the repeat-buying theory[DB/OL].[2008-10-12].http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.19.911.
  • 9Dahlen B J,Konstan J A,Herlocker J L,et al.Jumpstarting movielens:user benefits of starting a collaborative filtering system with "dead data"[DB/OL].[2008-10-12].http://www.bibsonomy.org/bibtex/24433e6aa3be2cdad117bfb5fd7a757a1/bsmyth.
  • 10Breese J S,Heckerman D,Kadie C.Empirical analysis of predictive algorithms for collaborative filtering[DB/OL].[2008-10-12].http://www.cs.pitt.edu/-mrotaru/comp/rs/Breese%20UAI%201998.pdf.

共引文献162

同被引文献163

引证文献15

二级引证文献125

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部