摘要
针对当前图书馆云检索系统未能较多关注用户需求,检索效率低的问题,以数据挖掘技术为核心,以分布式开源框架Hadoop为支撑,提出一种基于数据挖掘技术的智能图书馆云检索系统。首先集成Hive,HDFS,MapReduce,Hadoop组件对智能图书馆云检索系统的硬件部分进行设计。Hive主要用于图书馆书籍资源关键词的存储与分析;MapReduce主要用于图书馆书籍资源实际统计分析计算;HDFS主要用于相关操作数据的存储;而Hadoop主要用于存储设备的相关管理。然后在系统架构下,确定了系统的实现流程以及图书馆资源在分布式环境下的检索机制。通过多组实验数据测试系统性能,并与其他同类检索系统相比较,所设计系统检索效率有明显提升,且随着数据量的增加,提升效率会更加明显。
As for the little focus on user requirements and low retrieval efficiency in the current library cloud retrieval system,an intelligent library cloud retrieval system based on data mining technology is proposed,which takes the data mining technology as the core and the distributed open source framework Hadoop as the support.During the system design,Hive HDFS,MapReduce and Hadoop,components are integrated to design the hardware part of the intelligent library cloud retrieval system.Hive is mainly used for the storage and analysis of the keywords in the library book resources,MapReduce is mainly applied to the actual statistical analysis and calculation of the library book resources,HDFS is mainly used for the storage of the related operational data,and Hadoop is mainly used for the related management of the storage devices.In the system architecture,the implementation process of the system and the retrieval mechanism of the library resources in a distributed environment are determined.The performances of the system were tested with multi⁃group experimental data and compared with those of other similar retrieval systems.The retrieval efficiency of the designed system has been significantly improved,and can be lifted more obviously with the increase of data volume.
作者
赵翀
王丽达
ZHAO Chong;WANG Lida(Harbin Institute of Technology,Harbin 150090,China)
出处
《现代电子技术》
北大核心
2020年第2期60-63,共4页
Modern Electronics Technique
关键词
智能图书馆
云检索系统
数据挖掘技术
系统设计
数据检索
性能测试
intelligent library
cloud retrieval system
data mining technology
system design
data retrieval
performance test
