鉴于国内外图书馆大数据共享性不高,发展到如今仍缺乏跨系统一站式服务平台的现状。文章侧重于从技术方面提高数字资源的共享利用,提出了基于Hadoop的图书馆数字资源共享模式体系,解决资源共享度不高,缺乏系统性管理的问题,同时为读者提供多方位的服务。系统利用MapReduce分布式计算框架和资源管理系统并行处理数字资源数据,实现资源的快速关联性查找,提高了资源的处理效率,引入基于HDFS图书馆复合大数据存储系统,可保障资源共享系统的存储需求,有效提高读者访问效率,同时解决传统存储技术所面临的可扩展性等问题。
Abstract
In view of the low exchange of big data shared resource in libraries domestic and foreign, and the lack of one-stop service platform crossing all standalone system, this paper his paper is focused on improving the sharing and utilization of digital resources from the technical aspect, proposes a structure model for the sharing of library digital resource based on Hadoop to solve the problem of low sharing performance and the lack of systematic management. Moreover, it provides readers with a multi-faceted service.The system uses MapReduce distributed computing framework and a resource management system to process digital resource data in parallel to achieve fast correlation search and processing of digital resources, and introduces a composite library big data storage system based on HDFS which can guarantee the storage requirements of the resource sharing system, effectively improve the access efficiency for the readers, and solve the scalability problems faced by the traditional storage technologies.
关键词
数字资源共享 /
Hadoop /
MapReduce /
HDFS
{{custom_keyword}} /
Key words
digital resource sharing /
Hadoop /
MapReduce /
HDFS
{{custom_keyword}} /
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
参考文献
[1] 文化部印发《“十三五”时期公共数字文化建设规划》[EB/OL]. [2018-01-07].http://www.ndcnd.gov.cn/zixun/yaowen/201708/t20170803_1350560.htm.
[2] 肖希明,刘巧园.国外公共数字文化资源整合研究进展[J].中国图书馆学报,2015(5):63-75.
[3] World Digital Library [EB/OL].[2018-10-30].https://www.wdl.org/en/.
[4] Digital Public Library of America [EB/O L].[2018-10-30]. https://dp.la/.
[5] Europeana Digital Library [EB/OL].[20 18-10-30].http://www.Theeuropean library. or g /tel4/.
[6] What is Culture Online? [EB/OL].[2018-1030]https://aboutus.com/CultureOnline. gov.uk.
[7] Lee Hyuk-jin.Collaboration in Cultural Herit age Digitizaitionin East Asia[J]. Program:Electronic Library and Infor mation on Systems,2010(4):357-373.
[8] 肖荻昱. 我国“互联网+图书馆”研究的现状与趋势探析——基于CNKI数据库核心期刊[J].当代图书馆,2019(01):49-55.
[9] 陈颖,李景,李国鹏.国家科技图书文献中心(NSTL)数据加工数量统计与分析(2010~2015年)[J].标准科学, 2016(12):46-50.
[10] 陈凌. CALIS 20年:从共建共享走向融合开放[J].数字图书馆论坛, 2018(12):1.
[11] 范晨晓. “基于CADAL平台的资源共享与应用”国际研讨会综述[J].大学图书馆学报,2017,35(05):5-9.
[12] Renaud J,Britton S,Wang D,et al.Mining library and university data to understand library use patterns[J].The Electronic Library,2015,33(3):355-372.
[13] Williams K,Wu J,Choudhury SR,et al.Scholarly big data information extraction and integration in the CiteSeerx digital library[C]//Data Engineering Workshop (ICDEW), 2014 IEEE 30th International Conference, 2014:68-73.
[14] 鲁焱. 大数据共享平台的系统架构与建设思路[J].图书馆理论与实践,2017(04):86-90.
[15] 宋玲玲. 大数据时代图书馆数字学术中心服务探析——以北美高校图书馆为例[J].图书馆理论与实践,2018(08):92-97.
[16] Hashem I A T, Yaqoob I, Anuar N B, et al. The rise of “big data” on cloud computing: Review and open research issues[J]. Information Systems, 2015, 47: 98-115.
[17] Ghazi MR, Gangodkar D.Hadoop, MapReduceand HDFS:a developResper spectiv[J]. Procedia Computer Science, 2015, 48: 45-50.
[18] Eldawy A, Mokbel MF.Spatialhadoop:A mapreduce framework for spatial data[C] //Data Engineering (ICDE), 2015 IEEE 31st International Conference on. IEEE, 2015: 1352-1363.
[19] ZorichD M,Waibel G,Erway R. Beyond the Silos of the LAMs Collaboration among Libraries,Archives and Museumss [EB/O L].[2018-02-27].
[20] 王燕红. 国内基于关联数据的资源整合研究述评[J].图书馆理论与实践,2018(06):36-40.
[21] 李强. 基于关联数据的数字图书馆资源聚合及资源服务平台设计研究[J].图书馆理论与实践,2017(07):93-97.
[22] 刘爱琴,于贾燕,尚珊.基于语义的文献资源发现服务体系构建[J].图书馆理论与实践,2018(08):104-107.
[23] 陈臣. 一种基于新型存储的数字图书馆分布式大数据存储架构[J].现代情报,2015,35(01):100-103.
[24] 曹健,秦荣环,孙会清,毕长泉.基于Hadoop的高校图书馆数字资源整合利用研究[J].图书馆工作与研究,2018(03):74-78,101.
[25] 柳益君,何胜,冯新翎,武群辉,熊太纯.大数据挖掘在高校图书馆个性化服务中应用研究[J].图书馆工作与研究,2017(05):23-29.
[26] 张红. 基于大数据技术的资源发现平台构建——以国家图书馆“文津搜索”系统为例[J].数字图书馆论坛,2016(01):61-67.
[27] 刘海鸥,陈晶,孙晶晶,张亚明.面向大数据的移动数字图书馆情境化推荐系统研究[J].图书馆工作与研究,2018(09):58-64.
{{custom_fnGroup.title_cn}}
脚注
{{custom_fn.content}}
PDF(2910 KB)
