With the speed gap between storage system access and processor computing, end-to-end data processing has become a bottleneck to improve the total performance of computer systems over the Internet. Based on the analysi...With the speed gap between storage system access and processor computing, end-to-end data processing has become a bottleneck to improve the total performance of computer systems over the Internet. Based on the analysis of data processing behavior, an adaptive cache organization scheme is proposed with fast address calculation. This scheme can make full use of the characteristics of stack space data access, adopt fast address calculation strategy, and reduce the hit time of stack access. Adaptively, the stack cache can be turned off from beginning to end, when a stack overflow occurs to avoid the effect of stack switching on processor performance. Also, through the instruction cache and the failure behavior for the data cache, a prefetching policy is developed, which is combined with the data capture of the failover queue state. Finally, the proposed method can maintain the order of instruction and data access, which facilitates the extraction of prefetching in the end-to-end data processing.展开更多
This article discusses the current status and development strategies of computer science and technology in the context of big data.Firstly,it explains the relationship between big data and computer science and technol...This article discusses the current status and development strategies of computer science and technology in the context of big data.Firstly,it explains the relationship between big data and computer science and technology,focusing on analyzing the current application status of computer science and technology in big data,including data storage,data processing,and data analysis.Then,it proposes development strategies for big data processing.Computer science and technology play a vital role in big data processing by providing strong technical support.展开更多
In this paper, a holographic storage scheme for multimedia data storage and retrieval based on the digital signal processing (DSP) is designed. A communication model for holographic storage system is obtained on the a...In this paper, a holographic storage scheme for multimedia data storage and retrieval based on the digital signal processing (DSP) is designed. A communication model for holographic storage system is obtained on the analogy of traditional communication system. Many characteristics of holographic storage are embodied in the communication model. Then some new methods of DSP including two-dimensional (2-D) shifting interleaving, encoding and decoding of modulation-array (MA) code and method of soft-decision, etc. are proposed and employed in the system. From the results of experiments it can be seen that those measures can effectively reduce the influence of noise. A segment of multimedia data, including video and audio data, is retrieved successfully after holographic storage by using those techniques.展开更多
Purpose The LHAASO project collects trillions of cosmic ray events every year,generating about 10 PB of raw data annually,which brings big challenges for data processing platform.Method The LHAASO data processing plat...Purpose The LHAASO project collects trillions of cosmic ray events every year,generating about 10 PB of raw data annually,which brings big challenges for data processing platform.Method The LHAASO data processing platform is built to handle such a large amount of data,which is composed of some subsystems such as data transfer,data storage,high throughput computing and metadata management.Results and conclusions The platform was under construction since 2018 and has been working well since 2021.In this paper,the details of the design,implementation and performance of the data processing platform are presented.展开更多
The general idea of holographic optical data storage (HODS) is briefly introduced. Based on the recent advances of HODS, the key techniques and the challenges of HODS are discussed. Some new techniques are proposed to...The general idea of holographic optical data storage (HODS) is briefly introduced. Based on the recent advances of HODS, the key techniques and the challenges of HODS are discussed. Some new techniques are proposed to improve the system. A miniaturized volume holographic data storage and correlation system is presented. It can achieve a density of 10 Gb/cm3 and a fast correlation recognition rate of more than 2000 images per second. It shows the attracting potential advantages over other conventional storage meth- ods in the information storage as well as information proc- essing.展开更多
文摘With the speed gap between storage system access and processor computing, end-to-end data processing has become a bottleneck to improve the total performance of computer systems over the Internet. Based on the analysis of data processing behavior, an adaptive cache organization scheme is proposed with fast address calculation. This scheme can make full use of the characteristics of stack space data access, adopt fast address calculation strategy, and reduce the hit time of stack access. Adaptively, the stack cache can be turned off from beginning to end, when a stack overflow occurs to avoid the effect of stack switching on processor performance. Also, through the instruction cache and the failure behavior for the data cache, a prefetching policy is developed, which is combined with the data capture of the failover queue state. Finally, the proposed method can maintain the order of instruction and data access, which facilitates the extraction of prefetching in the end-to-end data processing.
文摘This article discusses the current status and development strategies of computer science and technology in the context of big data.Firstly,it explains the relationship between big data and computer science and technology,focusing on analyzing the current application status of computer science and technology in big data,including data storage,data processing,and data analysis.Then,it proposes development strategies for big data processing.Computer science and technology play a vital role in big data processing by providing strong technical support.
基金This work was supported by the National fuud for Fundamental Key Project(No.973G19990330) and theNational Natural Science Foundation of China(No.69977005).
文摘In this paper, a holographic storage scheme for multimedia data storage and retrieval based on the digital signal processing (DSP) is designed. A communication model for holographic storage system is obtained on the analogy of traditional communication system. Many characteristics of holographic storage are embodied in the communication model. Then some new methods of DSP including two-dimensional (2-D) shifting interleaving, encoding and decoding of modulation-array (MA) code and method of soft-decision, etc. are proposed and employed in the system. From the results of experiments it can be seen that those measures can effectively reduce the influence of noise. A segment of multimedia data, including video and audio data, is retrieved successfully after holographic storage by using those techniques.
基金supported by National Nature Science Foundation of China(GrantNos.12075268,12175255,12175258,12105300)the Chinese Academy of Science,Institute of High Energy Physics.
文摘Purpose The LHAASO project collects trillions of cosmic ray events every year,generating about 10 PB of raw data annually,which brings big challenges for data processing platform.Method The LHAASO data processing platform is built to handle such a large amount of data,which is composed of some subsystems such as data transfer,data storage,high throughput computing and metadata management.Results and conclusions The platform was under construction since 2018 and has been working well since 2021.In this paper,the details of the design,implementation and performance of the data processing platform are presented.
文摘The general idea of holographic optical data storage (HODS) is briefly introduced. Based on the recent advances of HODS, the key techniques and the challenges of HODS are discussed. Some new techniques are proposed to improve the system. A miniaturized volume holographic data storage and correlation system is presented. It can achieve a density of 10 Gb/cm3 and a fast correlation recognition rate of more than 2000 images per second. It shows the attracting potential advantages over other conventional storage meth- ods in the information storage as well as information proc- essing.
