摘要
ETL技术是创建数据仓库的关键。本文以银行数据仓库项目为背景,设计实现了数据的ETL系统,该系统具有良好的人机交互方式。系统采用时钟触发机制实现了数据的自动抽取过程;使用配置文件增强了系统的灵活性;通过对日志的细化实现了系统的快速恢复;针对海量数据的特点,在数据载入过程中优化了系统性能,提高了系统的运行效率。
Technology of ETL is the key to building data warehouse. An ETL system with friendly man-machine mode is designed and realized. An ETL system with friendly man-machine mode is designed and realized. With the mechanism of clock flip-flop, data can be extracted automatically. It makes the system more flexible by using configuration files. The subdivided log files could make fast recovering of the whole system when exception interruption happened. And, for the characters of massive data, the performance is optimized and the efficiency is enhanced especially on the process of data loading.
出处
《微计算机信息》
北大核心
2006年第08X期21-23,共3页
Control & Automation
基金
中国科学院院长基金(A050414)
关键词
银行
海量数据
配置文件
日志
Bank, Massive data, Configuration file, Log file
