[1]WANG Jun,HUANG Jingguo,YU Dan,et al.Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center[J].Journal of Seismological Research,2023,46(02):308-314.[doi:10.20015/j.cnki.ISSN1000-0666.2023.0019]
Copy
Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center
Journal of Seismological Research[ISSN 1000-0666/CN 53-1062/P] Volume:
46
Number of periods:
2023 02
Page number:
308-314
Column:
Public date:
2023-06-01
- Title:
- Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center
- Keywords:
- ClickHouse; big data; geophysical networks; observation data
- CLC:
- P315-391.2
- DOI:
- 10.20015/j.cnki.ISSN1000-0666.2023.0019
- Abstract:
- Traditional Oracle database has been unable to cope with the rapidly-growing seismic geophysical observation data.To meet the need of mass data processing of the historical geophysical data from the National Geophysical Observatory Network Center,through technology selection,the distributed OLAP database ClickHouse with horizontal expansion capability is used to redesign the structure of the data table which is suitable for ClickHouse.By full database migration,incremental migration,and data comparison,about 13 TB data in the Oracle database have been migrated to the ClickHouse database and have been keeping daily updating.Tests show that in ClickHouse,the performance of data reading and writing is significantly improved,the capability of data query is enhanced,and the consistency and security of the database is guaranteed through multiple copies.
- References:
-
陈晓琳,李盛乐,刘坚,等.2020.分布式数据库Greenplum在地震前兆数据存储中的应用[J].地震研究,43(2):412-416.
谷长勇,吴逸云,单永红,等.2011.Oracle 11g权威指南(2版)[M].北京:电子工业出版社.
李井冈,姚运生,李胜乐,等.2008.基于Oracle 的地震前兆数据库表结构对比[J].计算机工程与设计,29(1):243-245.
李亚臣.2021.基于ClickHouse的用户事件分析系统的设计与实现[J].信息与电脑:33(9):4.
刘坚,李胜乐,王子影.2009.基于LZMA的数据库压缩存储应用研究[J].大地测量与地球动力学,29(6):144-147.
王焕涛,周念,陈俊彦.2021.基于时序数据库的氢能源动力监测系统的设计[J].电子技术与软件工程,(16):2.
王建军,赵银刚,刘高川.2019.地震前兆Oracle LOB数据压缩与交换及其访问效率研究[J].地震研究,42(3):447-453.
王军,方召盟,何案华,等.2016.电扰动仪数据处理软件的设计和实现[J].震灾防御技术,11(3):667-673.
王军,赵刚,何案华,等.2008.通过C++类封装Oracle调用接口实现地热数据库的快速建库与访问[J].地震研究,31(3):293-297.
周克昌,蒋春花,纪寿文,等.2010.地震前兆数据库系统设计[J].地震,30(2):143-151.
朱凯.2020.ClickHouse原理解析与应用实践[M].北京:机械工业出版社.
Dwivedi A K,Lamba C S,Shukla S.2012.Performance analysis of column oriented database vs row oriented database[J].International Journal of Computer Applications,50(14):31-34.
Wickramasekara A,Liyanage P P,Kumarasinghe U.2020.A comparative study between the capabilities of MySQL and ClickHouse in low-performance Linux environment[C]//University of Colombo School of Computing.Conference Proceedings of the 20th International Conference on Advances in ICT for Emerging Regions(ICTer)-2020.Sri Lanka.
- Similar References:
Memo
-
Last Update:
2023-03-10