|本期目录/Table of Contents|

[1]王 军,黄经国,余 丹,等.分析数据库ClickHouse在国家地球物理台网中心的应用[J].地震研究,2023,46(02):308-314.[doi:10.20015/j.cnki.ISSN1000-0666.2023.0019 ]
　WANG Jun,HUANG Jingguo,YU Dan,et al.Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center[J].Journal of Seismological Research,2023,46(02):308-314.[doi:10.20015/j.cnki.ISSN1000-0666.2023.0019 ]
点击复制

分析数据库ClickHouse在国家地球物理台网中心的应用(PDF/HTML)

《地震研究》[ISSN:1000-0666/CN:53-1062/P]

卷:
46
期数:
2023年02期
页码:
308-314
栏目:
出版日期:
2023-03-10

文章信息/Info

Title:
Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center
作者:
王 军; 黄经国; 余 丹; 纪寿文; 王方建
(中国地震台网中心,北京 100045)
Author(s):
WANG Jun; HUANG Jingguo; YU Dan; JI Shouwen; WANG Fangjian
(China Earthquake Networks Center,Beijing 100045,China)
关键词:
ClickHouse;  大数据;  地球物理台网;  观测数据
Keywords:
ClickHouse;  big data;  geophysical networks;  observation data
分类号:
P315-391.2
DOI:
10.20015/j.cnki.ISSN1000-0666.2023.0019
摘要:
面对日益增长的地球物理观测数据,传统的Oracle数据库已经力不从心。根据地球物理历史数据可大量被读取的使用特点,通过技术选型,以具备横向扩展能力的分布式OLAP数据库ClickHouse作为数据底座,重新设计适用于ClickHouse的地球物理观测数据表结构。经过全库迁移、增量迁移和数据对比,国家地球物理台网中心的Oracle数据库中约13 TB的数据已经迁移到ClickHouse并每日更新。实际测试表明:ClickHouse显著提升数据读写性能,增强了数据统计查询能力,并且通过多副本保证了数据库的一致性和安全性。
Abstract:
Traditional Oracle database has been unable to cope with the rapidly-growing seismic geophysical observation data.To meet the need of mass data processing of the historical geophysical data from the National Geophysical Observatory Network Center,through technology selection,the distributed OLAP database ClickHouse with horizontal expansion capability is used to redesign the structure of the data table which is suitable for ClickHouse.By full database migration,incremental migration,and data comparison,about 13 TB data in the Oracle database have been migrated to the ClickHouse database and have been keeping daily updating.Tests show that in ClickHouse,the performance of data reading and writing is significantly improved,the capability of data query is enhanced,and the consistency and security of the database is guaranteed through multiple copies.

参考文献/References:

-

备注/Memo

备注/Memo:
收稿日期:2022-02-15.
基金项目:公共安全信息化工程(中国地震局建设项目)(12151013401).
第一作者简介:王 军(1979-),高级工程师,主要从事地震监测数据管理与软件开发.E-mail:wangjun825@163.com.
更新日期/Last Update: 2023-03-10