[1]WANG Jun,HUANG Jingguo,YU Dan,et al.Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center[J].Journal of Seismological Research,2023,46(02):308-314.[doi:10.20015/j.cnki.ISSN1000-0666.2023.0019
]
Copy
Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center
Journal of Seismological Research[ISSN 1000-0666/CN 53-1062/P] Volume:
46
Number of periods:
2023 02
Page number:
308-314
Column:
Public date:
2023-03-10
- Title:
- Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center
- Keywords:
- ClickHouse; big data; geophysical networks; observation data
- CLC:
- P315-391.2
- DOI:
- 10.20015/j.cnki.ISSN1000-0666.2023.0019
- Abstract:
- Traditional Oracle database has been unable to cope with the rapidly-growing seismic geophysical observation data.To meet the need of mass data processing of the historical geophysical data from the National Geophysical Observatory Network Center,through technology selection,the distributed OLAP database ClickHouse with horizontal expansion capability is used to redesign the structure of the data table which is suitable for ClickHouse.By full database migration,incremental migration,and data comparison,about 13 TB data in the Oracle database have been migrated to the ClickHouse database and have been keeping daily updating.Tests show that in ClickHouse,the performance of data reading and writing is significantly improved,the capability of data query is enhanced,and the consistency and security of the database is guaranteed through multiple copies.
- References:
- -
- Similar References:
Memo
-
Last Update:
2023-03-10