文章基本信息

标题：Integrating memory-mapping and N-dimensional hash function for fast and efficient grid-based climate data query
本地全文：下载
作者：Mengchao Xu ; Liang Zhao ; Ruixin Yang 等
期刊名称：Annals of GIS
印刷版ISSN：1947-5683
出版年度：2021
卷号：27
期号：1
页码：57-69
DOI：10.1080/19475683.2020.1743354
语种：English
出版社：Taylor & Francis Ltd.
摘要：Database systems are pervasive components in the current big data era. However, efficiently managing and querying grid-based or array-based multidimensional climate data are still beyond the capabilities of most databases. The mismatch between the array data model and relational data model limited the performance to query multidimensional data in a traditional database when data volume hits a cap. Even a trivial data retrieval on large multidimensional datasets in a relational database is time-consuming and requires enormous storage space. Given the scientific interests and application demands on time-sensitive spatiotemporal data query and analysis, there is an urgent need for efficient data storage and fast data retrieval solutions on large multidimensional datasets. In this paper, we introduce a method for multidimensional data storing and accessing, which includes a new hash function algorithm that works on a unified data storage structure and couples with the memory-mapping technology. A prototype database library, LotDB developed as an implementation, is described in this paper, which shows promising results on data query performance compared with SciDB, MongoDB, and PostgreSQL.
关键词：Multidimensional array; gridded data; array database; memory-mapping; MERRA; data cube