HaoLap: a Hadoop based OLAP system for big data - Archive ouverte HAL Access content directly
Journal Articles Journal of Systems and Software Year : 2015

HaoLap: a Hadoop based OLAP system for big data

(1) , (1) , (1) , (1) , (1) , (2)
1
2

Abstract

In recent years, facing information explosion, industry and academia have adopted distributed file system and MapReduce programming model to address new challenges the big data has brought. Based on these technologies, this paper presents HaoLap (Hadoop based oLap), an OLAP (OnLine Analytical Processing) system for big data. Drawing on the experience of Multidimensional OLAP (MOLAP), HaoLap adopts the specified multidimensional model to map the dimensions and the measures; the dimension coding and traverse algorithm to achieve the roll up operation on dimension hierarchy; the partition and linearization algorithm to store dimensions and measures; the chunk selection algorithm to optimize OLAP performance; and MapReduce to execute OLAP. The paper illustrates the key techniques of HaoLap including system architecture, dimension definition, dimension coding and traversing, partition, data storage, OLAP and data loading algorithm. We evaluated HaoLap on a real application and compared it with Hive, HadoopDB, HBaseLattice, and Olap4Cloud. The experiment results show that HaoLap boost the efficiency of data loading, and has a great advantage in the OLAP performance of the data set size and query complexity, and meanwhile HaoLap also completely support dimension operations.
Fichier principal
Vignette du fichier
song_13232.pdf (1.91 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01154322 , version 1 (21-05-2015)

Identifiers

Cite

Jie Song, Chaopeng Guo, Zhi Wang, Yichan Zhang, Ge Yu, et al.. HaoLap: a Hadoop based OLAP system for big data. Journal of Systems and Software, 2015, vol. 102, pp. 167-181. ⟨10.1016/j.jss.2014.09.024⟩. ⟨hal-01154322⟩
280 View
1020 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More