Cooperation between Data Modeling and Simulation Modeling for Performance Analysis of Hadoop

Abstract

Performance analysis of a complex computing system requires a lot of time and effort. Many studies related to performance analysis have been conducted. Firstly, there are studies about workload modeling that model and analyze the observed workloads using statistical summaries. Also, there are studies to analyze system behavior and procedures through simulation modeling. However, there are some disadvantages to using only one approach for analyzing the complex system more accurately. Therefore, this paper presents cooperation between data modeling and simulation modeling for performance analysis of the system. The target system, Hadoop, is one of the representative big data platforms that can demonstrate the complexity of the analysis. Firstly, we identify the characteristics of Hadoop and divide them into two parts according to their characteristics. Then, we model and integrate them using each modeling approach. This paper presents the experiment to show the advantages of the cooperative modeling in the accuracy, execution time, and modeling extensibility.