Industrial Case Study on Time Series Analysis of Metrics Changes Based on GQM Models

Kiyoshi Honda, Hironori Washizaki, Yoshiaki Fukazawa, Masahiro Taga, Akira Matsuzaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

It is difficult for companies to evaluate whether their activities have achieved the intended goals or to improve their goals in quantifiable ways. Herein we propose a method to evaluate quantitatively the results of a company's activities related to goals based on the GQM (Goal Question Metrics) method. Our proposed method uses successive statistical analysis and periodic statistical analysis. The former evaluates two groups of projects based on project release date, and the latter evaluates projects separated by six-month intervals. An empirical case study for a cloud service, which supports real estate businesses with e-Seikatsu, is used to evaluate our method. The target data contain project quality evaluation results for three years. We evaluated 73 project quality evaluation results using the proposed method. Successive statistical analysis reveals four of the five metrics have statistical significance of mean differences between groups, whereas periodic statistical analysis indicates three of the five metrics are statistically significant.

Original languageEnglish
Title of host publicationProceedings - 2019 10th International Workshop on Empirical Software Engineering in Practice, IWESEP 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages13-18
Number of pages6
ISBN (Electronic)9781728155906
DOIs
Publication statusPublished - 2019 Dec
Event10th International Workshop on Empirical Software Engineering in Practice, IWESEP 2019 - Tokyo, Japan
Duration: 2019 Dec 132019 Dec 14

Publication series

NameProceedings - 2019 10th International Workshop on Empirical Software Engineering in Practice, IWESEP 2019

Conference

Conference10th International Workshop on Empirical Software Engineering in Practice, IWESEP 2019
CountryJapan
CityTokyo
Period19/12/1319/12/14

Keywords

  • GQM
  • Statistic analysis
  • Time series analysis

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Fingerprint Dive into the research topics of 'Industrial Case Study on Time Series Analysis of Metrics Changes Based on GQM Models'. Together they form a unique fingerprint.

  • Cite this

    Honda, K., Washizaki, H., Fukazawa, Y., Taga, M., & Matsuzaki, A. (2019). Industrial Case Study on Time Series Analysis of Metrics Changes Based on GQM Models. In Proceedings - 2019 10th International Workshop on Empirical Software Engineering in Practice, IWESEP 2019 (pp. 13-18). [8945076] (Proceedings - 2019 10th International Workshop on Empirical Software Engineering in Practice, IWESEP 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWESEP49350.2019.00011