Experiments on quality evaluation of embedded software in Japan robot software design contest

Hironori Washizaki, Yasuhide Kobayashi, Hiroyuki Watanabe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

As a practical opportunity for educating Japanese young developers in the field of embedded software development, a software design contest involving the design of software to automatically control a line-trace robot, and conduct running performance tests was held. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We create a framework for evaluating the software quality which integrated design model quality and the final system performance, and conduct analysis using the framework. As a result of analysis, it is found that the quantitative measurement of the structural complexity of the design models bears a strong relationship to qualitative evaluation of the design conducted by judges. It is also found that there is no strong correlation between design model quality evaluated by the judges and the final system performance. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, using the model. Based on the analysis result, we consider possible remedies with respect to the models submitted, the evaluation methods used and the contest specifications. In order to adequately measure several non-functional quality characteristics including performance on the model, it is necessary to improve the way of developing robot software (such as applying model driven development) and reexamine the evaluation methods.

Original languageEnglish
Title of host publicationProceedings - International Conference on Software Engineering
Pages551-560
Number of pages10
Volume2006
Publication statusPublished - 2006
Externally publishedYes
Event28th International Conference on Software Engineering 2006, ICSE '06 - Shanghai
Duration: 2006 May 202006 May 28

Other

Other28th International Conference on Software Engineering 2006, ICSE '06
CityShanghai
Period06/5/2006/5/28

Fingerprint

Embedded software
Software design
Experiments
Software engineering
Computer systems
Robots
Specifications

Keywords

  • Embedded software development
  • Robot contest
  • Software design
  • Software model
  • Software quality

ASJC Scopus subject areas

  • Software

Cite this

Washizaki, H., Kobayashi, Y., & Watanabe, H. (2006). Experiments on quality evaluation of embedded software in Japan robot software design contest. In Proceedings - International Conference on Software Engineering (Vol. 2006, pp. 551-560)

Experiments on quality evaluation of embedded software in Japan robot software design contest. / Washizaki, Hironori; Kobayashi, Yasuhide; Watanabe, Hiroyuki.

Proceedings - International Conference on Software Engineering. Vol. 2006 2006. p. 551-560.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Washizaki, H, Kobayashi, Y & Watanabe, H 2006, Experiments on quality evaluation of embedded software in Japan robot software design contest. in Proceedings - International Conference on Software Engineering. vol. 2006, pp. 551-560, 28th International Conference on Software Engineering 2006, ICSE '06, Shanghai, 06/5/20.
Washizaki H, Kobayashi Y, Watanabe H. Experiments on quality evaluation of embedded software in Japan robot software design contest. In Proceedings - International Conference on Software Engineering. Vol. 2006. 2006. p. 551-560
Washizaki, Hironori ; Kobayashi, Yasuhide ; Watanabe, Hiroyuki. / Experiments on quality evaluation of embedded software in Japan robot software design contest. Proceedings - International Conference on Software Engineering. Vol. 2006 2006. pp. 551-560
@inproceedings{7d87c757ca8c482e943f3fc56da09d52,
title = "Experiments on quality evaluation of embedded software in Japan robot software design contest",
abstract = "As a practical opportunity for educating Japanese young developers in the field of embedded software development, a software design contest involving the design of software to automatically control a line-trace robot, and conduct running performance tests was held. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We create a framework for evaluating the software quality which integrated design model quality and the final system performance, and conduct analysis using the framework. As a result of analysis, it is found that the quantitative measurement of the structural complexity of the design models bears a strong relationship to qualitative evaluation of the design conducted by judges. It is also found that there is no strong correlation between design model quality evaluated by the judges and the final system performance. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, using the model. Based on the analysis result, we consider possible remedies with respect to the models submitted, the evaluation methods used and the contest specifications. In order to adequately measure several non-functional quality characteristics including performance on the model, it is necessary to improve the way of developing robot software (such as applying model driven development) and reexamine the evaluation methods.",
keywords = "Embedded software development, Robot contest, Software design, Software model, Software quality",
author = "Hironori Washizaki and Yasuhide Kobayashi and Hiroyuki Watanabe",
year = "2006",
language = "English",
isbn = "1595933751",
volume = "2006",
pages = "551--560",
booktitle = "Proceedings - International Conference on Software Engineering",

}

TY - GEN

T1 - Experiments on quality evaluation of embedded software in Japan robot software design contest

AU - Washizaki, Hironori

AU - Kobayashi, Yasuhide

AU - Watanabe, Hiroyuki

PY - 2006

Y1 - 2006

N2 - As a practical opportunity for educating Japanese young developers in the field of embedded software development, a software design contest involving the design of software to automatically control a line-trace robot, and conduct running performance tests was held. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We create a framework for evaluating the software quality which integrated design model quality and the final system performance, and conduct analysis using the framework. As a result of analysis, it is found that the quantitative measurement of the structural complexity of the design models bears a strong relationship to qualitative evaluation of the design conducted by judges. It is also found that there is no strong correlation between design model quality evaluated by the judges and the final system performance. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, using the model. Based on the analysis result, we consider possible remedies with respect to the models submitted, the evaluation methods used and the contest specifications. In order to adequately measure several non-functional quality characteristics including performance on the model, it is necessary to improve the way of developing robot software (such as applying model driven development) and reexamine the evaluation methods.

AB - As a practical opportunity for educating Japanese young developers in the field of embedded software development, a software design contest involving the design of software to automatically control a line-trace robot, and conduct running performance tests was held. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We create a framework for evaluating the software quality which integrated design model quality and the final system performance, and conduct analysis using the framework. As a result of analysis, it is found that the quantitative measurement of the structural complexity of the design models bears a strong relationship to qualitative evaluation of the design conducted by judges. It is also found that there is no strong correlation between design model quality evaluated by the judges and the final system performance. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, using the model. Based on the analysis result, we consider possible remedies with respect to the models submitted, the evaluation methods used and the contest specifications. In order to adequately measure several non-functional quality characteristics including performance on the model, it is necessary to improve the way of developing robot software (such as applying model driven development) and reexamine the evaluation methods.

KW - Embedded software development

KW - Robot contest

KW - Software design

KW - Software model

KW - Software quality

UR - http://www.scopus.com/inward/record.url?scp=34247114304&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34247114304&partnerID=8YFLogxK

M3 - Conference contribution

SN - 1595933751

SN - 9781595933751

VL - 2006

SP - 551

EP - 560

BT - Proceedings - International Conference on Software Engineering

ER -