Quality evaluation of embedded software in robot software design contest

Hironori Washizaki, Yasuhide Kobayashi, Hiroyuki Watanabe, Eiji Nakajima, Yuji Hagiwara, Kenji Hiranabe, Kazuya Fukuda

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

A robot design contest, called the "Embedded Technology (ET) Software Design Robot Contest," which involves designing software to automatically control a line-trace robot, was held in Tokyo, in 2005. The contest was intended to provide a practical opportunity to educate young Japanese developers in the field of embedded software development. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We created a framework for evaluating software quality, which integrated the design model quality and the final system performance, and we conducted an analysis using this framework. As a result of the analysis, the quantitative measurement of the structural complexity of the design model was found to have a strong relationship to the qualitative evaluation of the design by the contest judges. On the other hand, no strong correlation between the design model quality evaluated by the judges and the final system performance was found. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, according to the design and analysis models. Based on the results, we consider possible remedies with respect to the models submitted, the evaluation methods used, and the contest specifications. To adequately measure several quality characteristics, including performance, in terms of a model, it is necessary to improve the approach to developing robot software (for example, by applying model-driven development) and to reexamine the evaluation methods.

Original languageEnglish
Pages (from-to)63-78
Number of pages16
JournalProgress in Informatics
Issue number4
DOIs
Publication statusPublished - 2007 Mar
Externally publishedYes

Fingerprint

Embedded software
Software design
robot
evaluation
software development
performance
Robots
Software engineering
model analysis
development model
remedies
software
Computer systems
Specifications

Keywords

  • Embedded software
  • Product metrics
  • Robot contest
  • Software design
  • Software model
  • Software quality

ASJC Scopus subject areas

  • Library and Information Sciences

Cite this

Washizaki, H., Kobayashi, Y., Watanabe, H., Nakajima, E., Hagiwara, Y., Hiranabe, K., & Fukuda, K. (2007). Quality evaluation of embedded software in robot software design contest. Progress in Informatics, (4), 63-78. https://doi.org/10.2201/NiiPi.2007.4.6

Quality evaluation of embedded software in robot software design contest. / Washizaki, Hironori; Kobayashi, Yasuhide; Watanabe, Hiroyuki; Nakajima, Eiji; Hagiwara, Yuji; Hiranabe, Kenji; Fukuda, Kazuya.

In: Progress in Informatics, No. 4, 03.2007, p. 63-78.

Research output: Contribution to journalArticle

Washizaki, H, Kobayashi, Y, Watanabe, H, Nakajima, E, Hagiwara, Y, Hiranabe, K & Fukuda, K 2007, 'Quality evaluation of embedded software in robot software design contest', Progress in Informatics, no. 4, pp. 63-78. https://doi.org/10.2201/NiiPi.2007.4.6
Washizaki, Hironori ; Kobayashi, Yasuhide ; Watanabe, Hiroyuki ; Nakajima, Eiji ; Hagiwara, Yuji ; Hiranabe, Kenji ; Fukuda, Kazuya. / Quality evaluation of embedded software in robot software design contest. In: Progress in Informatics. 2007 ; No. 4. pp. 63-78.
@article{03281ccc185642669cc183c8c535c660,
title = "Quality evaluation of embedded software in robot software design contest",
abstract = "A robot design contest, called the {"}Embedded Technology (ET) Software Design Robot Contest,{"} which involves designing software to automatically control a line-trace robot, was held in Tokyo, in 2005. The contest was intended to provide a practical opportunity to educate young Japanese developers in the field of embedded software development. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We created a framework for evaluating software quality, which integrated the design model quality and the final system performance, and we conducted an analysis using this framework. As a result of the analysis, the quantitative measurement of the structural complexity of the design model was found to have a strong relationship to the qualitative evaluation of the design by the contest judges. On the other hand, no strong correlation between the design model quality evaluated by the judges and the final system performance was found. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, according to the design and analysis models. Based on the results, we consider possible remedies with respect to the models submitted, the evaluation methods used, and the contest specifications. To adequately measure several quality characteristics, including performance, in terms of a model, it is necessary to improve the approach to developing robot software (for example, by applying model-driven development) and to reexamine the evaluation methods.",
keywords = "Embedded software, Product metrics, Robot contest, Software design, Software model, Software quality",
author = "Hironori Washizaki and Yasuhide Kobayashi and Hiroyuki Watanabe and Eiji Nakajima and Yuji Hagiwara and Kenji Hiranabe and Kazuya Fukuda",
year = "2007",
month = "3",
doi = "10.2201/NiiPi.2007.4.6",
language = "English",
pages = "63--78",
journal = "NII Journal",
issn = "1349-8614",
publisher = "National Institute of Informatics",
number = "4",

}

TY - JOUR

T1 - Quality evaluation of embedded software in robot software design contest

AU - Washizaki, Hironori

AU - Kobayashi, Yasuhide

AU - Watanabe, Hiroyuki

AU - Nakajima, Eiji

AU - Hagiwara, Yuji

AU - Hiranabe, Kenji

AU - Fukuda, Kazuya

PY - 2007/3

Y1 - 2007/3

N2 - A robot design contest, called the "Embedded Technology (ET) Software Design Robot Contest," which involves designing software to automatically control a line-trace robot, was held in Tokyo, in 2005. The contest was intended to provide a practical opportunity to educate young Japanese developers in the field of embedded software development. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We created a framework for evaluating software quality, which integrated the design model quality and the final system performance, and we conducted an analysis using this framework. As a result of the analysis, the quantitative measurement of the structural complexity of the design model was found to have a strong relationship to the qualitative evaluation of the design by the contest judges. On the other hand, no strong correlation between the design model quality evaluated by the judges and the final system performance was found. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, according to the design and analysis models. Based on the results, we consider possible remedies with respect to the models submitted, the evaluation methods used, and the contest specifications. To adequately measure several quality characteristics, including performance, in terms of a model, it is necessary to improve the approach to developing robot software (for example, by applying model-driven development) and to reexamine the evaluation methods.

AB - A robot design contest, called the "Embedded Technology (ET) Software Design Robot Contest," which involves designing software to automatically control a line-trace robot, was held in Tokyo, in 2005. The contest was intended to provide a practical opportunity to educate young Japanese developers in the field of embedded software development. In this paper, we give the results of the contest from the viewpoint of software quality evaluation. We created a framework for evaluating software quality, which integrated the design model quality and the final system performance, and we conducted an analysis using this framework. As a result of the analysis, the quantitative measurement of the structural complexity of the design model was found to have a strong relationship to the qualitative evaluation of the design by the contest judges. On the other hand, no strong correlation between the design model quality evaluated by the judges and the final system performance was found. For embedded software development, it is particularly important to estimate and verify reliability and performance in the early stages, according to the design and analysis models. Based on the results, we consider possible remedies with respect to the models submitted, the evaluation methods used, and the contest specifications. To adequately measure several quality characteristics, including performance, in terms of a model, it is necessary to improve the approach to developing robot software (for example, by applying model-driven development) and to reexamine the evaluation methods.

KW - Embedded software

KW - Product metrics

KW - Robot contest

KW - Software design

KW - Software model

KW - Software quality

UR - http://www.scopus.com/inward/record.url?scp=34249747864&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34249747864&partnerID=8YFLogxK

U2 - 10.2201/NiiPi.2007.4.6

DO - 10.2201/NiiPi.2007.4.6

M3 - Article

SP - 63

EP - 78

JO - NII Journal

JF - NII Journal

SN - 1349-8614

IS - 4

ER -