AOP-based automated unit test classification of large benchmarks

Cyrille Artho, Zhongwei Chen, Shinichi Honiden

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Despite the availability of a variety of program analysis tools, evaluation of these tools is difficult, as only few benchmark suites exist. Existing benchmark suites lack the uniformity needed for automation of experiments. We introduce the design of a uniform build/installation platform, which constitutes an important part of the solution. This platform is used to manage the build and test process, which is enhanced by a tool that analyzes the structure of unit tests. Benchmark applications lack detailed information about unit tests. Such knowledge is useful: For analysis algorithms that target specific program features, it is desirable to analyze only relevant tests. Using aspect-oriented programming, we wrap test execution and implement a tool providing coverage data of individual unit tests. Furthermore, the wrapper provides a front-end for the selection of subsets of a test suite. We successfully applied our tool to several large programs. This evaluation also gave us interesting insights about the quality of different test suites.

Original languageEnglish
Title of host publicationProceedings - 31st Annual International Computer Software and Applications Conference, COMPSAC 2007
Pages17-22
Number of pages6
Volume2
DOIs
Publication statusPublished - 2007 Dec 31
Externally publishedYes
Event31st Annual International Computer Software and Applications Conference, COMPSAC 2007 - Beijing, China
Duration: 2007 Jul 242007 Jul 27

Other

Other31st Annual International Computer Software and Applications Conference, COMPSAC 2007
CountryChina
CityBeijing
Period07/7/2407/7/27

    Fingerprint

ASJC Scopus subject areas

  • Software

Cite this

Artho, C., Chen, Z., & Honiden, S. (2007). AOP-based automated unit test classification of large benchmarks. In Proceedings - 31st Annual International Computer Software and Applications Conference, COMPSAC 2007 (Vol. 2, pp. 17-22). [4291097] https://doi.org/10.1109/COMPSAC.2007.75