TY - GEN
T1 - AOP-based automated unit test classification of large benchmarks
AU - Artho, Cyrille
AU - Chen, Zhongwei
AU - Honiden, Shinichi
PY - 2007/12/31
Y1 - 2007/12/31
N2 - Despite the availability of a variety of program analysis tools, evaluation of these tools is difficult, as only few benchmark suites exist. Existing benchmark suites lack the uniformity needed for automation of experiments. We introduce the design of a uniform build/installation platform, which constitutes an important part of the solution. This platform is used to manage the build and test process, which is enhanced by a tool that analyzes the structure of unit tests. Benchmark applications lack detailed information about unit tests. Such knowledge is useful: For analysis algorithms that target specific program features, it is desirable to analyze only relevant tests. Using aspect-oriented programming, we wrap test execution and implement a tool providing coverage data of individual unit tests. Furthermore, the wrapper provides a front-end for the selection of subsets of a test suite. We successfully applied our tool to several large programs. This evaluation also gave us interesting insights about the quality of different test suites.
AB - Despite the availability of a variety of program analysis tools, evaluation of these tools is difficult, as only few benchmark suites exist. Existing benchmark suites lack the uniformity needed for automation of experiments. We introduce the design of a uniform build/installation platform, which constitutes an important part of the solution. This platform is used to manage the build and test process, which is enhanced by a tool that analyzes the structure of unit tests. Benchmark applications lack detailed information about unit tests. Such knowledge is useful: For analysis algorithms that target specific program features, it is desirable to analyze only relevant tests. Using aspect-oriented programming, we wrap test execution and implement a tool providing coverage data of individual unit tests. Furthermore, the wrapper provides a front-end for the selection of subsets of a test suite. We successfully applied our tool to several large programs. This evaluation also gave us interesting insights about the quality of different test suites.
UR - http://www.scopus.com/inward/record.url?scp=37349094852&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=37349094852&partnerID=8YFLogxK
U2 - 10.1109/COMPSAC.2007.75
DO - 10.1109/COMPSAC.2007.75
M3 - Conference contribution
AN - SCOPUS:37349094852
SN - 9780769528700
T3 - Proceedings - International Computer Software and Applications Conference
SP - 17
EP - 22
BT - Proceedings - 31st Annual International Computer Software and Applications Conference, COMPSAC 2007
T2 - 31st Annual International Computer Software and Applications Conference, COMPSAC 2007
Y2 - 24 July 2007 through 27 July 2007
ER -