OCCF: A framework for developing test coverage measurement tools supporting multiple programming languages

Kazunori Sakamoto, Kiyofumi Shimojo, Ryohei Takasawa, Hironori Washizaki, Yoshiaki Fukazawa

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    5 Citations (Scopus)

    Abstract

    Although many programming languages and test coverage criteria currently exist, most coverage measurement tools only support select programming languages and coverage criteria. Consequently, multiple measurement tools must be combined to measure coverage for software which uses multiple programming languages such as web applications. However, such combination leads to inconsistent and inaccurate measurement results.In this paper, we describe a consistent and flexible framework for measuring coverage supporting multiple programming languages, called Open Code Coverage Framework (OCCF). OCCF allows users to add new extensions for supporting programming languages and coverage criteria with low development costs. To evaluate the effectiveness of OCCF, sample implementation to support statement coverage and decision coverage for eight programming languages (C, C++, C#, Java, JavaScript, Python, Ruby and Lua) are demonstrated. Additionally, applications of OCCF for localizing faults and minimizing tests are shown.

    Original languageEnglish
    Title of host publicationProceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013
    Pages422-430
    Number of pages9
    DOIs
    Publication statusPublished - 2013
    EventIEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013 - Luxembourg
    Duration: 2013 May 182013 May 20

    Other

    OtherIEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013
    CityLuxembourg
    Period13/5/1813/5/20

    Fingerprint

    Computer programming languages
    Ruby
    Costs

    Keywords

    • fault localization
    • framework
    • programming languages
    • test coverage
    • test-suite minimization

    ASJC Scopus subject areas

    • Software

    Cite this

    Sakamoto, K., Shimojo, K., Takasawa, R., Washizaki, H., & Fukazawa, Y. (2013). OCCF: A framework for developing test coverage measurement tools supporting multiple programming languages. In Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013 (pp. 422-430). [6569756] https://doi.org/10.1109/ICST.2013.59

    OCCF : A framework for developing test coverage measurement tools supporting multiple programming languages. / Sakamoto, Kazunori; Shimojo, Kiyofumi; Takasawa, Ryohei; Washizaki, Hironori; Fukazawa, Yoshiaki.

    Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013. 2013. p. 422-430 6569756.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Sakamoto, K, Shimojo, K, Takasawa, R, Washizaki, H & Fukazawa, Y 2013, OCCF: A framework for developing test coverage measurement tools supporting multiple programming languages. in Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013., 6569756, pp. 422-430, IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013, Luxembourg, 13/5/18. https://doi.org/10.1109/ICST.2013.59
    Sakamoto K, Shimojo K, Takasawa R, Washizaki H, Fukazawa Y. OCCF: A framework for developing test coverage measurement tools supporting multiple programming languages. In Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013. 2013. p. 422-430. 6569756 https://doi.org/10.1109/ICST.2013.59
    Sakamoto, Kazunori ; Shimojo, Kiyofumi ; Takasawa, Ryohei ; Washizaki, Hironori ; Fukazawa, Yoshiaki. / OCCF : A framework for developing test coverage measurement tools supporting multiple programming languages. Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013. 2013. pp. 422-430
    @inproceedings{77363755532845d08c40691f5c88f52a,
    title = "OCCF: A framework for developing test coverage measurement tools supporting multiple programming languages",
    abstract = "Although many programming languages and test coverage criteria currently exist, most coverage measurement tools only support select programming languages and coverage criteria. Consequently, multiple measurement tools must be combined to measure coverage for software which uses multiple programming languages such as web applications. However, such combination leads to inconsistent and inaccurate measurement results.In this paper, we describe a consistent and flexible framework for measuring coverage supporting multiple programming languages, called Open Code Coverage Framework (OCCF). OCCF allows users to add new extensions for supporting programming languages and coverage criteria with low development costs. To evaluate the effectiveness of OCCF, sample implementation to support statement coverage and decision coverage for eight programming languages (C, C++, C#, Java, JavaScript, Python, Ruby and Lua) are demonstrated. Additionally, applications of OCCF for localizing faults and minimizing tests are shown.",
    keywords = "fault localization, framework, programming languages, test coverage, test-suite minimization",
    author = "Kazunori Sakamoto and Kiyofumi Shimojo and Ryohei Takasawa and Hironori Washizaki and Yoshiaki Fukazawa",
    year = "2013",
    doi = "10.1109/ICST.2013.59",
    language = "English",
    pages = "422--430",
    booktitle = "Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013",

    }

    TY - GEN

    T1 - OCCF

    T2 - A framework for developing test coverage measurement tools supporting multiple programming languages

    AU - Sakamoto, Kazunori

    AU - Shimojo, Kiyofumi

    AU - Takasawa, Ryohei

    AU - Washizaki, Hironori

    AU - Fukazawa, Yoshiaki

    PY - 2013

    Y1 - 2013

    N2 - Although many programming languages and test coverage criteria currently exist, most coverage measurement tools only support select programming languages and coverage criteria. Consequently, multiple measurement tools must be combined to measure coverage for software which uses multiple programming languages such as web applications. However, such combination leads to inconsistent and inaccurate measurement results.In this paper, we describe a consistent and flexible framework for measuring coverage supporting multiple programming languages, called Open Code Coverage Framework (OCCF). OCCF allows users to add new extensions for supporting programming languages and coverage criteria with low development costs. To evaluate the effectiveness of OCCF, sample implementation to support statement coverage and decision coverage for eight programming languages (C, C++, C#, Java, JavaScript, Python, Ruby and Lua) are demonstrated. Additionally, applications of OCCF for localizing faults and minimizing tests are shown.

    AB - Although many programming languages and test coverage criteria currently exist, most coverage measurement tools only support select programming languages and coverage criteria. Consequently, multiple measurement tools must be combined to measure coverage for software which uses multiple programming languages such as web applications. However, such combination leads to inconsistent and inaccurate measurement results.In this paper, we describe a consistent and flexible framework for measuring coverage supporting multiple programming languages, called Open Code Coverage Framework (OCCF). OCCF allows users to add new extensions for supporting programming languages and coverage criteria with low development costs. To evaluate the effectiveness of OCCF, sample implementation to support statement coverage and decision coverage for eight programming languages (C, C++, C#, Java, JavaScript, Python, Ruby and Lua) are demonstrated. Additionally, applications of OCCF for localizing faults and minimizing tests are shown.

    KW - fault localization

    KW - framework

    KW - programming languages

    KW - test coverage

    KW - test-suite minimization

    UR - http://www.scopus.com/inward/record.url?scp=84883396484&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84883396484&partnerID=8YFLogxK

    U2 - 10.1109/ICST.2013.59

    DO - 10.1109/ICST.2013.59

    M3 - Conference contribution

    AN - SCOPUS:84883396484

    SP - 422

    EP - 430

    BT - Proceedings - IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013

    ER -