DNN-Based image classification for software GUI testing

Huijuan Lu, Li Wang, Minchao Ye, Ke Yan, Qun Jin

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    Since visual design of Graphical User Interface (GUI) is one of the indispensable parts of every software and to some extent, it determines whether the software is attractive. And with the increasing amount of GUI designs, it is usually impractical to deal with a variety of designs manually with limited staff. Therefore, a solution for that program is needed. This work designs and implements an automatic GUI testing system based on Deep Neural Network (DNN) and cloud service. The system includes screenshot capturing and uploading module, web server, DNN models, etc. It provides accurate and efficient GUI automatic testing technology.

    Original languageEnglish
    Title of host publicationProceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018
    EditorsFrederic Loulergue, Guojun Wang, Md Zakirul Alam Bhuiyan, Xiaoxing Ma, Peng Li, Manuel Roveri, Qi Han, Lei Chen
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages1818-1823
    Number of pages6
    ISBN (Electronic)9781538693803
    DOIs
    Publication statusPublished - 2018 Dec 4
    Event4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018 - Guangzhou, China
    Duration: 2018 Oct 72018 Oct 11

    Other

    Other4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018
    CountryChina
    CityGuangzhou
    Period18/10/718/10/11

      Fingerprint

    Keywords

    • Cloud service
    • Deep neural network
    • GUI testing

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Computer Science Applications
    • Information Systems and Management
    • Artificial Intelligence

    Cite this

    Lu, H., Wang, L., Ye, M., Yan, K., & Jin, Q. (2018). DNN-Based image classification for software GUI testing. In F. Loulergue, G. Wang, M. Z. A. Bhuiyan, X. Ma, P. Li, M. Roveri, Q. Han, & L. Chen (Eds.), Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018 (pp. 1818-1823). [8560284] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SmartWorld.2018.00306