Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Crawling JavaScript heavy Rich Internet Applications has been a hot topic in recent years, giving us automated tools for indexing content, test generation, and security- and accessibility evaluation to mention a few examples. However, existing crawling techniques tend to ignore user interactions beyond mouse clicking, and therefore often fail to consider potential mouse, keyboard and touch interactions. We propose a new technique for finding and exercising mouse, keyboard, and touch interactions when crawling highly interactive JavaScript-based websites by analyzing and exercising event handlers registered in the DOM. A basic form of gesture emulation is employed to find states accessible via swiping and tapping. Testing the tool against 6 well-known gesture libraries and 5 actual RIA's, we find that the technique discovers many states and transitions resulting from such interactions. Our findings indicate the technique could be useful for automatic test generation, error discovery, and accessibility evaluation, especially for mobile web applications with advanced interaction options.

    Original languageEnglish
    Title of host publicationProceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE
    PublisherKnowledge Systems Institute Graduate School
    Pages631-638
    Number of pages8
    Volume2015-January
    ISBN (Print)1891706373
    DOIs
    Publication statusPublished - 2015
    Event27th International Conference on Software Engineering and Knowledge Engineering, SEKE 2015 - Pittsburgh, United States
    Duration: 2015 Jul 62015 Jul 8

    Other

    Other27th International Conference on Software Engineering and Knowledge Engineering, SEKE 2015
    CountryUnited States
    CityPittsburgh
    Period15/7/615/7/8

    Fingerprint

    Websites
    Internet
    Testing

    Keywords

    • Crawling
    • Event handler analysis
    • Gesture emulation
    • RIA

    ASJC Scopus subject areas

    • Software

    Cite this

    Nakstad, F. H., Washizaki, H., & Fukazawa, Y. (2015). Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's. In Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE (Vol. 2015-January, pp. 631-638). Knowledge Systems Institute Graduate School. https://doi.org/10.18293/SEKE2015-059

    Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's. / Nakstad, Frederik H.; Washizaki, Hironori; Fukazawa, Yoshiaki.

    Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE. Vol. 2015-January Knowledge Systems Institute Graduate School, 2015. p. 631-638.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Nakstad, FH, Washizaki, H & Fukazawa, Y 2015, Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's. in Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE. vol. 2015-January, Knowledge Systems Institute Graduate School, pp. 631-638, 27th International Conference on Software Engineering and Knowledge Engineering, SEKE 2015, Pittsburgh, United States, 15/7/6. https://doi.org/10.18293/SEKE2015-059
    Nakstad FH, Washizaki H, Fukazawa Y. Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's. In Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE. Vol. 2015-January. Knowledge Systems Institute Graduate School. 2015. p. 631-638 https://doi.org/10.18293/SEKE2015-059
    Nakstad, Frederik H. ; Washizaki, Hironori ; Fukazawa, Yoshiaki. / Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's. Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE. Vol. 2015-January Knowledge Systems Institute Graduate School, 2015. pp. 631-638
    @inproceedings{1565fa6ed5fe4c4181600e55780f463e,
    title = "Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's",
    abstract = "Crawling JavaScript heavy Rich Internet Applications has been a hot topic in recent years, giving us automated tools for indexing content, test generation, and security- and accessibility evaluation to mention a few examples. However, existing crawling techniques tend to ignore user interactions beyond mouse clicking, and therefore often fail to consider potential mouse, keyboard and touch interactions. We propose a new technique for finding and exercising mouse, keyboard, and touch interactions when crawling highly interactive JavaScript-based websites by analyzing and exercising event handlers registered in the DOM. A basic form of gesture emulation is employed to find states accessible via swiping and tapping. Testing the tool against 6 well-known gesture libraries and 5 actual RIA's, we find that the technique discovers many states and transitions resulting from such interactions. Our findings indicate the technique could be useful for automatic test generation, error discovery, and accessibility evaluation, especially for mobile web applications with advanced interaction options.",
    keywords = "Crawling, Event handler analysis, Gesture emulation, RIA",
    author = "Nakstad, {Frederik H.} and Hironori Washizaki and Yoshiaki Fukazawa",
    year = "2015",
    doi = "10.18293/SEKE2015-059",
    language = "English",
    isbn = "1891706373",
    volume = "2015-January",
    pages = "631--638",
    booktitle = "Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE",
    publisher = "Knowledge Systems Institute Graduate School",

    }

    TY - GEN

    T1 - Finding and emulating keyboard, mouse, and touch interactions and gestures while crawling RIA's

    AU - Nakstad, Frederik H.

    AU - Washizaki, Hironori

    AU - Fukazawa, Yoshiaki

    PY - 2015

    Y1 - 2015

    N2 - Crawling JavaScript heavy Rich Internet Applications has been a hot topic in recent years, giving us automated tools for indexing content, test generation, and security- and accessibility evaluation to mention a few examples. However, existing crawling techniques tend to ignore user interactions beyond mouse clicking, and therefore often fail to consider potential mouse, keyboard and touch interactions. We propose a new technique for finding and exercising mouse, keyboard, and touch interactions when crawling highly interactive JavaScript-based websites by analyzing and exercising event handlers registered in the DOM. A basic form of gesture emulation is employed to find states accessible via swiping and tapping. Testing the tool against 6 well-known gesture libraries and 5 actual RIA's, we find that the technique discovers many states and transitions resulting from such interactions. Our findings indicate the technique could be useful for automatic test generation, error discovery, and accessibility evaluation, especially for mobile web applications with advanced interaction options.

    AB - Crawling JavaScript heavy Rich Internet Applications has been a hot topic in recent years, giving us automated tools for indexing content, test generation, and security- and accessibility evaluation to mention a few examples. However, existing crawling techniques tend to ignore user interactions beyond mouse clicking, and therefore often fail to consider potential mouse, keyboard and touch interactions. We propose a new technique for finding and exercising mouse, keyboard, and touch interactions when crawling highly interactive JavaScript-based websites by analyzing and exercising event handlers registered in the DOM. A basic form of gesture emulation is employed to find states accessible via swiping and tapping. Testing the tool against 6 well-known gesture libraries and 5 actual RIA's, we find that the technique discovers many states and transitions resulting from such interactions. Our findings indicate the technique could be useful for automatic test generation, error discovery, and accessibility evaluation, especially for mobile web applications with advanced interaction options.

    KW - Crawling

    KW - Event handler analysis

    KW - Gesture emulation

    KW - RIA

    UR - http://www.scopus.com/inward/record.url?scp=84969790718&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84969790718&partnerID=8YFLogxK

    U2 - 10.18293/SEKE2015-059

    DO - 10.18293/SEKE2015-059

    M3 - Conference contribution

    SN - 1891706373

    VL - 2015-January

    SP - 631

    EP - 638

    BT - Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE

    PB - Knowledge Systems Institute Graduate School

    ER -