skip to main content
10.1145/3220134.3220146acmconferencesArticle/Chapter ViewAbstractPublication PageseicsConference Proceedingsconference-collections
extended-abstract

Interactive System Testing: Beyond GUI Testing

Published:19 June 2018Publication History

ABSTRACT

The increasing variety of Input/Output devices and functionalities in interactive systems raises concerns regarding the way they are tested. Indeed, while most of the existing testing techniques are suitable for interactive systems supporting WIMP interactions, only few of them support, partially, the testing of highly interactive systems (e.g. smart speakers or smartwatches). We claim that techniques and tools that provides support for the testing of highly interactive systems must take into account the entire architecture of interactive systems. This includes the variety of I/O devices and their drivers, permissions at the operating system level, applications running on the system, etc. In this doctoral consortium paper, we present an ongoing PhD in which we propose to define an approach and tools to support the testing of all the elements of the architecture of highly interactive systems.

References

  1. Airlines Electronic Engineering Committee. 2002. ARINC 661 specification: Cockpit Display System Interfaces To User Systems. Published by AERONAUTICAL RADIO, INC, april 22, 2002.Google ScholarGoogle Scholar
  2. Ishan Banerjee, Bao Nguyen, Vahid Garousi, and Atif M. Memon. 2013. Graphical user interface (GUI) testing: Systematic mapping and repository. Information and Software Technology 55, 10: 1679--1694. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Stefan Battlogg. 2016. Haptic operating device with a rotating element and method. Retrieved April 9, 2018 from https://patents.google.com/patent/US20160378131A1/en.Google ScholarGoogle Scholar
  4. Robert V. Binder, Bruno Legeard, and Anne Kramer. 2014. Model-based Testing: Where Does It Stand? Queue 13, 1:40:40--40:48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Martin Cronel. 2017. Une approche pour l'ingénierie des systèmes interactifs critiques multimodaux et multiutilisateurs: Application à la prochaine génération de cockpit d'aéronefs. Thèse de doctorat. Université de Toulouse, Université Toulouse III-Paul Sabatier.Google ScholarGoogle Scholar
  6. L Gomez, I. Neamtiu, T. Azim, and T. Millstein. 2013. RERAN: Timing- and touch-sensitive record and replay for Android. 2013 35th International Conference on Software Engineering (ICSE), 72--81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Arnaud Hamon, Phil Palanque, Raphaël André, Eric Barboni, Martin Cronel, and David Navarre. 2014. Multi-Touch Interactions for Control and Display in Interactive Cockpits: Issues and a Proposal. Proceedings of the International Conference on Human-Computer Interaction in Aerospace, ACM, 7:1--7:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Valéria Lelli, Arnaud Blouin, and Benoit Baudry. 2015. Classifying and Qualifying GUI Defects. 1--10. 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW).Google ScholarGoogle ScholarCross RefCross Ref
  9. V. Lelli, A. Blouin, B. Baudry, and F. Coulon. 2015. On model-based testing advanced GUIs. 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 1--10.Google ScholarGoogle Scholar
  10. Atif M. Memon, Mary Lou Soffa, and Martha E. Pollack. 2001. Coverage Criteria for GUI Testing. Proceedings of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering, ACM, 256--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Atif M. Memon and Bao N. Nguyen. 2010. Advances in Automated Model-Based System Testing of Software Applications with a GUI Front-End. In M.V. Zelkowitz, ed., Advances in Computers. Elsevier, 121--162.Google ScholarGoogle Scholar
  12. Bao N. Nguyen, Bryan Robbins, Ishan Banerjee, and Atif Memon. 2014. GUITAR: an innovative tool for automated testing of GUI-driven software. Automated Software Engineering 21, 1: 65--105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Pretschner and J. Philipps. 2005. Methodological issues in model-based testing. In M. Broy, B. Jonsson, J.P. Katoen, M. Leucker, and A. Pretschner, eds., Model-Based Testing of Reactive Systems. Springer-Verlag Berlin, Berlin, 281--291.Google ScholarGoogle Scholar
  14. Alireza Sadeghi, Reyhaneh Jabbarvand, and Sam Malek. 2017. PATDroid: Permission-aware GUI Testing of Android. Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, ACM, 220--232. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Interactive System Testing: Beyond GUI Testing

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        EICS '18: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems
        June 2018
        115 pages
        ISBN:9781450358972
        DOI:10.1145/3220134

        Copyright © 2018 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 19 June 2018

        Check for updates

        Qualifiers

        • extended-abstract
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate73of299submissions,24%

        Upcoming Conference

        EICS '24

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader