skip to main content
10.1145/2950290.2983942acmconferencesArticle/Chapter ViewAbstractPublication PagesfseConference Proceedingsconference-collections
abstract

Regression testing of web applications using Record/Replay tools

Published:01 November 2016Publication History

ABSTRACT

Software engineers often use record/replay tools to enable the automated testing of web applications. Tests created in this man- ner can then be used to regression test new versions of the web applications as they evolve. Web application tests recorded by record/replay tools, however, can be quite brittle; they can easily break as applications change. For this reason, researchers have be- gun to seek approaches for automatically repairing record/replay tests. This research investigates different aspects in relation to test- ing web applications using record/replay tools. The areas that we are interested in include taxonomizing the causes behind breakages and developing automated techniques to repair breakages, creating prevention techniques to stop the occurrence of breakages and de- veloping automated frameworks for root cause analysis. Finally, we intend to evaluate all of these activities via controlled studies involving software engineers and real web application tests.

References

  1. S. Chandra, E. Torlak, S. Barman, and R. Bodik. Angelic debugging. In Proceedings of the International Conference on Software Engineering, pages 121–130, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. S. R. Choudhary, D. Zhao, H. Versee, and A. Orso. WATER: Web Application TEst Repair. In Proceedings of the Workshop on End-to-End Test Script Engineering, pages 24–29, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. B. Daniel, T. Gvero, and D. Marinov. On test repair using symbolic execution. In Proceedings of the International Symposium on Software Testing and Analysis, pages 207–218, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. B. Daniel, V. Jagannath, D. Dig, and D. Marinov. ReAssert: Suggesting repairs for broken unit tests. In Proceedings of the International Conference on Automated Software Engineering, pages 433–444, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. B. Daniel, Q. Luo, M. Mirzaaghaei, D. Dig, D. Marinov, and M. Pezzè. Automated GUI refactoring and test script repair. In Proceedings of the Workshop on End-to-End Test Script Engineering, pages 38–41, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. M. Dhatchayani, X. A. R. Arockia, P. Yogesh, and B. Zacharias. Test case generation and reusing test cases for GUI designed with HTML. Journal of Software, 7(10):2269–2277, 2012.Google ScholarGoogle Scholar
  7. D. Gopinath, M. Z. Malik, and S. Khurshid. Specification-based program repair using SAT. In Proceedings of the International Conference on Tools and Algorithms for the Construction and Analysis of Systems, pages 173–188, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. Grechanik, Q. Xie, and C. Fu. Maintaining and evolving GUI-directed test scripts. In Proceedings of the International Conference on Software Engineering, pages 408–418, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. Hammoudi, G. Rothermel, and A. Stocco. Waterfall: An incremental approach for repairing record-replay tests of web applications. In Proceedings of the International Symposium on the Foundations of Software Engineering, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. M. Hammoudi, G. Rothermel, and P. Tonella. Why do record/replay tests of web applications break? In Proceedings of the International Conference on Software Testing, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  11. S. Huang, M. B. Cohen, and A. M. Memon. Repairing GUI test suites using a genetic algorithm. In Proceedings of the International Conference on Software Testing, pages 245–254, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Leotta, A. Stocco, F. Ricca, and P. Tonella. Using multi-locators to increase the robustness of web test cases. In Proceedings of the International Conference on Software Testing, Verification and Validation, pages 1–10, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  13. S. Mechtaev, J. Yi, and A. Roychoudhury. DirectFix: Looking for simple program repairs. In Proceedings of the International Conference on Software Engineering, pages 448–458, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. A. M. Memon. Automatically repairing event sequence-based GUI test suites for regression testing. ACM Transactions on Software Engineering and Methodology, 18(2):4:1–4:36, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. A. M. Memon and M. L. Soffa. Regression testing of GUIs. In Proceedings of the International Symposium on the Foundations of Software Engineering, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. Mirzaaghaei, F. Pastore, and M. Pezze. Supporting test suite evolution through test case adaptation. In Proceedings of the International Conference on Software Testing, Verification and Validation, pages 231–240, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. H. D. T. Nguyen, D. Qi, A. Roychoudhury, and S. Chandra. Semfix: Program repair via semantic analysis. In Proceedings of the International Conference on Software Engineering, pages 772–781, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. The Selenium Project. http://seleniumhq.org/docs/03_webdriver.html/.Google ScholarGoogle Scholar
  19. A. Stocco, M. Leotta, F. Ricca, and P. Tonella. Why creating web page objects manually if it can be done automatically? In Proceedings of 10th IEEE/ACM International Workshop on Automation of Software Test, AST 2015, pages 70–74. IEEE, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Stocco, M. Leotta, F. Ricca, and P. Tonella. Clustering-aided page object generation for web testing. In Proceedings of 16th International Conference on Web Engineering, ICWE 2016, pages 132–151. Springer, 2016.Google ScholarGoogle Scholar
  21. S. Zhang, H. Lü, and M. D. Ernst. Automatically repairing broken workflows for evolving GUI applications. In Proceedings of the International Symposium on Software Testing and Analysis, pages 45–55, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Regression testing of web applications using Record/Replay tools

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      FSE 2016: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering
      November 2016
      1156 pages
      ISBN:9781450342186
      DOI:10.1145/2950290

      Copyright © 2016 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 November 2016

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      Overall Acceptance Rate17of128submissions,13%

      Upcoming Conference

      FSE '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader