NLP; Use Case Specifications; Test Cases Generation
Abstract :
[en] In safety critical domains, system test cases are often derived from functional requirements in natural language (NL) and traceability between requirements and their corresponding test cases is usually mandatory. The definition of test cases is therefore time-consuming and error prone, especially so given the quickly rising complexity of embedded systems in many critical domains. Though considerable research has been devoted to automatic generation of system test cases from NL requirements, most of the proposed approaches re- quire significant manual intervention or additional, complex behavioral modelling. This significantly hinders their appli- cability in practice.
In this paper, we propose Use Case Modelling for System Tests Generation (UMTG), an approach that automatically generates executable system test cases from use case spec- ifications and a domain model, the latter including a class diagram and constraints. Our rationale and motivation are that, in many environments, including that of our industry partner in the reported case study, both use case specifica- tions and domain modelling are common and accepted prac- tice, whereas behavioural modelling is considered a difficult and expensive exercise if it is to be complete and precise. In order to extract behavioral information from use cases and enable test automation, UMTG employs Natural Language Processing (NLP), a restricted form of use case specifica- tions, and constraint solving.
Research center :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Disciplines :
Computer science
Author, co-author :
Wang, Chunhui ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Pastore, Fabrizio ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Göknil, Arda ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Briand, Lionel ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
Iqbal, Zohaib; National University of Computer & Emerging Sciences (FAST NU) > Quest Lab
External co-authors :
yes
Language :
English
Title :
Automatic Generation of System Test Cases from Use Case Specifications
Publication date :
July 2015
Event name :
International Symposium on Software Testing and Analysis (ISSTA 2015)
Event organizer :
University of Oregon
Event place :
Baltimore, United States
Event date :
July 12–17, 2015
Audience :
International
Main work title :
Proceedings of the International Symposium on Software Testing and Analysis (ISSTA' 15), July 2015, USA
The Object Constraint Language (OCL). http://www.omg.org/spec/OCL/.
S. Ali, M. Zohaib Iqbal, A. Arcuri, and L. Briand. Generating test data from OCL constraints with search techniques. IEEE Transactions on Software Engineering, 39(10):1376-1402, Oct 2013.
A. Bandyopadhyay and S. Ghosh. Test input generation using UML sequence and state machines models. In Proceedings of the 2nd International Conference on Software Testing Verification and Validation (ICST'09), pages 121-130, 2009.
A. Bertolino and S. Gnesi. Use case-based testing of product lines. ACM SIGSOFT Software Engineering Notes, 28(5):355-358, 2003.
L. C. Briand and Y. Labiche. A UML-based approach to system testing. Software and Systems Modelling, 1(1):10-42, 2002.
G. Carvalho, D. Falc~ao, F. Barros, A. Sampaio, A. Mota, L. Motta, and M. Blackburn. Test case generation from natural language requirements based on SCR specifications. In Proceedings of the 28th Annual ACM Symposium on Applied Computing (SAC'13), pages 1217-1222, 2013.
H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications. In Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics (ACL'02), 2002.
A. L. L. de Figueiredo, W. L. Andrade, and P. D. L. Machado. Generating interaction test cases for mobile phone systems from use case specifications. SIGSOFT Software Engineering Notes, 31(6):1-10.
M. J. Escalona, J. J. Gutierrez, M. Mejías, G. Aragón, I. Ramos, J. Torres, and F. J. Domínguez. An overview on test generation from functional requirements. Journal of System and Software, 84(8):1379-1393, Aug. 2011.
P. Frohlich and J. Link. Automated test case generation from dynamic models. In 14th European Conference on Object Oriented Programming (ECOOP'00), pages 472-491, 2000.
J. Gutiérrez, M. J. Escalona, M. Mejías, and J. Torres. A case study for generating test cases from use cases. In Proceedings of the 2nd International Conference on Research Challenges in Information Science (RCIS'08), pages 83-96, 2008.
M. J. Harrold, G. Rothermel, and S. Sinha. Computation of interprocedural control dependence. In Proceedings of the 1998 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'98), pages 11-20, New York, NY, USA, 1998. ACM.
B. Hasling, H. Goetz, and K. Beetz. Model based testing of system requirements using UML use case models. In Proceedings of the 1st international conference on Software Testing, Verification, and Validation (ICST'08), pages 367-376. IEEE, 2008.
M. Kaplan, T. Klinger, A. M. Paradkar, A. Sinha, C. Williams, and C. Yilmaz. Less is more: A minimalistic approach to UML model-based conformance test generation. In 1st International Conference on Software Testing, Verification, and Validation (ICST'08), pages 82-91, 2008.
M. Katara and A. Kervinen. Making model-based testing more agile: a use case driven approach. In Hardware and Software, Verification and Testing, pages 219-234. Springer, 2007.
C. Larman. Applying UML and Patterns:An Introduction to Object-Oriented Analysis and Design and the Unified Process. Prentice Hall Professional, 2002.
W. Linzhang, Y. Jiesong, Y. Xiaofeng, H. Jun, L. Xuandong, and Z. Guoliang. Generating test cases from UML activity diagram based on gray-box method. In Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC'04), 2004.
A. Nayak and D. Samanta. Synthesis of test scenarios using UML activity diagrams. Software and Systems Modelling, 10:63-89, 2011.
C. Nebut, F. Fleurey, Y. Le-Traon, and J.-M. Jezequel. Automatic test generation: a use case driven approach. IEEE Transactions on Software Engineering, 32(3):140-155, March 2006.
M. Riebisch, I. Philippow, and M. Götze. UML-based statistical test case generation. In Objects, Components, Architectures, Services, and Applications for a Networked World, pages 394-411. Springer, 2003.
V. Rus, M. Lintean, R. Banjade, N. Niraula, and D. Stefanescu. SEMILAR: The semantic similarity toolkit. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL), 2013.
J. Ryser and M. Glinz. A scenario-based approach to validating and testing software systems using statecharts. In Proceedings of the 12th International Conference on Software and Systems Engineering and their Applications (ICSSEA'99), 1999.
E. Sarmiento, J. C. S. d. P. Leite, and E. Almentero. C&L: Generating model based test cases from natural language requirements descriptions. In 1st International Workshop on Requirements Engineering and Testing (RET'14), pages 32-38, 2014.
M. Shirole and R. Kumar. UML behavioral model based test case generation: a survey. ACM SIGSOFT Software Engineering Notes, 38(4):1-13, 2013.
A. Sinha, S. M. S. Jr., and A. Paradkar. Text2test: Automated inspection of natural language use cases. In Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST'10), pages 155-164. IEEE Computer Society, 2010.
M. Soeken, R. Wille, and R. Drechsler. Assisted behavior driven development using natural language processing. In Proceedings of the 5th International Conference on Objects, Models, Components, Patterns (TOOLS'12), pages 269-287. Springer-Verlag, 2012.
T. Yue, S. Ali, and L. Briand. Automated transition from use cases to UML state machines to support state-based testing. In Proceedings of the 7th European conference on Modelling foundations and applications (ECMFA'11), pages 115-131, 2011.
T. Yue, L. Briand, and Y. Labiche. An automated approach to transform use cases into activity diagrams. In Proceedings of the 6th European conference on Modelling foundations and applications (ECMFA'10), pages 337-353, 2010.
T. Yue, L. C. Briand, and Y. Labiche. Facilitating the transition from use case models to analysis models: Approach and experiments. ACM Transactions on Software Engineering and Methodology, 22(1), 2013.
M. Zhang, T. Yue, S. Ali, H. Zhang, and J. Wu. A systematic approach to automatically derive test cases from use cases specified in restricted natural languages. In Proceedings of the 8th International Conference on System Analysis and Modeling: Models and Reusability (SAM'14), pages 142-157, 2014.