0
1

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

Model-based mutation testing-Approach and case studies

Last updated at Posted at 2025-07-14

Model-based mutation testing-Approach and case studies
https://dl.acm.org/doi/abs/10.1016/j.scico.2016.01.003

References

[1] Unified Modeling Language (UML). http://www.omg.org
[2] J. Grabowski, D. Hogrefe, G. Réthy, I. Schieferdecker, A. Wiles, C. Willcock, An introduction to the Testing and Test Control Notation (TTCN-3), Int. J. Comput. Telecommun. Netw., 42 (2003) 375-403.
[3] F. Belli, C.J. Budnik, L. White, Event-based modeling, analysis and testing of user interactions: approach and case study, Softw. Test. Verif. Reliab., 16 (2006) 3-32.
[4] F. Belli, A. Hollmann, Test generation and minimization with 'basic' statecharts, in: 23rd Annual ACM Symposium on Applied Computing, 2008, pp. 718-723.
[5] H. Agrawal, R.A. DeMillo, R. Hathaway, Wm. Hsu, W. Hsu, E.W. Krauser, R.J. Martin, A.P. Mathur, E.H. Spafford, Design of mutant operators for the C programming language, Software Engineering Research Center, Purdue University, W. Lafayette, Indiana, Mar. 1989.
[6] K.N. King, A.J. Offutt, A Fortran language system for mutation-based software testing, Softw. Pract. Exp., 21 (1991) 685-718.
[7] M.E. Delamaro, J.C. Maldonado, A.P. Mathur, Interface mutation: an approach for integration testing, IEEE Trans. Softw. Eng., 27 (2001) 228-247.
[8] G.V. Bochmann, A. Petrenko, Protocol testing: review of methods and relevance for software testing, in: International Symposium on Software Testing and Analysis, 1994, pp. 109-124.
[9] T.S. Chow, Testing software design modeled by finite-state machines, IEEE Trans. Softw. Eng., 4 (1978) 178-187.
[10] S.C.P.F. Fabbri, J.C. Maldonado, M.E. Delamaro, P.C. Masiero, Mutation analysis testing for finite-state machines, in: 5th IEEE International Symposium on Software Reliability Engineering, 1994, pp. 220-229.
[11] S.C.P.F. Fabbri, J.C. Maldonado, P.C. Masiero, M.E. Delamaro, W.E. Wong, Mutation testing applied to validate specifications based on Petri nets, in: 8th International IFIP Conference on Formal Description Techniques for Distributed Systems and Communications Protocols, 1995, pp. 329-337.
[12] S.C.P.F. Fabbri, J.C. Maldonado, T. Sugeta, P.C. Masiero, Mutation testing applied to validate specifications based on statecharts, in: 10th IEEE International Symposium on Software Reliability Engineering, 1999, pp. 210-219.
[13] G. Kovács, Z. Pap, D.L. Viet, A. Wu-Hen-Chang, G. Csopaki, Applying mutation analysis to SDL specifications, in: SDL Forum, 2003, pp. 269-284.
[14] B. Sarikaya, Conformance testing: architectures and test sequences, Comput. Netw. ISDN Syst., 17 (1989) 111-126.
[15] T. Sugeta, J.C. Maldonado, W.E. Wong, Mutation testing applied to validate SDL specifications, in: LNCS, vol. 2978, Springer, 2004, pp. 193-208.
[16] W.E. Wong, A. Restrepo, Y. Qi, B. Choi, An EFSM-based test generation for validation of SDL specifications, in: 3rd International Workshop on Automation of Software Test, 2008, pp. 25-32.
[17] B.J. Choi, R.A. DeMillo, E.W. Krauser, R.J. Martin, A.P. Mathur, A.J. Offutt, H. Pan, E.H. Spafford, The Mothra tool set, in: 22nd Annual Hawaii International Conference on System Sciences, 1989, pp. 275-284.
[18] B.K. Aichernig, E. Joebstl, Efficient refinement checking for model-based mutation testing, in: 12th International Conference on Quality Software, Aug. 2012.
[19] E.M. Clarke, O. Grumberg, D. Peled, Model Checking, MIT Press, 2000.
[20] H. Zhu, P.A.V. Hall, J.H.R. May, Software unit test coverage and adequacy, ACM Comput. Surv., 29 (1997) 366-427.
[21] A.M. Memon, An event-flow model of GUI-based applications for testing, Softw. Test. Verif. Reliab., 17 (2007) 137-157.
[22] F. Belli, C.J. Budnik, Test minimization for human-computer interaction, J. Appl. Intell., 26 (2007) 161-174.
[23] T.A. Budd, F.G. Sayward, R.A. DeMillo, R.J. Lipton, The design of a prototype mutation system for program testing, in: National Computer Conference, 1978, pp. 623-627.
[24] R.A. DeMillo, R.J. Lipton, F.G. Sayward, Hints on test data selection: help for the practicing programmer, Computer, 11 (1978) 34-41.
[25] Y. Jia, M. Harman, An analysis and survey of the development of mutation testing, IEEE Trans. Softw. Eng., 37 (2011) 649-678.
[26] A.T. Acree, On mutation, Georgia Institute of Technology, Atlanta, Georgia, 1980.
[27] T.A. Budd, Mutation analysis of program test data, Yale University, New Haven, Connecticut, 1980.
[28] A.J. Offutt, Investigations of the software testing coupling effect, ACM Trans. Softw. Eng. Methodol., 1 (1992) 3-18.
[29] R.A. DeMillo, R.J. Martin, The Mothra software testing environment user's manual, Software Engineering Research Center, Purdue University, W. Lafayette, Indiana, Sep. 1987.
[30]. http://www.real.com
[31]. http://www.hella.de
[32]. http://www.vector-worldwide.com
[33]. http://www.mercedes-benz.de
[34] M. Harman, Y. Jia, W.B. Langdon, A manifesto for higher order mutation testing, in: 5th Workshop on Mutation Analysis, Apr. 2010.
[35] Y. Jia, M. Harman, Higher order mutation testing, J. Inf. Softw. Technol., 51 (2009) 1379-1393.
[36] J.M. Hanks, Testing COBOL programs by mutation, Georgia Institute of Technology, 1980.
[37] T.A. Budd, R.J. Lipton, Proving lisp programs using test data (digest), in: The Workshop on Software Testing and Test Documentation, IEEE Computer Society Press, 1978, pp. 374-403.
[38] J.H. Bowser, Reference manual for Ada mutant operators, Georgia Institute of Technology, Feb. 1988.
[39] A.J. Offutt, J. Payne, J.M. Voas, Mutation operators for Ada, Department of Information and Software Systems Engineering, George Mason University, Fairfax, Virginia, Mar. 1996.
[40] S.W. Kim, J.A. Clark, J.A. McDermid, Investigating the effectiveness of object-oriented testing strategies with the mutation method, Softw. Test. Verif. Reliab., 11 (2001) 207-225.
[41] Y.S. Ma, Y.R. Kwon, A.J. Offutt, Inter-class mutation operators for Java, in: 13th IEEE International Symposium on Software Reliability Engineering, 2002, pp. 352-363.
[42] Y.S. Ma, A.J. Offutt, Y.R. Kwon, MuJava: an automated class mutation system, Softw. Test. Verif. Reliab., 15 (2005) 97-133.
[43] M.E. Delamaro, J.C. Maldonado, A.P. Mathur, Proteum - a tool for the assessment of test adequacy for C programs: user's guide, Software Engineering Research Center, Purdue University, W. Lafayette, Indiana, Apr. 1996.
[44] P. Ammann, P.E. Black, W. Majurski, Using model checking to generate tests from specifications, in: 2nd IEEE International Conference on Formal Engineering Methods, 1998, pp. 46-54.
[45] J.B. Goodenough, S.L. Gerhart, Toward a theory of test data selection, IEEE Trans. Softw. Eng., 1 (1975) 156-173.
[46] S.C.P.F. Fabbri, J.C. Maldonado, P.C. Masiero, M. Delamaro, Proteum/FSM: a tool to support finite state machine validation based on mutation testing, in: 19th International Conference of the Chilean Computer Science Society, 1999, pp. 96-104.
[47] K.A. El-Fakih, R. Dorofeeva, N.V. Yevtushenko, G.V. Bochmann, FSM-based testing from user defined faults adapted to incremental and mutation testing, Program. Comput. Softw., 38 (2012) 201-209.
[48] J.A. Clark, H. Dan, R.M. Hierons, Semantic mutation testing, Sci. Comput. Program., 78 (2013) 345-363.
[49] B.K. Aichernig, H. Brandl, E. Jöbstl, W. Krenn, R. Schlick, S. Tiran, Killing strategies for model-based mutation testing, Softw. Test. Verif. Reliab., 25 (2014) 716-748.
[50] B.K. Aichernig, E. Jöbstl, Towards symbolic model-based mutation testing: combining reachability and refinement checking, in: Workshop on Model Based Testing, 2012, pp. 88-102.
[51] G. Smith, The Object-Z Specification Language, Kluwer Academic Publishers, Boston, 2000.
[52] P.A. Stocks, Applying formal methods to software testing, The University of Queensland, Brisbane, 1993.
[53] L. Liu, H. Miao, Mutation operators for object-Z specification, in: 10th IEEE International Conference on Engineering of Complex Computer Systems, 2005, pp. 498-506.
[54] M. Woodward, Errors in algebraic specifications and an experimental mutation testing tool, Softw. Eng. J., 8 (1993) 211-224.
[55] D. Coleman, R.M. Gallimore, V. Stavridou, The design of a rewrite rule interpreter from algebraic specifications, Softw. Eng. J., 2 (1987) 95-104.
[56] S.C. Lee, J. Offutt, Generating test cases for XML based web component interactions using mutation analysis, in: 12th IEEE International Symposium on Software Reliability Engineering, 2001, pp. 200-209.
[57] W. Xu, A.J. Offutt, J. Luo, Testing web services by XML perturbation, in: 16th IEEE International Symposium on Software Reliability Engineering, 2005, pp. 257-266.
[58] J.B. Li, J. Miller, Testing the semantics of W3C XML schema, in: 29th Annual International Computer Software and Applications Conference, 2005, pp. 26-28.
[59] C. Henard, M. Papadakis, G. Perrouin, J. Klein, Y. Le Traon, Assessing software product line testing via model-based mutation: an application to similarity testing, in: Sixth IEEE International Conference on Software Testing, Verification and Validation Workshops, 2013, pp. 188-197.
[60] P. Oehlert, Violating assumptions with fuzzing, IEEE Secur. Priv., 3 (2005) 58-62.
[61] Y. Hsu, G. Shu, D. Lee, A model-based approach to security flaw detection of network protocol implementations, in: Proc. IEEE International Conference on Network Protocols, 2008, pp. 114-123.
[62] S. Gorbunov, A. Rosenbloom, Autofuzz: automated network protocol fuzzing framework, Int. J. Comput. Sci. Netw. Secur., 10 (2010).
[63] Z. Zhang, Q. Wen, W. Tang, An efficient mutation-based fuzz testing approach for detecting flaws of network protocol, in: Proc. International Conference on Computer Science & Service System, 2012, pp. 814-817.
[64] D. Yang, Y. Zhang, Q. Liu, BlendFuzz: a model-based framework for fuzz testing programs with grammatical inputs, in: Proc. IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications, 2012, pp. 1070-1076.
[65] P. Ammann, P.E. Black, A specification-based coverage metric to evaluate test sets, Int. J. Reliab. Qual. Saf. Eng., 8 (2001) 275-300.
[66] P.E. Black, V. Okun, Y. Yesha, Mutation of model checker specifications for test generation and evaluation, in: Mutation Testing for the New Century, Kluwer Academic Publishers, Norwell, Massachusetts, 2001, pp. 14-20.
[67] P.E. Black, V. Okun, Y. Yesha, Mutation operators for specifications, in: 15th IEEE International Conference on Automated Software Engineering, 2000, pp. 81-88.
[68] F. Belli, B. Guldali, Software testing via model checking, in: Proc. 19th International Symposium on Computer and Information Sciences, Springer-Verlag, 2004, pp. 907-916.
[69] F. Belli, B. Guldali, A holistic approach to test-driven model checking, in: LNAI, vol. 3533, Springer-Verlag, 2005, pp. 321-331.
[70] A.J. Offutt, P. Ammann, L. Liu, Mutation testing implements grammar-based testing, in: Proc. 2nd Workshop Mutation Analysis, Nov. 2006, pp. 12-21.
[71] F. Belli, M. Beyazit, Exploiting model morphology for event-based testing, IEEE Trans. Softw. Eng., 41 (2015) 113-134.
[72] P. Ammann, A.J. Offutt, Introduction to Software Testing, Cambridge Univ. Press, 2008.
[73] F. Belli, M. Beyazit, T. Takagi, Z. Furukawa, Model-based mutation testing using pushdown automata, IEICE Trans. Inf. Syst., E95-D (2012) 2211-2218.
[74] F. Belli, M. Beyazit, Mutation of directed graphs - corresponding regular expressions and complexity of their generation, Electron. Proc. Theor. Comput. Sci., 3 (2009) 69-77.
[75] F. Belli, M. Beyazit, Using regular grammars for event-based testing, in: LNCS, vol. 7982, Springer-Verlag, 2013, pp. 48-59.

0
1
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
0
1

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?