Model-based mutation testing-Approach and case studies
https://dl.acm.org/doi/abs/10.1016/j.scico.2016.01.003

References

[1] Unified Modeling Language (UML). http://www.omg.org
[2] J. Grabowski, D. Hogrefe, G. Réthy, I. Schieferdecker, A. Wiles, C. Willcock, An introduction to the Testing and Test Control Notation (TTCN-3), Int. J. Comput. Telecommun. Netw., 42 (2003) 375-403.
[3] F. Belli, C.J. Budnik, L. White, Event-based modeling, analysis and testing of user interactions: approach and case study, Softw. Test. Verif. Reliab., 16 (2006) 3-32.
[4] F. Belli, A. Hollmann, Test generation and minimization with 'basic' statecharts, in: 23rd Annual ACM Symposium on Applied Computing, 2008, pp. 718-723.
[5] H. Agrawal, R.A. DeMillo, R. Hathaway, Wm. Hsu, W. Hsu, E.W. Krauser, R.J. Martin, A.P. Mathur, E.H. Spafford, Design of mutant operators for the C programming language, Software Engineering Research Center, Purdue University, W. Lafayette, Indiana, Mar. 1989.
[6] K.N. King, A.J. Offutt, A Fortran language system for mutation-based software testing, Softw. Pract. Exp., 21 (1991) 685-718.
[7] M.E. Delamaro, J.C. Maldonado, A.P. Mathur, Interface mutation: an approach for integration testing, IEEE Trans. Softw. Eng., 27 (2001) 228-247.
[8] G.V. Bochmann, A. Petrenko, Protocol testing: review of methods and relevance for software testing, in: International Symposium on Software Testing and Analysis, 1994, pp. 109-124.
[9] T.S. Chow, Testing software design modeled by finite-state machines, IEEE Trans. Softw. Eng., 4 (1978) 178-187.
[10] S.C.P.F. Fabbri, J.C. Maldonado, M.E. Delamaro, P.C. Masiero, Mutation analysis testing for finite-state machines, in: 5th IEEE International Symposium on Software Reliability Engineering, 1994, pp. 220-229.
[11] S.C.P.F. Fabbri, J.C. Maldonado, P.C. Masiero, M.E. Delamaro, W.E. Wong, Mutation testing applied to validate specifications based on Petri nets, in: 8th International IFIP Conference on Formal Description Techniques for Distributed Systems and Communications Protocols, 1995, pp. 329-337.
[12] S.C.P.F. Fabbri, J.C. Maldonado, T. Sugeta, P.C. Masiero, Mutation testing applied to validate specifications based on statecharts, in: 10th IEEE International Symposium on Software Reliability Engineering, 1999, pp. 210-219.
[13] G. Kovács, Z. Pap, D.L. Viet, A. Wu-Hen-Chang, G. Csopaki, Applying mutation analysis to SDL specifications, in: SDL Forum, 2003, pp. 269-284.
[14] B. Sarikaya, Conformance testing: architectures and test sequences, Comput. Netw. ISDN Syst., 17 (1989) 111-126.
[15] T. Sugeta, J.C. Maldonado, W.E. Wong, Mutation testing applied to validate SDL specifications, in: LNCS, vol. 2978, Springer, 2004, pp. 193-208.
[16] W.E. Wong, A. Restrepo, Y. Qi, B. Choi, An EFSM-based test generation for validation of SDL specifications, in: 3rd International Workshop on Automation of Software Test, 2008, pp. 25-32.
[17] B.J. Choi, R.A. DeMillo, E.W. Krauser, R.J. Martin, A.P. Mathur, A.J. Offutt, H. Pan, E.H. Spafford, The Mothra tool set, in: 22nd Annual Hawaii International Conference on System Sciences, 1989, pp. 275-284.
[18] B.K. Aichernig, E. Joebstl, Efficient refinement checking for model-based mutation testing, in: 12th International Conference on Quality Software, Aug. 2012.
[19] E.M. Clarke, O. Grumberg, D. Peled, Model Checking, MIT Press, 2000.
[20] H. Zhu, P.A.V. Hall, J.H.R. May, Software unit test coverage and adequacy, ACM Comput. Surv., 29 (1997) 366-427.
[21] A.M. Memon, An event-flow model of GUI-based applications for testing, Softw. Test. Verif. Reliab., 17 (2007) 137-157.
[22] F. Belli, C.J. Budnik, Test minimization for human-computer interaction, J. Appl. Intell., 26 (2007) 161-174.
[23] T.A. Budd, F.G. Sayward, R.A. DeMillo, R.J. Lipton, The design of a prototype mutation system for program testing, in: National Computer Conference, 1978, pp. 623-627.
[24] R.A. DeMillo, R.J. Lipton, F.G. Sayward, Hints on test data selection: help for the practicing programmer, Computer, 11 (1978) 34-41.
[25] Y. Jia, M. Harman, An analysis and survey of the development of mutation testing, IEEE Trans. Softw. Eng., 37 (2011) 649-678.
[26] A.T. Acree, On mutation, Georgia Institute of Technology, Atlanta, Georgia, 1980.
[27] T.A. Budd, Mutation analysis of program test data, Yale University, New Haven, Connecticut, 1980.
[28] A.J. Offutt, Investigations of the software testing coupling effect, ACM Trans. Softw. Eng. Methodol., 1 (1992) 3-18.
[29] R.A. DeMillo, R.J. Martin, The Mothra software testing environment user's manual, Software Engineering Research Center, Purdue University, W. Lafayette, Indiana, Sep. 1987.
[30]. http://www.real.com
[31]. http://www.hella.de
[32]. http://www.vector-worldwide.com
[33]. http://www.mercedes-benz.de
[34] M. Harman, Y. Jia, W.B. Langdon, A manifesto for higher order mutation testing, in: 5th Workshop on Mutation Analysis, Apr. 2010.
[35] Y. Jia, M. Harman, Higher order mutation testing, J. Inf. Softw. Technol., 51 (2009) 1379-1393.
[36] J.M. Hanks, Testing COBOL programs by mutation, Georgia Institute of Technology, 1980.
[37] T.A. Budd, R.J. Lipton, Proving lisp programs using test data (digest), in: The Workshop on Software Testing and Test Documentation, IEEE Computer Society Press, 1978, pp. 374-403.
[38] J.H. Bowser, Reference manual for Ada mutant operators, Georgia Institute of Technology, Feb. 1988.
[39] A.J. Offutt, J. Payne, J.M. Voas, Mutation operators for Ada, Department of Information and Software Systems Engineering, George Mason University, Fairfax, Virginia, Mar. 1996.
[40] S.W. Kim, J.A. Clark, J.A. McDermid, Investigating the effectiveness of object-oriented testing strategies with the mutation method, Softw. Test. Verif. Reliab., 11 (2001) 207-225.
[41] Y.S. Ma, Y.R. Kwon, A.J. Offutt, Inter-class mutation operators for Java, in: 13th IEEE International Symposium on Software Reliability Engineering, 2002, pp. 352-363.
[42] Y.S. Ma, A.J. Offutt, Y.R. Kwon, MuJava: an automated class mutation system, Softw. Test. Verif. Reliab., 15 (2005) 97-133.
[43] M.E. Delamaro, J.C. Maldonado, A.P. Mathur, Proteum - a tool for the assessment of test adequacy for C programs: user's guide, Software Engineering Research Center, Purdue University, W. Lafayette, Indiana, Apr. 1996.
[44] P. Ammann, P.E. Black, W. Majurski, Using model checking to generate tests from specifications, in: 2nd IEEE International Conference on Formal Engineering Methods, 1998, pp. 46-54.
[45] J.B. Goodenough, S.L. Gerhart, Toward a theory of test data selection, IEEE Trans. Softw. Eng., 1 (1975) 156-173.
[46] S.C.P.F. Fabbri, J.C. Maldonado, P.C. Masiero, M. Delamaro, Proteum/FSM: a tool to support finite state machine validation based on mutation testing, in: 19th International Conference of the Chilean Computer Science Society, 1999, pp. 96-104.
[47] K.A. El-Fakih, R. Dorofeeva, N.V. Yevtushenko, G.V. Bochmann, FSM-based testing from user defined faults adapted to incremental and mutation testing, Program. Comput. Softw., 38 (2012) 201-209.
[48] J.A. Clark, H. Dan, R.M. Hierons, Semantic mutation testing, Sci. Comput. Program., 78 (2013) 345-363.
[49] B.K. Aichernig, H. Brandl, E. Jöbstl, W. Krenn, R. Schlick, S. Tiran, Killing strategies for model-based mutation testing, Softw. Test. Verif. Reliab., 25 (2014) 716-748.
[50] B.K. Aichernig, E. Jöbstl, Towards symbolic model-based mutation testing: combining reachability and refinement checking, in: Workshop on Model Based Testing, 2012, pp. 88-102.
[51] G. Smith, The Object-Z Specification Language, Kluwer Academic Publishers, Boston, 2000.
[52] P.A. Stocks, Applying formal methods to software testing, The University of Queensland, Brisbane, 1993.
[53] L. Liu, H. Miao, Mutation operators for object-Z specification, in: 10th IEEE International Conference on Engineering of Complex Computer Systems, 2005, pp. 498-506.
[54] M. Woodward, Errors in algebraic specifications and an experimental mutation testing tool, Softw. Eng. J., 8 (1993) 211-224.
[55] D. Coleman, R.M. Gallimore, V. Stavridou, The design of a rewrite rule interpreter from algebraic specifications, Softw. Eng. J., 2 (1987) 95-104.
[56] S.C. Lee, J. Offutt, Generating test cases for XML based web component interactions using mutation analysis, in: 12th IEEE International Symposium on Software Reliability Engineering, 2001, pp. 200-209.
[57] W. Xu, A.J. Offutt, J. Luo, Testing web services by XML perturbation, in: 16th IEEE International Symposium on Software Reliability Engineering, 2005, pp. 257-266.
[58] J.B. Li, J. Miller, Testing the semantics of W3C XML schema, in: 29th Annual International Computer Software and Applications Conference, 2005, pp. 26-28.
[59] C. Henard, M. Papadakis, G. Perrouin, J. Klein, Y. Le Traon, Assessing software product line testing via model-based mutation: an application to similarity testing, in: Sixth IEEE International Conference on Software Testing, Verification and Validation Workshops, 2013, pp. 188-197.
[60] P. Oehlert, Violating assumptions with fuzzing, IEEE Secur. Priv., 3 (2005) 58-62.
[61] Y. Hsu, G. Shu, D. Lee, A model-based approach to security flaw detection of network protocol implementations, in: Proc. IEEE International Conference on Network Protocols, 2008, pp. 114-123.
[62] S. Gorbunov, A. Rosenbloom, Autofuzz: automated network protocol fuzzing framework, Int. J. Comput. Sci. Netw. Secur., 10 (2010).
[63] Z. Zhang, Q. Wen, W. Tang, An efficient mutation-based fuzz testing approach for detecting flaws of network protocol, in: Proc. International Conference on Computer Science & Service System, 2012, pp. 814-817.
[64] D. Yang, Y. Zhang, Q. Liu, BlendFuzz: a model-based framework for fuzz testing programs with grammatical inputs, in: Proc. IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications, 2012, pp. 1070-1076.
[65] P. Ammann, P.E. Black, A specification-based coverage metric to evaluate test sets, Int. J. Reliab. Qual. Saf. Eng., 8 (2001) 275-300.
[66] P.E. Black, V. Okun, Y. Yesha, Mutation of model checker specifications for test generation and evaluation, in: Mutation Testing for the New Century, Kluwer Academic Publishers, Norwell, Massachusetts, 2001, pp. 14-20.
[67] P.E. Black, V. Okun, Y. Yesha, Mutation operators for specifications, in: 15th IEEE International Conference on Automated Software Engineering, 2000, pp. 81-88.
[68] F. Belli, B. Guldali, Software testing via model checking, in: Proc. 19th International Symposium on Computer and Information Sciences, Springer-Verlag, 2004, pp. 907-916.
[69] F. Belli, B. Guldali, A holistic approach to test-driven model checking, in: LNAI, vol. 3533, Springer-Verlag, 2005, pp. 321-331.
[70] A.J. Offutt, P. Ammann, L. Liu, Mutation testing implements grammar-based testing, in: Proc. 2nd Workshop Mutation Analysis, Nov. 2006, pp. 12-21.
[71] F. Belli, M. Beyazit, Exploiting model morphology for event-based testing, IEEE Trans. Softw. Eng., 41 (2015) 113-134.
[72] P. Ammann, A.J. Offutt, Introduction to Software Testing, Cambridge Univ. Press, 2008.
[73] F. Belli, M. Beyazit, T. Takagi, Z. Furukawa, Model-based mutation testing using pushdown automata, IEICE Trans. Inf. Syst., E95-D (2012) 2211-2218.
[74] F. Belli, M. Beyazit, Mutation of directed graphs - corresponding regular expressions and complexity of their generation, Electron. Proc. Theor. Comput. Sci., 3 (2009) 69-77.
[75] F. Belli, M. Beyazit, Using regular grammars for event-based testing, in: LNCS, vol. 7982, Springer-Verlag, 2013, pp. 48-59.