Actas de congresos
Twenty-five Years Of Research In Structural And Mutation Testing
Registro en:
9780769546032
Proceedings - 25th Brazilian Symposium On Software Engineering, Sbes 2011. , v. , n. , p. 40 - 49, 2011.
10.1109/SBES.2011.16
2-s2.0-82255166813
Autor
Delamaro M.E.
Chaim M.L.
Vincenzi A.M.R.
Jino M.
Maldonado J.C.
Institución
Resumen
Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) Research in software testing has been carried out for approximately forty years, but its importance has escalated very quickly in the last ten or fifteen years. In particular, structural and mutation testing are techniques which havereceived a large amount of investment in both academia and software development industry. In this paper, we draw a historical perspective on how they appeared and how they evolved. In particular, the main contributions on structural and mutation testing from two Brazilian researching groups - ICMC-USP and FEEC-UNICAMP - are described. We highlight the workproduced and published in these twenty-five years in the Brazilian Symposium on Software Engineering and elsewhere, as well its impact in the community of software testing. © 2011 IEEE.
40 49 FAPESP,CNPq,Google,Mack Pesquisa,CAPES,PRCEU-USP Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) Harrold, M.J., Testing: A roadmap (2000) ICSE - Future of SE Track, pp. 61-72 Beizer, B., (1984) Software System Testing and Quality Assurance, , NewYork: Van Nostrand Reinhold Company Pezz, M., Young, M., (2007) Software Testing and Analysis: Process, Principles and Techniques, , John Wiley and Sons Spillner, A., Linz, T., Schaefer, H., (2007) Software Testing Foundation, , Rockynook Maldonado, J.C., Chaim, M.L., Jino, M., Seleo de casos de testes baseada na anlise de fluxo de dados atravs dos critrios potenciais usos II SBES - Simpsio Brasileiro de Engenharia de Software (SBES 88), Canela, RS, Oct. 1988, pp. 24-35 Martins, E., Integrando injecao de falhas e testes formais na validacao da tolerancia a falhas IX Simposio Brasileiro de Engenharia de Software (SBES 95), Recife, PE, 1995, pp. 223-239 Rombaldi, A.M.A.P.J.B.S., Proteste: Um ambiente de apoio ao teste de programas VI Simpsio Brasileiro de Engenharia de Software (SBES 92), Canela, RS, Oct. 1992 McCabe, T.J., A software complexity measure (1976) IEEE Transactions on Software Engineering, 2 (6), pp. 308-320. , Dec Myers, G.J., (1979) The Art of Software Testing, , Wiley, New York Beizer, B., (1990) Software Testing Techniques, , 2nd ed. New York: Van Nostrand Reinhold Company Howden, W.E., Methodology for the generation of program test data (1975) IEEE Computer, C-24 (5), pp. 554-559. , May Howden, W.E., (1987) Functional Program Testing and Analysis, , New York: McGrall-Hill Hecht, M.S., (1977) Flow Analysis of Computer Programs, , NewYork:North Holland Herman, P.M., A data flow analysis approach to program testing (1976) Australian Computer Journal, 8 (3). , Nov Rapps, S., Weyuker, E.J., SELECTING SOFTWARE TEST DATA USING DATA FLOW INFORMATION (1985) IEEE Transactions on Software Engineering, SE-11 (4), pp. 367-375 Ntafos, S.C., On required element testing (1984) IEEE Transactions on Software Engineering, SE-10, pp. 795-803. , Nov Laski, J.W., Korel, B., A data flow oriented program testing strategy (1983) IEEE Transactions on Software Engineering, 9 (3). , May Ural, H., Yang, B., A structural test selection criterion (1988) Information Processing Letters, 28, pp. 157-163 Haley, A., Zweben, S., Development and application of a white box approach to integration testing (1984) The Journal of Systems and Software, 4, pp. 309-315 Linnenkugel, U., Müllerburg, M., Test data selection criteria for (software) integration testing First International Conference on Systems Integration, Morristown, NJ, Apr. 1990, pp. 709-717 Harrold, M.J., Soffa, M.L., Selecting and using data for integration test (1991) IEEE Software, 8 (2), pp. 58-65. , Mar Jin, Z., Offut, A.J., Integration testing based on software couplings X Annual Conference on Computer Assurance (COMPASS 95), Gaithersburg, Maryland, Jan. 1995, pp. 13-23 Frankl, P.G., Weyuker, E.J., An applicable family of data flow testing criteria (1988) IEEE Transactions on Software Engineering, 14 (10), pp. 1483-1498. , Oct Maldonado, J.C., Chaim, M.L., Jino, M., Potential uses testing criteria: A step towards bridging the gap in the presence of infeasible paths Proceedings of the XII International Conference of the Chilean Computer Society, 1992 Maldonado, J.C., Chaim, M.L., Jino, M., Using the essential branch concept to support data-flow criteria application Proceedings of the V International Conference on Software Engineering and Its Applications, 1992 Weyuker, E.J., The complexity of data flow for test data selection (1984) Information Processing Letters, 19 (2), pp. 103-109. , Aug Maldonado, J.C., Verglio, S.R., Chaim, M.L., Jino, M., Critrios potenciais usos: Anlise da aplicao de um benchmark VI SBES -Simpsio Brasileiro de Engenharia de Software (SBES 92), Gramado, RS, Nov. 1992, pp. 357-374 Vilela, P.R.S., (1998) Critrios Potenciais Usos de Integrao: Definio e Anlise, , Ph.D. dissertation, DCA/FEEC/UNICAMP, Campinas, SP, Apr Vergilio, S.R., Maldonado, J.C., Jino, M., Soares, I.W., Constraint based structural testing criteria (2006) Journal of Systems and Software, 79 (6), pp. 756-771 Wong, W., Sugeta, T., Li, J.J., Maldonado, J.C., Coverage testing software architectural design in SDL (2003) Journal of Computer Networks, 42 (3), pp. 359-374. , Jun Eler, M.M., Delamaro, M.E., Masiero, P.C., Maldonado, J.C., Builtin structural testing of web services (2010) Proceedings of the Brazilian Symposium on Software Engineering, CBSOFT 2010, pp. 1-10 Vincenzi, A.M.R., Maldonado, J.C., Wong, W.E., Delamaro, M.E., Coverage testing of Java programs and components (2005) Journal of Science of Computer Programming Vincenzi, A.M.R., Delamaro, M.E., Maldonado, J.C., Wong, W.E., Establishing structural testing criteria for java bytecode (2006) Softw., Pract. Exper., 36 (14), pp. 1513-1541 Lemos, O.A.L., Franchin, I.G., Masiero, P.C., Integration testing of object-oriented and aspect-oriented programs: A structural pairwise approach for java (2009) Sci. Comput. Program., 74 (10), pp. 861-878 Lemos, O.A.L., Vincenzi, A.M.R., Maldonado, J.C., Masiero, P.C., Control and data flow structural testing criteria for aspect-oriented programs (2007) Journal of Systems and Software, 80 (6), pp. 862-882 Chaim, M.L., (1991) POKE-TOOL: A Tool to Support Data Flow Based Structural Test of Programs, , Master's thesis, DCA/FEEC/UNICAMP, Campinas, SP, Apr. (In Portuguese) Bueno, P.M.S., Jino, M., Automatic test data generation for program paths using genetic algorithms (2002) International Journal of Software Engineering and Knowledge Engineering, 12 (6), pp. 691-710 Bueno, P.M., Jino, M., Wong, W.E., Diversity oriented test data generation using metaheuristic search techniques (2011) Information Sciences, , http://caocao.myipcn.org/science/article/pii/S0020025511000442, vol. In Press, Corrected Proof, pp. -, [Online]. Available Chaim, M.L., Maldonado, J.C., Jino, M., A debugging strategy based on the requirements of testing (2004) Journal of Software Maintenance, 16 (4-5), pp. 277-308 Crespo, A.N., Jino, M., Pasquini, A., Maldonado, J.C., A binomial software reliability model based on coverage of structural testing criteria (2008) Empirical Software Engineering, 13 (2), pp. 185-209. , DOI 10.1007/s10664-007-9055-3 Pasquini, A., Crespo, A.N., Matrella, P., Sensitivity of reliability-growth models to operational profile errors vs testing accuracy (1996) IEEE Transactions on Reliability, 45 (4), pp. 531-540. , PII S0018952996095462 Vincenzi, A.M.R., Wong, W.E., Delamaro, M.E., Maldonado, J.C., JaBUTi: A coverage analysis tool for Java programs XVII Brazilian Symposium on Software Engineering, Manaus, AM, Brasil, Oct. 2003, pp. 79-84 Delamaro, M.E., Vincenzi, A.M.R., Maldonado, J.C., A strategy to perform coverage testing of mobile applications (2006) Proceedings of the 2006 International Workshop on Automation of Software Test, AST 2006, pp. 118-124 Delamaro, M.E., Vincenzi, A.M.R., Structural Testing of Mobile Agents (2003) Lecture Notes on Computer Science, 2952, pp. 73-85. , International Workshop on Scientific Engineering of Java Distributed Applications (FIDJI 2003), ser. E. A. Nicolas Guelfi and G. Reggio, Eds. Springer, Nov Li, J.J., Weiss, D.M., Yee, H., An automatically-generated run-time instrumenter to reduce coverage testing overhead (2008) Proceedings of the 3rd International Workshop on Automation of Software Test, AST 2008, pp. 49-56 Soffa, M.L., Walcott, K.R., Mars, J., Exploiting hardware advances for software testing and debugging: Nier track (2011) Proceedings of the 33rd International Conference on Software Engineering, ICSE 2011, pp. 888-891 Hutchins, M., Foster, H., Goradia, T., Ostrand, T.J., Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria (1994) ICSE, pp. 191-200 Santelices, R.A., Jones, J.A., Yu, Y., Harrold, M.J., Lightweight fault-localization using multiple coverage types (2009) 31st International Conference on Software Engineering, ICSE 2009, pp. 56-66 Misurda, J., Clause, J.A., Reed, J.L., Childers, B.R., Soffa, M.L., Demand-driven structural testing with dynamic instrumentation (2005) 27th International Conference on Software Engineering (ICSE 2005), pp. 156-165 Santelices, R.A., Harrold, M.J., Efficiently monitoring data-flow test coverage (2007) 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), pp. 343-352 DeMillo, R.A., Lipton, R.J., Sayward, F.G., Hints on test data selection: Help for the practicing programmer (1978) Computer, 11 (4), pp. 34-41. , April DeMillo, R., Guindi, D., McCracken, W., Offutt, A., King, K., An extended overview of the mothra software testing environment (1988) Software Testing, Verification, and Analysis, 1988., Proceedings of the Second Workshop on, pp. 142-151. , jul Agrawal, H., DeMillo, R.A., Hathaway, R., Hsu, W., Hsu, W., Krauser, E.W., Martin, R.J., Spafford, E.H., (1989) Design of Mutant Operators for the C Programming Language, , Software Engineering Research Center, Purdue University, West Lafayette, IN, Tech. Rep. SERC-TR41-P, Mar Choi, B., Mathur, A., Pattison, B., Pmothra: Scheduling mutants for execution on a hypercube (1989) SIGSOFT Softw. Eng. Notes, 14, pp. 58-65. , http://doi.acm.org/10.1145/75309.75316, November [Online]. Available Offutt, A.J., Pargas, R.P., Fichter, S.V., Khambekar, P.K., Mutation testing of software using a mimd computer (1992) 1992 International Conference on Parallel Processing, pp. 257-266 Offutt, A.J., Rothermel, G., Zapf, C., An experimental evaluation of selective mutation (1993) ICSE '93, pp. 100-107. , http://portal.acm.org/citation.cfm?id=257572.257597, Proceedings of the 15th international conference on Software Engineering, ser. Los Alamitos, CA, USA: IEEE Computer Society Press, [Online]. Available Offutt, A., Pan, J., Detecting equivalent mutants and the feasible path problem (1996) Computer Assurance, 1996. COMPASS '96, 'Systems Integrity. Software Safety. Process Security'. Proceedings of the Eleventh Annual Conference on, pp. 224-236. , jun Offutt, A.J., Craft, W.M., Using compiler optimization techniques to detect equivalent mutants (1994) Software Testing, Verification and Reliability, 4 (3), pp. 131-154. , http://dx.doi.org/10.1002/stvr.4370040303, [Online]. Available Jia, Y., Harman, M., An analysis and survey of the development of mutation testing (2010) IEEE Transactions on Software Engineering, 99. , no. PrePrints Delamaro, M.E., (1993) Proteum: Um Ambiente de Teste Baseado Na Análise de Mutantes (Proteum: A Testing Environment Based on Mutation Testing), , Master Thesis, SCE-ICMSC-USP, São Carlos - SP, Oct Delamaro, M.E., Maldonado, J.C., Jino, M., Chaim, M.L., Proteum: A Testing Tool Based on Mutation Analysis Software Tools Seesion - VII Brazilian Symposium on Software Engineering, Rio de Janeiro - RJ, Oct. 1993, pp. 31-33 Vincenzi, A.M.R., (1998) Subsídios para O Estabelecimento de Estratégias de Teste Baseadas Na Técnica de Mutaço Aid for Establishing Mutation Based Testing Strategies, , Master's thesis, ICMC-USP, So Carlos - SP, Nov Vincenzi, A.M.R., Maldonado, J.C., Barbosa, E.F., Delamaro, M.E., Unit and integration testing strategies for C programs using mutation-based criteria (2001) Software Testing, Verification and Reliability, 11 (4), pp. 249-268. , Dec Barbosa, E.F., (1998) A Contribution for the Determination of A Sufficient Mutant Operators Set for C-program Testing, , Master's thesis, ICMCUSP, São Carlos, SP, Nov. (in Portuguese) Fabbri, S.C.P.F., Maldonado, J.C., Masiero, P.C., Delamaro, M.E., Mutation analysis testing for finite state machines (1994) 5th International Symposium on Software Reliability Engineering (ISSRE'94), pp. 220-229. , Monterey - CA: IEEE Computer Society Press, Nov Fabbri, S.C.P.F., Delamaro, M.E., Maldonado, J.C., Masieiro, P.C., Aplicaçã o da análise de mutantes na validac̃ã o de especificações baseadas em redes de petri (mutation analysis based on petri net models) VIII Brazilian Symposium on Software Engineering, Curitiba -PR, Brazil, Oct. 1994, pp. 423-437 Fabbri, S.C.P.F., Maldonado, J.C., Sugeta, T., Masiero, P.C., Mutation testing applied to validate specifications based on statecharts ISSRE - International Symposium on Software Reliability Systems, Nov. 1999, pp. 210-219 Simo, A.S., Maldonado, J.C., Fabbri, S.C.P.F., Proteum-RS/PN: A tool to support edition, simulation and validation of Petri nets based on mutation testing XIV Brazilian Symposium on Software Engineering, João Pessoa - PB - Brazil, Oct. 2000 Delamaro, M.E., Maldonado, J.C., Mathur, A.P., Interface Mutation: An Approach for Integration Testing (2001) IEEE Transactions on Software Engineering, 27 (3), pp. 228-247. , Mar Araujo, R.F., Maldonado, J.C., Delamaro, M.E., Devising Mutant Operators for Dynamic Systems Models by Applying the Hazop Study, , submited Araujo, R.F., Maldonado, J.C., Delamaro, M.E., Tetoods Extension for Mutation Testing, , submited