Artículos de revistas
Conformance Testing Process For Space Applications Software Services
Registro en:
Journal Of Aerospace Computing, Information And Communication. , v. 3, n. 4, p. 146 - 158, 2006.
15429423
10.2514/1.15529
2-s2.0-33646799430
Autor
Ambrosio A.M.
Martins E.
Vijaykumar N.L.
De Carvalho S.V.
Institución
Resumen
Comprehensive tests for space applications software are costly but extremely necessary. This software must be reliable and produced within schedule and budget. In a tentative of making the space mission software development for space agencies and industries more costeffective, the European Committee for Space Standardization (ECSS) has been compiling a set of standards that specify the common core of some space application systems. Once the set of services is standardized, the conformance problem is raised. In this paper we present a testing process for standardized services, which is based on the IS-9646 standard for ISO protocol conformance testing. The process includes an approach to derive test and fault cases by combining conformance testing concepts with the software-implemented fault injection (SWIFI) technique. One advantage of this process is the generation of a re-usable abstract test suite which improves the testing effectiveness. Reliability and convergence in the test cases are increased the more the tests are applied. Additionally, the evaluation of the software behavior under external faults may be performed under the repeatable set of fault cases. The approach is illustrated with abstract test and fault cases derived for the telecommand verification service stated in the ECSS-E-70-41A standard. These services, successfully adopted in many missions, define the application-level communication between on-board and ground applications. 3 4 146 158 Mazza, C., Standards: The foundations for space IT (2000) Workshop: Space Information Technology in the 21st Century, , www.esoc.esa.de/pr/documents/workshops/it_2000/it_in_future/ESA_C_Mazza. ppt, Sep. 27, Darmstadt, Germany [cited 2 Dec. 2004] http://www.ecss.nl/(2003) Space Engineering - Ground Systems and Operations: Telemetry and Telecommand Packet Utilization, , ECSS-E-70-41 A, Jan Merri, M., Melton, B., Valera, S., Parkes, A., The ECSS packet utilization standard and its support tool (2002) Proceedings of AIAA International Conference on Space Operations, , www.spaceops2002.org/papers/SpaceOps02-P-T5-06.pdf, [cited 13 Dec. 2002] Merri, M., Rüting, J., Schurman, P., Validation of the ESA packet utilization standard by object-oriented analysis (1996) Proceedings of International Conference on Space Operations CCSDS-201.0-B-3 to CCSDS-203.0-B-2-Telecommand System, , htpp://www.ccsds.org, [cited 13 Dec. 2004] (1983) Basic Reference Model for Open System Interconnection, , ISO/TC 97/WG1 IS 7498 (1991) Conformance Testing Methodology and Framework, , ISO/IEC 9646 International Standard IS-9646. ISO, Geneva, Also in: ITU-T Recommendations X.290 to X.296 Baumgarten, B., Giessler, A., (1994) OSI Conformance Testing Methodology and TTCN, , Elsevier, Amsterdam (2002) Space Link Extension Services -CCSDS 910.0-Y-1 Yellow Book, , April Mertens, M., Advanced protocol testing methods and tools (2002) Proceedings of AIAA International Conference on Space Operations Voas, J.M., McGraw, G., (1998) Software Fault 1njection: Inoculating Programs Against Errors, , John Wiley & Sons, Inc., New York Arlat, J., Aguera, M., Amat, L., Crouzrt, Y., Fabre, J.C., Lapri, J.C., Martins, E., Powell, D., Fault injection for dependability validation: A methodology and some applications (1990) IEEE Transactions on Software Engineering, 16 (2), pp. 166-182 Madeira, H., Some, R.R., Moreira, F., Costa, D., Rennels, D., Experimental evaluation of a COTS system for space applications (2002) Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN), , http://computer.org/proceedings/dsn/1597/15970325abs.htm, 23-26 June Washington, D.C., USA [cited 02 Feb. 2004] Pressman, R.S., (1982) Software Engineering: A Practioner's Approach, 4th Ed., , McGraw-Hill Companies, Inc., New York Ambrosio, A.M., Martins, E., Vijaykumar, N.L., Carvalho, S.V., Systematic generation of test and fault cases for space application validation (2005) Proceedings of the 9th ESA Data System in Aerospace (DASIA), , 30 Mai-2 Jun. Edinburgh, Scotland Noordwijk: ESA Publications, 2005. Papers on Disc [CD-ROM] Ambrosio, A.M., Martins, E., Vijaykumar, N.L., Carvalho, S.V., A methodology for designing fault injection experiments as an addition to communication systems conformance testing (2005) Proceedings of the First Workshop on Dependable Software -Tools and Methods in the IEEE Conference on Dependable System and Network, , 28 June-1 July Yokohama, Japan Cavali, A.R., Favreau, J.P., Phalippou, M., Standardization of formal methods in conformance testing of communication protocols (1996) Computer Networks and ISDN Systems, (29), pp. 3-14 Martins, E., Ambrosio, A.M., Mattiello-Francisco, M.F., ATIFS: A testing toolset with software fault injection (2003) Proceedings of the Workshop of Software Test (SofTest), , University of York: 4-5 Sep Zeng, H.X., Rayner, D., The impact of the Ferry concept on protocol testing (1985) Proceedings of the 5th International Conference on Protocol Specification, Testing and Verification, pp. 519-531. , 10-13 June Toulouse-Moissac, France. North-Holland: IFIP WG6.1.1985 Chanson, S.T., Lee, B.P., Parakh, N.J., Zeng, H.X., Design and implementation of a ferry clip test system (1989) Proceedings of the 9th IFIP Symposium on Protocol Specification Testing & Verification, pp. 101-118. , Enscchede, The Netherlands Martins, E., Mattiello-Francisco, M.F., A tool for fault injection and conformance testing of distributed systems (2003) Proceedings of the 1st. Latin-American Dependable Computing Symposium, pp. 282-302. , Lecture Notes in Computer Science, Springer Verlag, Sep Ambrosio, A.M., Martins, E., Mattiello-Francisco, M.F., Silva, C.S., Vijaykumar, N.L., On the use of test standardization in communication space applications (2004) Proceeding of AIAA International Conference on Space Operations (2001) Space Engineering - Procedure Language for User in Test and Operations (PLUTO), , ECSS-E_70-32, Issue Draft 5 Larson, W., Vertens, J., (1992) Space Mission Analysis and Design, 2nd Ed., , Kluwer Academic Publisher, Dordrecht Binder, R., (2000) Testing Object-oriented Systems: Models, Patterns and Tools, , Addison-Wesley, Boston Ryser, J., Glinz, M., SCENT: A method employing scenarios to systematically derive test cases for system test (2000) Technical Report, 2000 (3). , Zürich: Institut für Informatik, Universität Zürich Rumbaugh, J., Blaha, M., Premerlani, W., Eddy, F., Lorensen, W., (1991) Object-oriented Modeling and Design, , Prentice Hall International, New York Ural, H., Formal methods for test sequence generation (1992) Computer Communication, 15 (5), pp. 311-325 Lee, D., Yannakakis, M., Principles and methods of testing finite state machines: A survey (1996) Proceedings of IEEE, 84 (8), pp. 1090-1123 Grabowski, J., (1994) SDL and MSC Based Test Case Generation-an Overall View of the SAMSTAG Method, , University of Berne, IAM-94-0005 Koné, O., An interoperability testing approach to wireless application protocols (2003) Journal of Universal Computer Science, 9 (10), pp. 1220-1243