Publication:
Testing from a stochastic timed system with a fault model.

Loading...
Thumbnail Image
Full text at PDC
Publication Date
2009-01
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Elsevier
Citations
Google Scholar
Research Projects
Organizational Units
Journal Issue
Abstract
In this paper we present a method for testing a system against a non-deterministic stochastic finite state machine. As usual, we assume that the functional behaviour of the system under test (SUT) is deterministic but we allow the timing to be non-deterministic. We extend the state counting method of deriving tests, adapting it to the presence of temporal requirements represented by means of random variables. The notion of conformance is introduced using an implementation relation considering temporal aspects and the limitations imposed by a black-box framework. We propose a new group of implementation relations and an algorithm for generating a test suite that determines the conformance of a deterministic SUT with respect to a non-deterministic specification. We show how previous work on testing from stochastic systems can be encoded into the framework presented in this paper as an instantiation of our parameterized implementation relation. In this setting, we use a notion of conformance up to a given confidence level.
Description
Keywords
Citation
M. Bernardo, R. Gorrieri, A tutorial on EMPA: a theory of concurrent processes with nondeterminism, priorities, probabilities and time, Theoret. Comput. Sci. 202 (1–2) (1998) 1–54. M. Bravetti, R. Gorrieri, The theory of interactive generalized semi-Markov processes, Theoret. Comput. Sci., 282 (1) (2002) 5–32. E. Brinksma, J. Tretmans, Testing transition systems: an annotated bibliography, 4th Summer School on Modeling and Verification of Parallel Processes, MOVEP 2000, LNCS 2067, Springer, 2001, pp. 187–195. L. Brandan Briones, E. Brinksma, Testing real-time multi input-output systems, 7th International Conference on Formal Engineering Methods, ICFEM'95, LNCS 3785, Springer, 2005, pp. 264–279. D. Cazorla, F. Cuartero, V. Valero, F.L. Pelayo, J.J. Pardo, Algebraic theory of probabilistic and non-deterministic processes, J. Log. Algebr. Program. 55 (1–2) (2003) 57–103. L. Cheung, M. Stoelinga, F. Vaandrager, A testing scenario for probabilistic processes, J. ACM 54 (6) (2007) 29. T.S. Chow, Testing software design modelled by finite state machines, IEEE Trans. Software Eng. 4 (1978) 178–187. D. Clarke, I. Lee, Automatic generation of tests for timing constraints from requirements, 3rd Workshop on Object-Oriented Real-Time Dependable Systems, WORDS'97, IEEE Computer Society Press, 1997, pp. 199–206. R. Cleaveland, Z. Dayar, S.A. Smolka, S. Yuen, Testing preorders for probabilistic processes, Inform. and Comput. 54 (2) (1999) 93–148. A. En-Nouaary, R. Dssouli, F. Khendek, Timed Wp-method: testing real time systems, IEEE Trans. Software Eng. 28 (11) (2002) 1024–1039. M.A. Fecko, M.Ü. Uyar, A.Y. Duale, P.D. Amer, A technique to generate feasible tests for communications systems with multiple timers, IEEE/ACM Trans. Networking 11 (5) (2003) 796–809. A. Gill, Introduction to The Theory of Finite State Machines, McGraw-Hill, 1962. R. van Glabbeek, S.A. Smolka, B. Steffen, Reactive, generative and stratified models of probabilistic processes, Inform, and Comput. 121 (1) (1995) 59–80. M. Hennessy, T. Regan, A process algebra for timed systems, Inform. and Comput. 117 (2) (1995) 221–239. F.C. Hennie, Fault-detecting experiments for sequential circuits, in: 5th Annual Symposium on Switching Circuit Theory and Logical Design, 1964, pp. 95–110. H. Hermanns, Interactive Markov chains, Ph.D. Thesis, Universität Erlangen-Nürnberg, 1998. Also appeared as LNCS 2428, Springer, 2002. R.M. Hierons, Testing from a non-deterministic finite state machine using adaptive state counting, IEEE Trans. Comput. 53 (10) (2004) 1330–1342. R.M. Hierons, H. Ural, Reduced length checking sequences, IEEE Trans. Comput. 51 (9) (2002) 1111–1117. J. Hillston, A Compositional Approach to Performance Modelling, Cambridge University Press. 1996. ITU-T. Recommendation Z.500 Framework on Formal Methods in Conformance Testing. International Telecommunications Union, Geneva, Switzerland, 1997. K.G. Larsen, M. Mikucionis, B. Nielsen, Online testing of real-time systems using Uppaal, 4th International Workshop on Formal Approaches to Testing of Software, FATES'04, LNCS 3395, Springer, 2004, pp. 79–94. D. Lee, M. Yannakakis, Principles and methods of testing finite state machines: a survey, Proc. IEEE 84 (8) (1996) 1090–1123. N. López, M. Núñez, A testing theory for generally distributed stochastic processes, 12th International Conference on Concurrency Theory, CONCUR'01. LNCS 2154, Springer, 2001. pp. 321–335. N. López, M. Nú~nez, I. Rodríguez, Specification, testing and implementation relations for symbolic-probabilistic systems, Theoret. Comput. Sci. 353 (1–3) (2006) 228–248. G.L. Luo, G. von Bochmann, A. Petrenko, Test selection based on communicating nondeterministic finite-state machines using a generalized Wp-method, IEEE Trans. Software Eng. 20 (2) (1994) 149–161. D. Mandrioli, S. Morasca, A. Morzenti, Generating test cases for real time systems from logic specifications, ACM Trans. Comput. Syst. 13 (4) (1995) 356–398. M.G. Merayo, M. Núñez, I. Rodríguez, Implementation relations for stochastic finite state machines, 3rd European Performance Engineering Workshop, EPEW'06, LNCS 3964, Springer, 2006, pp. 123–137. M.G. Merayo, M. Núñez, I. Rodríguez, Testing finite state machines presenting stochastic time and timeouts, in: 4th European Performance Engineering Workshop, EPEW'07, LNCS 4748, Springer, 2007, pp. 97–111. M.G. Merayo, M. Núñez, I. Rodríguez, Extending EFSMs to specify and test timed systems with action durations and timeouts, IEEE Trans. Comp. 57 (6) (2008a) 835–848. M.G. Merayo, M. Nú~nez, I. Rodríguez, Formal testing from timed finite state machines, Comput. Networks 52 (2) (2008b) 432–460. X. Nicollin, J. Sifakis, An overview and synthesis on timed process algebras, 3rd International Conference on Computer Aided Verification, CAV'91, LNCS 575, Springer, 1991, pp. 376–398. M. Núñez, Algebraic theory of probabilistic processes, J. Log. Algebr. Program. 56 (1–2) (2003) 117–177. M. Núñez, I. Rodríguez, Towards testing stochastic timed systems, 23rd IFIP WG 6.1 International Conference on Formal Methods for Networked and Distributed Systems, FORTE'03, LNCS 2767, Springer, 2003, pp. 335–350. A. Petrenko, Fault model-driven test derivation from finite state models: Annotated bibliography, 4th Summer School on Modeling and Verification of Parallel Processes. MOVEP 2000, LNCS 2067, Springer, 2001, pp. 196–205. A. Petrenko, N. Yevtushenko, Testing from partial deterministic FSM specifications, IEEE Trans. Comput. 54 (9) (2005) 1154–1165. A. Petrenko, N. Yevtushenko, G. von Bochmann, Testing deterministic implementations from their nondeterministic fsm specifications, 9th IFIP Workshop on Testing of Communicating Systems, IWTCS'96, Chapman & Hall, 1996, pp. 125–140. A. Petrenko, N. Yevtushenko, A.V. Lebedev, A. Das, Nondeterministic state machines in protocol conformance testing, 6th IFIP Workshop on Protocol Test Systems, IWPTS'93, North Holland, 1993, pp. 363–378. G.M. Reed, A.W. Roscoe, A timed model for communicating sequential processes, Theoret. Comput. Sci. 58 (1988) 249–261. I. Rodríguez, M.G. Merayo, M. Nú~nez, HOTL: Hypotheses and observations testing logic, J. Log. Algebr. Program 74 (2) (2008) 57–93. D.P. Sidhu, T.-K. Leung, Formal methods for protocol testing: a detailed study, IEEE Trans. Software Eng. 15 (4) (1989) 413–426. J. Springintveld, F. Vaandrager, P.R. D'Argenio, Testing timed automata, Theoret. Comput. Sci. 254 (1–2) (2001) 225–257., Previously appeared as Technical Report CTIT-97-17, University of Twente, 1997. M.Ü. Uyar, M.A. Fecko, A.S. Sethi, P.D. Amar, Testing protocols modeled as FSMs with timing parameters, Comput. Networks 31 (18)(1999) 1967–1998. N. Yevtushenko, A.V. Lebedev, A. Petrenko, On checking experiments with nondeterministic automata, Automat. Control Comput. Sci. 6 (1991) 81–85.
Collections