Assessing Test Adequacy for Black-Box Systems without Specifications - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2011

Assessing Test Adequacy for Black-Box Systems without Specifications

Neil Walkinshaw
  • Function : Author
  • PersonId : 1015963


Testing a black-box system without recourse to a specification is difficult, because there is no basis for estimating how many tests will be required, or to assess how complete a given test set is. Several researchers have noted that there is a duality between these testing problems and the problem of inductive inference (learning a model of a hidden system from a given set of examples). It is impossible to tell how many examples will be required to infer an accurate model, and there is no basis for telling how complete a given set of examples is. These issues have been addressed in the domain of inductive inference by developing statistical techniques, where the accuracy of an inferred model is subject to a tolerable degree of error. This paper explores the application of these techniques to assess test sets of black-box systems. It shows how they can be used to reason in a statistically justified manner about the number of tests required to fully exercise a system without a specification, and how to provide a valid adequacy measure for black-box test sets in an applied context.
Fichier principal
Vignette du fichier
978-3-642-24580-0_15_Chapter.pdf (274.07 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01583922 , version 1 (08-09-2017)





Neil Walkinshaw. Assessing Test Adequacy for Black-Box Systems without Specifications. 23th International Conference on Testing Software and Systems (ICTSS), Nov 2011, Paris, France. pp.209-224, ⟨10.1007/978-3-642-24580-0_15⟩. ⟨hal-01583922⟩
48 View
80 Download



Gmail Facebook X LinkedIn More