|
BEACON eSpace at Jet Propulsion Laboratory >
JPL Technical Report Server >
JPL TRS 1992+ >
Please use this identifier to cite or link to this item:
http://hdl.handle.net/2014/41720
|
| Title: | Random test run length and effectiveness |
| Authors: | Andrews, James H.
Groce, Alex
Weston, Melissa
Xu, Ru-Gang |
| Keywords: | random testing
software testing |
| Issue Date: | 20-Jun-2008 |
| Publisher: | Pasadena, CA : Jet Propulsion Laboratory, National Aeronautics and Space Administration, 2008. |
| Citation: | International Symposium on Software Testing and Analysis, Seattle, Washington, June 20, 2008. |
| Abstract: | A poorly understood but important factor in many applications of random testing is the selection of a maximum length for test runs. Given a limited time for testing, it is seldom clear whether executing a small number of long runs or a large number of short runs maximizes utility. It is generally expected that longer runs are more likely to expose failures — which is certainly true with respect to runs shorter than the shortest failing trace. However, longer runs produce longer failing traces, requiring more effort from humans in debugging or more resources for automated minimization. In testing with feedback, increasing ranges for parameters may also cause the probability of failure to decrease in longer runs. We show that the choice of test length dramatically impacts the effectiveness of random testing, and that the patterns observed in simple models and predicted by analysis are useful in understanding effects observed. |
| URI: | http://hdl.handle.net/2014/41720 |
| Appears in Collections: | JPL TRS 1992+
|
Items in DSpace are protected by copyright, but are furnished with U.S. government purpose use rights.
|
