• Thank you Robert.  This gives me a place to start.  So p = 12.5% and std = .0523.  We haven’t run any tests in the other environments yet.  The question is how many need to be run to provide 95% confidence that the problem was related to the first environment.   5 tests?  10?  I’ll try to learn more. 1 year, 9 months ago

  • We have a software test environment that is experiencing an intermittent failure of 5 in 40 trials (1/8).  We suspect this is not a software problem, but something in the environment.  If we move the software to a new environment (or release it), how many tests need to be run to ensure (to, say 95%) that the problem is not in the software?  I’…[Read more]