[netperf-dev] short circuit for confidence intervals?
Rick Jones
rick.jones2 at hp.com
Tue Aug 7 13:52:54 PDT 2007
Folks -
While running some scripts I've noticed that on some tests, TCP_RR
especially, I often notice that the confidence intervals for the trio of
result, local CPU and remote CPU aren't hit, overall but the confidence
interval for the result is often spot-on within < 5 iterations.
I'm wondering if it would be worthwhile to provide some sort of "I only
_really_ care about confidence on the result" switch whereby netperf
(netperf2) still calculates confidence for all three, but will quit when
confidence for the result is hit regardless of confidence on CPU utils.
I'm thinking of a new global switch which would be examined by the
confidence code in netlib.c and calculate "confidence" based on
results_confid only. There would remain the issue of the test banners
asserting +/- N% which would have to be ammended when this switch was
enabled, and then the prospect of some additional -v 2 output to give
the intervals for the CPU utils.
Or should I just leave things as they are and cope with the longer
script runtimes when it runs all the way out to 30 iterations ?-)
rick jones
More information about the netperf-dev
mailing list