[netperf-talk] global question concerning Netperf test and SMP support

Simon Duboue Simon.Duboue at ces.ch
Mon Apr 23 09:09:23 PDT 2012


>That is much better.  Still, I've taken to using:
>
>
http://www.netperf.org/svn/netperf2/trunk/doc/netperf.html#Using-_002d_002denable_002ddemo

>
>and scripting along the lines of:
>
>
http://www.netperf.org/svn/netperf2/trunk/doc/examples/runemomniaggdemo.sh
>
>with post-processing via rrdtool for aggregate measurements.

I will concentrate on this after.

>> For the -s -S and -m -M options, what scenario could be a good start in
>> order to test their influence?
>
>Pretty much up to you.  There are some ancient scripts under 
>http://www.netperf.org/svn/netperf2/trunk/doc/examples/ like the 
>tcp_stream_script you could use as a starting point - that script is 
>focused on single-instance testing.

I use this script, modified to fit my test bench and my multi instance 
testing.
Here are the results and some interpretation based on what you already 
explained to me.

CIO-SUSE:/ces/Simon/Rick # ./tcp_stream_script.sh 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 128K -S 128K
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 128K -S 128K
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! WARNING
!!! Desired confidence was not achieved within the specified iterations.
!!! This implies that there was variability in the test environment that
!!! must be investigated before going further.
!!! Confidence intervals: Throughput      :  6.5%
!!!                       Local CPU util  :  9.9%
!!!                       Remote CPU util : -713.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

262142 262142   4096    60.02      1149.25   4.77     -138.54   0.681 
-76.721 
!!! WARNING
!!! Desired confidence was not achieved within the specified iterations.
!!! This implies that there was variability in the test environment that
!!! must be investigated before going further.
!!! Confidence intervals: Throughput      :  4.3%
!!!                       Local CPU util  :  9.0%
!!!                       Remote CPU util : -713.4%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

262142 262142   4096    60.08      1140.63   4.77     -138.42   0.685 
-81.299

Here we can consider that the tests are running in parallel because both 
send and remote CPU utilization are quite the same.
The throughput is considered as the sum of the two throughputs obtained. I 
will try the same test with much more instance.
I still can not explain the negative CPU utilzation in remote. What 
considerations could we do with the confidence interval? Is it acceptable? 
Could we ignore it?
Next, the changes are just concerning the socket size and the message 
size.
We clearly observe the differences between the different configuration. 
The best throughput is obtained for 56k socket size. These performance and 
optimal configuration are dependent of the equipment.

Why does we configure 56k and netperf print 56k x 2 as socket size. Is it 
what you called linuxism here? 
http://www.netperf.org/pipermail/netperf-talk/2006-October/000176.html

------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 128K -S 128K
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 128K -S 128K
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  5.9%
!!!                       Local CPU util  : 13.2%
!!!                       Remote CPU util : 36.4%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

262142 262142   8192    60.05      1154.15   4.22     9.16     0.599 5.206 
 
!!! Confidence intervals: Throughput      :  7.0%
!!!                       Local CPU util  : 12.2%
!!!                       Remote CPU util : 36.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

262142 262142   8192    60.08      1186.34   4.22     9.10     0.583 5.023 
 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 128K -S 128K
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 128K -S 128K
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      : 10.7%
!!!                       Local CPU util  : 31.0%
!!!                       Remote CPU util : 30.9%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

262142 262142  32768    60.05      1172.18   4.05     9.52     0.565 5.319 
 
!!! Confidence intervals: Throughput      :  8.8%
!!!                       Local CPU util  : 31.1%
!!!                       Remote CPU util : 30.8%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

262142 262142  32768    60.06      1170.69   4.03     9.54     0.564 5.347 
 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 57344 -S 57344
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 57344 -S 57344
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  0.9%
!!!                       Local CPU util  :  9.0%
!!!                       Remote CPU util : 379.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

114688 114688   4096    60.00      1711.03   8.90     28.41    0.852 
10.872 
!!! Confidence intervals: Throughput      :  1.1%
!!!                       Local CPU util  :  9.0%
!!!                       Remote CPU util : 379.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

114688 114688   4096    60.00      1714.80   8.90     28.41    0.850 
10.841 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 57344 -S 57344
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 57344 -S 57344
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  1.0%
!!!                       Local CPU util  :  5.8%
!!!                       Remote CPU util : 176.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

114688 114688   8192    60.00      1711.16   8.37     45.42    0.801 
17.397 
!!! Confidence intervals: Throughput      :  0.9%
!!!                       Local CPU util  :  5.8%
!!!                       Remote CPU util : 176.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

114688 114688   8192    60.00      1710.34   8.37     45.42    0.801 
17.388 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 57344 -S 57344
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 57344 -S 57344
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  1.2%
!!!                       Local CPU util  : 11.3%
!!!                       Remote CPU util : 328.7%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

114688 114688  32768    60.00      1717.21   7.74     37.64    0.738 
14.361 
!!! Confidence intervals: Throughput      :  0.9%
!!!                       Local CPU util  : 11.3%
!!!                       Remote CPU util : 328.7%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

114688 114688  32768    60.00      1713.09   7.74     37.64    0.740 
14.422 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 32768 -S 32768
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 32768 -S 32768
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  0.3%
!!!                       Local CPU util  : 43.8%
!!!                       Remote CPU util : 3397.1%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 65536  65536   4096    60.00      1148.96   4.98     6.76     0.710 3.844 
 
!!! Confidence intervals: Throughput      :  0.3%
!!!                       Local CPU util  : 43.8%
!!!                       Remote CPU util : 3397.1%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 65536  65536   4096    60.00      1149.32   4.98     6.76     0.710 3.838 
 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 32768 -S 32768
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 32768 -S 32768
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  2.0%
!!!                       Local CPU util  : 34.5%
!!!                       Remote CPU util : 25909.6%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 65536  65536   8192    60.00       754.82   2.51     0.82     0.545 0.352 
 
!!! Confidence intervals: Throughput      : 29.0%
!!!                       Local CPU util  : 34.2%
!!!                       Remote CPU util : 25907.9%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 65536  65536   8192    60.00       789.35   2.51     0.82     0.526 
-0.424 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 32768 -S 32768
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 32768 -S 32768
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  0.1%
!!!                       Local CPU util  : 37.7%
!!!                       Remote CPU util : 734.0%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 65536  65536  32768    60.00      1149.70   2.74     20.57    0.390 
11.715 
!!! Confidence intervals: Throughput      :  0.2%
!!!                       Local CPU util  : 37.5%
!!!                       Remote CPU util : 734.0%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 65536  65536  32768    60.00      1150.06   2.73     20.57    0.389 
11.708 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 8192 -S 8192
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096 
-s 8192 -S 8192
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  0.8%
!!!                       Local CPU util  : 12.2%
!!!                       Remote CPU util : 2058.3%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 16384  16384   4096    60.00       437.99   4.19     5.12     1.566 7.757 
 
!!! Confidence intervals: Throughput      :  3.3%
!!!                       Local CPU util  : 12.3%
!!!                       Remote CPU util : 2058.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 16384  16384   4096    60.00       426.25   4.19     5.12     1.610 7.673 
 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 8192 -S 8192
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192 
-s 8192 -S 8192
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  2.0%
!!!                       Local CPU util  : 31.1%
!!!                       Remote CPU util : 139.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 16384  16384   8192    60.00       437.92   4.92     37.54    1.843 
56.225 
!!! Confidence intervals: Throughput      :  2.2%
!!!                       Local CPU util  : 31.1%
!!!                       Remote CPU util : 139.2%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 16384  16384   8192    60.00       441.02   4.92     37.54    1.830 
55.732 
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 8192 -S 8192
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768 
-s 8192 -S 8192
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200 
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf.  : demo
!!! Confidence intervals: Throughput      :  1.5%
!!!                       Local CPU util  : 17.4%
!!!                       Remote CPU util : 2895.5%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 16384  16384  32768    60.00       439.39   4.05     4.57     1.508 6.537 
 
!!! Confidence intervals: Throughput      :  0.7%
!!!                       Local CPU util  : 17.3%
!!!                       Remote CPU util : 2854.1%

Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB us/KB

 16384  16384  32768    60.02       439.50   4.05     4.63     1.511 6.979 
 





Thank you for helping me interpreting these statistics.

Have a nice day.

Simon Duboué
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.netperf.org/pipermail/netperf-talk/attachments/20120423/a9dbee75/attachment-0001.html>


More information about the netperf-talk mailing list