[netperf-talk] global question concerning Netperf test and SMP support
Simon Duboue
Simon.Duboue at ces.ch
Mon Apr 23 09:09:23 PDT 2012
>That is much better. Still, I've taken to using:
>
>
http://www.netperf.org/svn/netperf2/trunk/doc/netperf.html#Using-_002d_002denable_002ddemo
>
>and scripting along the lines of:
>
>
http://www.netperf.org/svn/netperf2/trunk/doc/examples/runemomniaggdemo.sh
>
>with post-processing via rrdtool for aggregate measurements.
I will concentrate on this after.
>> For the -s -S and -m -M options, what scenario could be a good start in
>> order to test their influence?
>
>Pretty much up to you. There are some ancient scripts under
>http://www.netperf.org/svn/netperf2/trunk/doc/examples/ like the
>tcp_stream_script you could use as a starting point - that script is
>focused on single-instance testing.
I use this script, modified to fit my test bench and my multi instance
testing.
Here are the results and some interpretation based on what you already
explained to me.
CIO-SUSE:/ces/Simon/Rick # ./tcp_stream_script.sh
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 128K -S 128K
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 128K -S 128K
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! WARNING
!!! Desired confidence was not achieved within the specified iterations.
!!! This implies that there was variability in the test environment that
!!! must be investigated before going further.
!!! Confidence intervals: Throughput : 6.5%
!!! Local CPU util : 9.9%
!!! Remote CPU util : -713.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
262142 262142 4096 60.02 1149.25 4.77 -138.54 0.681
-76.721
!!! WARNING
!!! Desired confidence was not achieved within the specified iterations.
!!! This implies that there was variability in the test environment that
!!! must be investigated before going further.
!!! Confidence intervals: Throughput : 4.3%
!!! Local CPU util : 9.0%
!!! Remote CPU util : -713.4%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
262142 262142 4096 60.08 1140.63 4.77 -138.42 0.685
-81.299
Here we can consider that the tests are running in parallel because both
send and remote CPU utilization are quite the same.
The throughput is considered as the sum of the two throughputs obtained. I
will try the same test with much more instance.
I still can not explain the negative CPU utilzation in remote. What
considerations could we do with the confidence interval? Is it acceptable?
Could we ignore it?
Next, the changes are just concerning the socket size and the message
size.
We clearly observe the differences between the different configuration.
The best throughput is obtained for 56k socket size. These performance and
optimal configuration are dependent of the equipment.
Why does we configure 56k and netperf print 56k x 2 as socket size. Is it
what you called linuxism here?
http://www.netperf.org/pipermail/netperf-talk/2006-October/000176.html
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 128K -S 128K
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 128K -S 128K
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 5.9%
!!! Local CPU util : 13.2%
!!! Remote CPU util : 36.4%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
262142 262142 8192 60.05 1154.15 4.22 9.16 0.599 5.206
!!! Confidence intervals: Throughput : 7.0%
!!! Local CPU util : 12.2%
!!! Remote CPU util : 36.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
262142 262142 8192 60.08 1186.34 4.22 9.10 0.583 5.023
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 128K -S 128K
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 128K -S 128K
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 10.7%
!!! Local CPU util : 31.0%
!!! Remote CPU util : 30.9%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
262142 262142 32768 60.05 1172.18 4.05 9.52 0.565 5.319
!!! Confidence intervals: Throughput : 8.8%
!!! Local CPU util : 31.1%
!!! Remote CPU util : 30.8%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
262142 262142 32768 60.06 1170.69 4.03 9.54 0.564 5.347
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 57344 -S 57344
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 57344 -S 57344
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 0.9%
!!! Local CPU util : 9.0%
!!! Remote CPU util : 379.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
114688 114688 4096 60.00 1711.03 8.90 28.41 0.852
10.872
!!! Confidence intervals: Throughput : 1.1%
!!! Local CPU util : 9.0%
!!! Remote CPU util : 379.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
114688 114688 4096 60.00 1714.80 8.90 28.41 0.850
10.841
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 57344 -S 57344
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 57344 -S 57344
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 1.0%
!!! Local CPU util : 5.8%
!!! Remote CPU util : 176.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
114688 114688 8192 60.00 1711.16 8.37 45.42 0.801
17.397
!!! Confidence intervals: Throughput : 0.9%
!!! Local CPU util : 5.8%
!!! Remote CPU util : 176.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
114688 114688 8192 60.00 1710.34 8.37 45.42 0.801
17.388
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 57344 -S 57344
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 57344 -S 57344
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 1.2%
!!! Local CPU util : 11.3%
!!! Remote CPU util : 328.7%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
114688 114688 32768 60.00 1717.21 7.74 37.64 0.738
14.361
!!! Confidence intervals: Throughput : 0.9%
!!! Local CPU util : 11.3%
!!! Remote CPU util : 328.7%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
114688 114688 32768 60.00 1713.09 7.74 37.64 0.740
14.422
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 32768 -S 32768
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 32768 -S 32768
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 0.3%
!!! Local CPU util : 43.8%
!!! Remote CPU util : 3397.1%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
65536 65536 4096 60.00 1148.96 4.98 6.76 0.710 3.844
!!! Confidence intervals: Throughput : 0.3%
!!! Local CPU util : 43.8%
!!! Remote CPU util : 3397.1%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
65536 65536 4096 60.00 1149.32 4.98 6.76 0.710 3.838
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 32768 -S 32768
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 32768 -S 32768
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 2.0%
!!! Local CPU util : 34.5%
!!! Remote CPU util : 25909.6%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
65536 65536 8192 60.00 754.82 2.51 0.82 0.545 0.352
!!! Confidence intervals: Throughput : 29.0%
!!! Local CPU util : 34.2%
!!! Remote CPU util : 25907.9%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
65536 65536 8192 60.00 789.35 2.51 0.82 0.526
-0.424
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 32768 -S 32768
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 32768 -S 32768
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 0.1%
!!! Local CPU util : 37.7%
!!! Remote CPU util : 734.0%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
65536 65536 32768 60.00 1149.70 2.74 20.57 0.390
11.715
!!! Confidence intervals: Throughput : 0.2%
!!! Local CPU util : 37.5%
!!! Remote CPU util : 734.0%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
65536 65536 32768 60.00 1150.06 2.73 20.57 0.389
11.708
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 8192 -S 8192
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 4096
-s 8192 -S 8192
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 0.8%
!!! Local CPU util : 12.2%
!!! Remote CPU util : 2058.3%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
16384 16384 4096 60.00 437.99 4.19 5.12 1.566 7.757
!!! Confidence intervals: Throughput : 3.3%
!!! Local CPU util : 12.3%
!!! Remote CPU util : 2058.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
16384 16384 4096 60.00 426.25 4.19 5.12 1.610 7.673
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 8192 -S 8192
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 8192
-s 8192 -S 8192
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 2.0%
!!! Local CPU util : 31.1%
!!! Remote CPU util : 139.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
16384 16384 8192 60.00 437.92 4.92 37.54 1.843
56.225
!!! Confidence intervals: Throughput : 2.2%
!!! Local CPU util : 31.1%
!!! Remote CPU util : 139.2%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
16384 16384 8192 60.00 441.02 4.92 37.54 1.830
55.732
------------------------------------
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 8192 -S 8192
netperf -l 60 -H 10.0.17.200 -t TCP_STREAM -cC -i 10,2 -I 99,5 -- -m 32768
-s 8192 -S 8192
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.0.17.200
(10.0.17.200) port 0 AF_INET : +/-2.5% @ 99% conf. : demo
!!! Confidence intervals: Throughput : 1.5%
!!! Local CPU util : 17.4%
!!! Remote CPU util : 2895.5%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
16384 16384 32768 60.00 439.39 4.05 4.57 1.508 6.537
!!! Confidence intervals: Throughput : 0.7%
!!! Local CPU util : 17.3%
!!! Remote CPU util : 2854.1%
Recv Send Send Utilization Service
Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local
remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB
16384 16384 32768 60.02 439.50 4.05 4.63 1.511 6.979
Thank you for helping me interpreting these statistics.
Have a nice day.
Simon Duboué
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.netperf.org/pipermail/netperf-talk/attachments/20120423/a9dbee75/attachment-0001.html>
More information about the netperf-talk
mailing list