[netperf-talk] 10G test problem

[Rick Jones]

On 11/11/2012 05:56 AM, m13601078155 wrote:
> 1.The network that I used is Infiniband of 10GB
> 2.NFS file system V3 and No RDMA
> 3.offload is enabled.

Could you provide the full output of ethtool -k <interface>?

> I want to know if can I use test infiniband speed by netperf ?

You can run netperf over IPoIB.  However, netperf does not have native 
support for direct Infiniband tests.

> Thanks a lot.

Since you seem to have gone parallel with your queries I will go ahead 
and paste my response to your message to netperf-feedback here so 
everyone can be on the same page (some of which overlaps with Andrew's 
questions):

Are you completely certain that your file system copy test is not 
accessing a cached file and is always generating meaningful network 
load?  What protocol is being used for the network file copy test?

What OS is running on either side of the test?

Are there any TCP retransmissions reported by the stack on the sending side?

Does any one CPU on either the sender or the receiver become saturated 
(close to 100% utilization)?


I might suggest trying:

netperf -H 192.168.32.62 -l 60 -c -C -- -o 
throughput,local_transport_retrans,local_cpu_peak_util,local_cpu_peak_id,remote_cpu_peak_util,remote_cpu_peak_id

If your sending system is running Linux, the "local_transport_retrans" 
will give the retransmission count for the data connection.

If I've made a typographical error in that list, you can generate one to 
look through by running "netperf -- -O ?"  or looking at 
http://www.netperf.org/svn/netperf2/trunk/doc/netperf.html#Omni-Output-Selectors 


happy benchmarking,

rick jones

> 2012-11-11
> ------------------------------------------------------------------------
> m13601078155
> ------------------------------------------------------------------------
> *发件人：* Andrew Gallatin
> *发送时间：* 2012-11-10  21:43:16
> *收件人：* netperf-talk
> *抄送：*
> *主题：* Re: [netperf-talk] 10G test problem
> On 11/10/12 03:52, m13601078155 wrote:
>  > When I use netperf test 10G network interface .I got the speed is 2121Mbit/s
>  > but I use network file system copy file between the nodes,the file copy
>  > speed is 900M byte/s
>  > so I don't understand wether the result of netperf test is OK or not.
>  > pls give me some advices.Thank you.
> What network file system do you use?  Does it use some sort of
> accelerated side channel (rdma ?) that might not be available to
> a "normal" sockets application?
> Do you have the standard TCP stateless offloads enabled
> (TSO/LSO on the transmit side, GRO / LRO on the receive side)?
> Drew
> _______________________________________________
> netperf-talk mailing list
> netperf-talk at netperf.org
> http://www.netperf.org/cgi-bin/mailman/listinfo/netperf-talk
>
>
> _______________________________________________
> netperf-talk mailing list
> netperf-talk at netperf.org
> http://www.netperf.org/cgi-bin/mailman/listinfo/netperf-talk
>