User Tools

Site Tools


documentation:examples:forwarding_performance_lab_of_a_hp_proliant_dl360p_gen8_with_10-gigabit_with_10-gigabit_chelsio_t540-cr
no way to compare when less than two revisions

Differences

This shows you the differences between two versions of the page.


Previous revision
Last revision
documentation:examples:forwarding_performance_lab_of_a_hp_proliant_dl360p_gen8_with_10-gigabit_with_10-gigabit_chelsio_t540-cr [2019/12/18 00:36] olivier
Line 1: Line 1:
 +====== Forwarding performance lab of a HP ProLiant DL360p Gen8 with 10-Gigabit Chelsio T540-CR ======
 +{{description>Forwarding performance lab of a quad cores Xeon 2.13GHz and quad-port 10-Gigabit Chelsio T540-CR}}
  
 +===== Bench lab =====
 +
 +==== Hardware detail ====
 +
 +This lab will test an [[HP ProLiant DL360p Gen8]] with **eight** cores (Intel Xeon E5-2650  @ 2.60GHz), quad port Chelsio 10-Gigabit T540-CR and OPT SFP (SFP-10G-LR).
 +
 +The lab is detailed here: [[documentation:examples:Setting up a forwarding performance benchmark lab]].
 +
 +=== Diagram ===
 +
 +<code>
 ++------------------------------------------+ +-------+ +------------------------------+
 +|        Device under test                 | |Juniper| | Packet generator & receiver  |
 +|                                          | |  QFX  | |                              |
 +|                cxl0: 198.18.0.10/24      |=|   <   |=| vcxl0: 198.18.0.108/24       |
 +|                      2001:2::10/64       | |       | |        2001:2::108/64        |
 +|                      (00:07:43:2e:e4:70) | |       | |        (00:07:43:2e:e5:92)   |
 +|                                          | |       | |                              |
 +|                cxl1: 198.19.0.10/24      |=|   >   |=| vcxl1: 198.19.0.108/24       |
 +|                     2001:2:0:8000::10/64 | |       | |        2001:2:0:8000::108/64 |
 +|                      (00:07:43:2e:e4:78) | +-------+ |        (00:07:43:2e:e5:9a)   |
 +|                                          |                                        |
 +|            static routes                                                        |
 +| 192.18.0.0/16      => 198.18.0.108                                              |
 +| 192.19.0.0/16      => 198.19.0.108                                              |
 +| 2001:2::/49        => 2001:2::108        |                                        |
 +| 2001:2:0:8000::/49 => 2001:2:0:8000::108 |                                        |
 +|                                          |                                        |
 +|        static arp and ndp                |           | /boot/loader.conf:           |
 +| 198.18.0.108        => 00:07:43:2e:e5:92 |                hw.cxgbe.num_vis=2      |
 +| 2001:2::108                              |                                        |
 +|                                          |                                        |
 +| 198.19.0.108        => 00:07:43:2e:e5:9a |                                        |
 +| 2001:2:0:8000::108                                                              |
 ++------------------------------------------+           +------------------------------+
 +</code>
 +
 +The generator **MUST** generate lot's of smallest IP flows (multiple source/destination IP addresses and/or UDP src/dst port).
 +
 +Here is an example for generating 5000 flows (different source IP * different destination IP) at line-rate by using 2 threads:
 +<code>
 +pkt-gen -N -f tx -w 2 -i vcxl0 -n 1000000000 -l 60 -4 -p 2 -S 00:07:43:2f:fe:b2 -s 198.18.10.1:2001-198.18.10.71 -D 00:07:43:2e:e4:70 -d 198.19.10.1:2001-198.19.10.70
 +</code>
 +
 +And the same with IPv6 flows (minimum frame size of 62 here):
 +<code>
 +pkt-gen -N -f tx -w 2 -i vcxl0 -n 1000000000 -l 62 -6 -p 2 -S 00:07:43:2f:fe:b2 -s "[2001:2:0:10::1]-[2001:2:0:10::47]" -D 00:07:43:2e:e4:70 -d "[2001:2:0:8010::1]-[2001:2:0:8010::46]"
 +</code>
 +
 +<note warning>
 +Netmap disable hardware checksum on the NIC, if you can't re-enable hardware checksum in netmap mode (like with Intel NIC), you need to use a FreeBSD -head with svn revision of 257758 minimum with the[[https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=187149|pkt-gen software-checksum patch]] for using multiple src/dst IP or port with netmap's pkt-gen. But this software checksum patch will reduce performance from line-rate to about 10Mpps.
 +</note>
 +Receiver will use this command:
 +<code>
 +pkt-gen -i vcxl1 -f rx -w 2
 +</code>
 +==== Configuration and tuning ====
 +
 +[[https://github.com/ocochard/netbenches/tree/master/Xeon_E5-2650-8Cores-Chelsio_T540-CR/forwarding-pf-ipfw/configs|DUT configurations repository]]
 +=== Results ===
 +
 +{{https://raw.githubusercontent.com/ocochard/netbenches/master/Xeon_E5-2650-8Cores-Chelsio_T540-CR/forwarding-pf-ipfw/results/fbsd12-stable.r354440.BSDRP.1.96/graph.png}}
documentation/examples/forwarding_performance_lab_of_a_hp_proliant_dl360p_gen8_with_10-gigabit_with_10-gigabit_chelsio_t540-cr.txt · Last modified: 2019/12/27 11:41 by olivier

Except where otherwise noted, content on this wiki is licensed under the following license: BSD 2-Clause
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki