User Tools

Site Tools


documentation:technical_docs:bench_lab

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

documentation:technical_docs:bench_lab [2018/11/12 08:34] (current)
Line 1: Line 1:
 +====== Orange'​s FreeBSD networking performance lab ======
 +{{description>​Instructions for using Orange'​s FreeBSD networking performance lab}}
  
 +===== Diagrams ​ =====
 +
 +{{freebsd_labs.png}}
 +===== Inventory ​ =====
 +
 +^ Servers ^ CPU ^ cores ^ GHz ^ Network card (driver name) ^
 +|Dell PowerEdge R630 | Intel E5-2650 v4 | 2x12x2 | 2.2 | 10G Intel 82599ES (ixgbe) |
 +| ::: | ::: | ::: | ::: | 10G Chelsio T520-CR (cxgbe) |
 +| ::: | ::: | ::: | ::: | 10-50G Mellanox ConnectX-4 LX (mlx5en) |
 +| HP ProLiant DL360p Gen8 | Intel E5-2650 v2 | 8x2 | 2.6 | 10G Chelsio T540-CR (cxgbe) |
 +| ::: | ::: | ::: | ::: | 10G Emulex OneConnect be3 (oce) |
 +| SuperMicro 5018A-FTN4 | Intel Atom C2758 | 8 | 2.4 | 10G Chelsio T540-CR (cxgbe) |
 +| ::: | ::: | ::: | ::: | Gigabit Intel i354 (igb) |
 +| SuperMicro 5018A-FTN4 | Intel Atom C2758 | 8 | 2.4 | 10G Intel 82599 (ixgbe) |
 +| ::: | ::: | ::: | ::: | Gigabit Intel i354 (igb) |
 +| Netgate RCC-VE 4860 | Intel Atom C2558 | 4 | 2.4 | Gigabit Intel i350 (igb) |
 +| ::: | ::: | ::: | ::: | Gigabit Intel i211 (igb) |
 +| PC Engines APU2 | AMD GX-412TC | 4 | 1 | Gigabit Intel i210AT (igb)|
 +| IBM System x3550 M3 | Intel L5630 | 4x2 | 2.13 | Gigabit Intel 82580 (igb)|
 +
 +===== Connectivity ​ =====
 +
 +^  Server ​    ​^^^^^^ ​ Connected to       ^^^
 +| Description | Usage | Hostname | Interface | MAC | IP (/24) | Switch | Port | VLAN |
 +| Dell PowerEdge R630 | DUT | r630 | IPMI | 84:​7b:​eb:​f6:​03:​5c | 192.168.1.12 | Catalyst-3750 ​ | Gi1/0/3 | 3 |
 +| ::: | ::: | ::: | igb0 | 24:​6e:​96:​5b:​92:​84 | | Catalyst-3750 | Gi1/0/4 | 3 |
 +| ::: | ::: | ::: | igb1 | 24:​6e:​96:​5b:​92:​85 | 192.168.1.2 | Catalyst-3750 | Gi1/0/16 | 3 |
 +| ::: | ::: | ::: | ix0 | 24:​6e:​96:​5b:​92:​80 | 198.18.0.12| Juniper-QFX | xe-0/0/13 | 2 |
 +| ::: | ::: | ::: | ix1 | 24:​6e:​96:​5b:​92:​82 | 198.19.0.12 | Juniper-QFX | xe-0/0/12 | 2 |
 +| ::: | ::: | ::: | cxl0 | 00:​07:​43:​2f:​fe:​b0 | 198.18.0.202 | Juniper-QFX | xe-0/0/15 | 2 |
 +| ::: | ::: | ::: | vcxl0 | 00:​07:​43:​2f:​fe:​b2 | 198.18.0.2 | ::: | ::: | ::: |
 +| ::: | ::: | ::: | cxl1 | 00:​07:​43:​2f:​fe:​b8 | 198.19.0.202 | Juniper-QFX | xe-0/0/14 | 2 |
 +| ::: | ::: | ::: | vcxl1 | 00:​07:​43:​2f:​fe:​ba | 198.19.0.2 | ::: | ::: | ::: |
 +| ::: | ::: | ::: | mlxen0 | ec:​0d:​9a:​21:​aa:​10 | 198.18.0.222 | Juniper-QFX | xe-0/0/17 | 2 |
 +| ::: | ::: | ::: | mlxen1 | ec:​0d:​9a:​21:​aa:​11 | 198.19.0.222 | Juniper-QFX | xe-0/0/16 | 2 |
 +| ::: | ::: | ::: | mce0 | ec:​0d:​9a:​9c:​7a:​e6 | 198.18.0.22 | Juniper-QFX | xe-0/0/18 | 2 |
 +| ::: | ::: | ::: | mce1 | ec:​0d:​9a:​9c:​7a:​e7 | 198.19.0.22 | Juniper-QFX | xe-0/0/19 | 2 |
 +| ::: | ::: | ::: | uart1 || 115200 | bastion | /dev/cuaU4 |
 +| HP ProLiant DL360p Gen8 | DUT | HP | IPMI | fc:​15:​b4:​1b:​5b:​b6| 192.168.1.15 | Catalyst-3750 | Gi1/0/11 | 3 |
 +| ::: | ::: | ::: | igb0 | 38:​ea:​a7:​38:​4d:​74 |
 +| ::: | ::: | ::: | igb1 | 38:​ea:​a7:​38:​4d:​75 | 192.168.1.10 | Catalyst-3750 | Gi1/0/23 | 3 |
 +| ::: | ::: | ::: | oce0 | e8:​39:​35:​c4:​0f:​c8 | 198.18.0.100 | Juniper-QFX | xe-0/0/3 | 2 |
 +| ::: | ::: | ::: | oce1 | e8:​39:​35:​c4:​0f:​cc | 198.19.0.100 | Juniper-QFX | xe-0/0/2 | 2 |
 +| ::: | ::: | ::: | cxl0 | 00:​07:​43:​2e:​e4:​70 | 198:​18.0.110 | Juniper-QFX | xe-0/0/0 | 2 |
 +| ::: | ::: | ::: | vcxl0 | 00:​07:​43:​2e:​e4:​71 | 198.18.0.10 | ::: | ::: | ::: |
 +| ::: | ::: | ::: | cxl1 | 00:​07:​43:​2e:​e4:​78 | 198.19.0.110 | Juniper-QFX | xe-0/0/1 | 2 |
 +| ::: | ::: | ::: | vcxl1 | 00:​07:​43:​2e:​e4:​79 | 198.19.0.10 | ::: | ::: | ::: |
 +| SuperMicro 5018A-FTN4 | DUT | SM1 | IPMI | 00:​25:​90:​f1:​b1:​18 | 192.168.1.18 | Catalyst-3750 | Gi1/0/14 | 3 |
 +| ::: | ::: | ::: | igb0 | 00:​25:​90:​f1:​58:​ee | 192.168.1.8 | Catalyst-3750 | Gi1/0/19 | 3 |
 +| ::: | ::: | ::: | igb1 | 00:​25:​90:​f1:​58:​ef | 198.18.0.208 | Catalyst-3750 | Gi1/0/30 | 2 |
 +| ::: | ::: | ::: | igb2 | 00:​25:​90:​f1:​58:​f0 | 198.19.0.208 | Catalyst-3750 | Gi1/0/21 | 2 |
 +| ::: | ::: | ::: | cxl0 | 00:​07:​43:​2e:​e5:​90 | 198.18.0.8 | Juniper-QFX | xe-0/0/6 | 2 |
 +| ::: | ::: | ::: | vcxl0 | 00:​07:​43:​2e:​e5:​91 | 198.18.0.108 | ::: | ::: | ::: |
 +| ::: | ::: | ::: | cxl1 | 00:​07:​43:​2e:​e5:​98 | 198.19.0.8 | Juniper-QFX | xe-0/0/7 | 2 |
 +| ::: | ::: | ::: | vcxl1 | 00:​07:​43:​2e:​e5:​99 | 198.19.0.108 | ::: | ::: | ::: |
 +| ::: | ::: | ::: | uart0 | | 115200 | bastion | /dev/cuau5 |
 +| SuperMicro 5018A-FTN4 | DUT | SM2 | IPMI | 0c:​c4:​7a:​de:​44:​81 ​ | 192.168.1.11 | Catalyst-3750 | Gi1/0/2 | 3 |
 +| ::: | ::: | ::: | igb0 | 0c:​c4:​7a:​da:​3c:​10 ​ | 192.168.1.1 | Catalyst-3750 | Gi1/0/1 | 3 |
 +| ::: | ::: | ::: | igb1 | 0c:​c4:​7a:​da:​3c:​11 | 198.18.0.201 | Catalyst-3750 | Gi1/0/14 | 2 |
 +| ::: | ::: | ::: | igb2 | 0c:​c4:​7a:​da:​3c:​12 | 198.19.0.201 | Catalyst-3750 | Gi1/0/13 | 2 |
 +| ::: | ::: | ::: | ix0 | 90:​e2:​ba:​84:​20:​38 ​ | 198.18.0.1 | Juniper-QFX | xe-0/0/4 | 2 |
 +| ::: | ::: | ::: | ix1 | 90:​e2:​ba:​84:​20:​39 ​ | 198.19.0.1 | Juniper-QFX | xe-0/0/5 | 2 |
 +| ::: | ::: | ::: | uart0 || 115200 | bastion | /dev/cuau8 |
 +| Netgate RCC-VE 4860  | DUT | netgate | igb5 | 00:​08:​a2:​09:​33:​dd | 192.168.1.9 | Catalyst-3750 | Gi1/0/7 | 3 |
 +| ::: | ::: | ::: | igb2 | 00:​08:​a2:​09:​33:​da | 198.18.0.209 | Catalyst-3750 | Gi1/0/31 | 2 |
 +| ::: | ::: | ::: | igb3 | 00:​08:​a2:​09:​33:​db | 198.19.0.209 | Catalyst-3750 | Gi1/0/32 | 2 |
 +| ::: | ::: | ::: | uart1 || 115200 | bastion | /dev/cuaU0 |
 +| PC Engines APU2 | DUT | APU2| igb0 | 00:​0d:​b9:​41:​ca:​3c | 192.168.1.5 | Catalyst-3750 | Gi1/0/08 | 3 |
 +| ::: | ::: | ::: | igb1 | 00:​0d:​b9:​41:​ca:​3d | 198.18.0.205 | Catalyst-3750 | Gi1/0/33 | 2 |
 +| ::: | ::: | ::: | igb2 | 00:​0d:​b9:​41:​ca:​3e | 198.19.0.205 | Catalyst-3750 | Gi1/0/34 | 2 |
 +| IBM x3550-M3 | pkt-gen | IBM3 | bce0 | 5cf3.fcdd.a4c1 | 192.168.1.13 | Catalyst-3750 | Gi1/0/6 | 3 |
 +| ::: | ::: | ::: | igb2 | 00:​1b:​21:​c4:​95:​7a | 198.18.0.203 | Catalyst-3750 | Gi1/0/17 | 2 |
 +| ::: | ::: | ::: | igb3 | 00:​1b:​21:​c4:​95:​7b | 198.19.0.203 | Catalyst-3750 | Gi1/0/18 | 2 |
 +| PowerEdge M630 | dev | Lame4 | bxe3 | 00:​0e:​1e:​77:​7d:​12 | 192.168.1.24 | Catalyst-3750 | Gi1/0/35 | 3 |
 +| PowerEdge M630 | dev | Lame5 | bxe3 | 14:​9e:​cf:​17:​ad:​50 | 192.168.1.25| Catalyst-3750 | Gi1/0/38 | 3 |
 +| PC Engines APU1 | Management | bastion | re0 | 00:​0d:​b9:​3c:​a0:​cc | Internet Access |
 +| ::: | ::: | ::: | re1 | 00:​0d:​b9:​3c:​a0:​ce | 192.168.1.100 | Catalyst-3750 | Gi1/0/9 | 3 |
 +
 +VLANs definition:
 +  * 3: management
 +  * 2: benches
 +===== Devices access ​ =====
 +
 +Once logged into the management server (bastion), you can access the devices by
 +
 +==== SSH ====
 +
 +Simply type:
 +<​code>​
 +ssh root@HOSTNAME
 +</​code>​
 +
 +==== Console or IPMI ====
 +
 +^ device hostname ^ command ^ type ^ 
 +| hp | tip hp | serial |
 +| apu2 | tip apu | serial |
 +| netgate | tip netgate | serial |
 +| Catalyst-3750 | tip switch | serial |
 +
 +===== Usage  example =====
 +
 +Objective: Start a traffic flow arccos the "​netgate"​ device using "​ibm3"​ as packet source&​receiver:​
 +  - Open a tmux with 3 windows
 +  - On the first window, ssh to ibm3 and start packet receiver<​code>​ssh root@ibm3
 +pkt-gen -N -f rx -i igb3 -w 4</​code>​
 +  - On the second window, ssh into ibm3 and start a packet generator<​code>​ssh root@ibm3
 +pkt-gen -N -f tx -w 4 -i igb2 -n 300000000 -l 60 -4 -U -S 00:​1b:​21:​c4:​95:​7a -s 198.18.10.1:​2000-198.18.10.20 -D 00:​08:​a2:​09:​33:​da -d 198.19.10.1:​2000-198.19.10.100</​code>​
 +  - On the third window, ssh or connect to console of netgate for checking throughput<​code>​ssh root@netgate
 +netstat -ihw 1</​code>​
documentation/technical_docs/bench_lab.txt ยท Last modified: 2018/11/12 08:34 (external edit)