FreeBSD networking performance lab

Instructions for using some FreeBSD networking performance lab

Orange

Diagrams

Inventory

Servers	CPU	cores	GHz	Network card (driver name)
Dell PowerEdge R630	Intel E5-2650 v4	2x12x2	2.2	10G Intel 82599ES (ixgbe)
				10G Chelsio T520-CR (cxgbe)
				10-50G Mellanox ConnectX-4 LX (mlx5en)
HP ProLiant DL360p Gen8	Intel E5-2650 v2	8×2	2.6	10G Chelsio T540-CR (cxgbe)
HP ProLiant DL360p Gen8	Intel E5-2650 v2	8×2	2.6	10G Emulex OneConnect be3 (oce)
SuperMicro 5018A-FTN4	Intel Atom C2758	8	2.4	10G Chelsio T540-CR (cxgbe)
SuperMicro 5018A-FTN4	Intel Atom C2758	8	2.4	Gigabit Intel i354 (igb)
SuperMicro 5018A-FTN4	Intel Atom C2758	8	2.4	10G Intel 82599 (ixgbe)
SuperMicro 5018A-FTN4	Intel Atom C2758	8	2.4	Gigabit Intel i354 (igb)
Netgate RCC-VE 4860	Intel Atom C2558	4	2.4	Gigabit Intel i350 (igb)
Netgate RCC-VE 4860	Intel Atom C2558	4	2.4	Gigabit Intel i211 (igb)
PC Engines APU2	AMD GX-412TC	4	1	Gigabit Intel i210AT (igb)
IBM System x3550 M3	Intel L5630	4×2	2.13	Gigabit Intel 82580 (igb)

Connectivity

Server						Connected to
Description	Usage	Hostname	Interface	MAC	IP (/24)	Switch	Port	VLAN
Dell PowerEdge R630	DUT	r630	IPMI	84:7b:eb:f6:03:5c	192.168.1.12	Catalyst-3750	Gi1/0/3	3
			igb0	24:6e:96:5b:92:84		Catalyst-3750	Gi1/0/4	3
			igb1	24:6e:96:5b:92:85	192.168.1.2	Catalyst-3750	Gi1/0/16	3
			ix0	24:6e:96:5b:92:80	198.18.0.12	Juniper-QFX	xe-0/0/13	2
			ix1	24:6e:96:5b:92:82	198.19.0.12	Juniper-QFX	xe-0/0/12	2
			cxl0	00:07:43:2f:fe:b0	198.18.0.202	Juniper-QFX	xe-0/0/15	2
			vcxl0	00:07:43:2f:fe:b2	198.18.0.2	Juniper-QFX	xe-0/0/15	2
			cxl1	00:07:43:2f:fe:b8	198.19.0.202	Juniper-QFX	xe-0/0/14	2
			vcxl1	00:07:43:2f:fe:ba	198.19.0.2	Juniper-QFX	xe-0/0/14	2
			mlxen0	ec:0d:9a:21:aa:10	198.18.0.222	Juniper-QFX	xe-0/0/17	2
			mlxen1	ec:0d:9a:21:aa:11	198.19.0.222	Juniper-QFX	xe-0/0/16	2
			mce0	ec:0d:9a:9c:7a:e6	198.18.0.22	Juniper-QFX	xe-0/0/18	2
			mce1	ec:0d:9a:9c:7a:e7	198.19.0.22	Juniper-QFX	xe-0/0/19	2
			uart1		115200	bastion	/dev/cuaU4
HP ProLiant DL360p Gen8	DUT	HP	IPMI	fc:15:b4:1b:5b:b6	192.168.1.15	Catalyst-3750	Gi1/0/11	3
			igb0	38:ea:a7:38:4d:74
			igb1	38:ea:a7:38:4d:75	192.168.1.10	Catalyst-3750	Gi1/0/23	3
			oce0	e8:39:35:c4:0f:c8	198.18.0.100	Juniper-QFX	xe-0/0/3	2
			oce1	e8:39:35:c4:0f:cc	198.19.0.100	Juniper-QFX	xe-0/0/2	2
			cxl0	00:07:43:2e:e4:70	198:18.0.110	Juniper-QFX	xe-0/0/0	2
			vcxl0	00:07:43:2e:e4:71	198.18.0.10	Juniper-QFX	xe-0/0/0	2
			cxl1	00:07:43:2e:e4:78	198.19.0.110	Juniper-QFX	xe-0/0/1	2
			vcxl1	00:07:43:2e:e4:79	198.19.0.10	Juniper-QFX	xe-0/0/1	2
SuperMicro 5018A-FTN4	DUT	SM1	IPMI	00:25:90:f1:b1:18	192.168.1.18	Catalyst-3750	Gi1/0/14	3
			igb0	00:25:90:f1:58:ee	192.168.1.8	Catalyst-3750	Gi1/0/19	3
			igb1	00:25:90:f1:58:ef	198.18.0.208	Catalyst-3750	Gi1/0/30	2
			igb2	00:25:90:f1:58:f0	198.19.0.208	Catalyst-3750	Gi1/0/21	2
			cxl0	00:07:43:2e:e5:90	198.18.0.8	Juniper-QFX	xe-0/0/6	2
			vcxl0	00:07:43:2e:e5:91	198.18.0.108	Juniper-QFX	xe-0/0/6	2
			cxl1	00:07:43:2e:e5:98	198.19.0.8	Juniper-QFX	xe-0/0/7	2
			vcxl1	00:07:43:2e:e5:99	198.19.0.108	Juniper-QFX	xe-0/0/7	2
			uart0		115200	bastion	/dev/cuau5
SuperMicro 5018A-FTN4	DUT	SM2	IPMI	0c:c4:7a:de:44:81	192.168.1.11	Catalyst-3750	Gi1/0/2	3
			igb0	0c:c4:7a:da:3c:10	192.168.1.1	Catalyst-3750	Gi1/0/1	3
			igb1	0c:c4:7a:da:3c:11	198.18.0.201	Catalyst-3750	Gi1/0/14	2
			igb2	0c:c4:7a:da:3c:12	198.19.0.201	Catalyst-3750	Gi1/0/13	2
			ix0	90:e2:ba:84:20:38	198.18.0.1	Juniper-QFX	xe-0/0/4	2
			ix1	90:e2:ba:84:20:39	198.19.0.1	Juniper-QFX	xe-0/0/5	2
			uart0		115200	bastion	/dev/cuau8
Netgate RCC-VE 4860	DUT	netgate	igb5	00:08:a2:09:33:dd	192.168.1.9	Catalyst-3750	Gi1/0/7	3
			igb2	00:08:a2:09:33:da	198.18.0.209	Catalyst-3750	Gi1/0/31	2
			igb3	00:08:a2:09:33:db	198.19.0.209	Catalyst-3750	Gi1/0/32	2
			uart1		115200	bastion	/dev/cuaU0
PC Engines APU2	DUT	APU2	igb0	00:0d:b9:41:ca:3c	192.168.1.5	Catalyst-3750	Gi1/0/08	3
			igb1	00:0d:b9:41:ca:3d	198.18.0.205	Catalyst-3750	Gi1/0/33	2
			igb2	00:0d:b9:41:ca:3e	198.19.0.205	Catalyst-3750	Gi1/0/34	2
IBM x3550-M3	pkt-gen	IBM3	bce0	5cf3.fcdd.a4c1	192.168.1.13	Catalyst-3750	Gi1/0/6	3
			igb2	00:1b:21:c4:95:7a	198.18.0.203	Catalyst-3750	Gi1/0/17	2
			igb3	00:1b:21:c4:95:7b	198.19.0.203	Catalyst-3750	Gi1/0/18	2
PowerEdge M630	dev	Lame4	bxe3	00:0e:1e:77:7d:12	192.168.1.24	Catalyst-3750	Gi1/0/35	3
PowerEdge M630	dev	Lame5	bxe3	14:9e:cf:17:ad:50	192.168.1.25	Catalyst-3750	Gi1/0/38	3
PC Engines APU1	Management	bastion	re0	00:0d:b9:3c:a0:cc	Internet Access
PC Engines APU1	Management	bastion	re1	00:0d:b9:3c:a0:ce	192.168.1.100	Catalyst-3750	Gi1/0/9	3

VLANs definition:

3: management
2: benches

Devices access

Once logged into the management server (bastion), you can access the devices by

SSH

Simply type:

ssh root@HOSTNAME

Console or IPMI

device hostname	command	type
hp	tip hp	serial
apu2	tip apu	serial
netgate	tip netgate	serial
Catalyst-3750	tip switch	serial

Usage example

Objective: Start a traffic flow arccos the “netgate” device using “ibm3” as packet source&receiver:

Open a tmux with 3 windows
On the first window, ssh to ibm3 and start packet receiver
```
ssh root@ibm3
pkt-gen -N -f rx -i igb3 -w 4
```

On the second window, ssh into ibm3 and start a packet generator

ssh root@ibm3
pkt-gen -N -f tx -w 4 -i igb2 -n 300000000 -l 60 -4 -U -S 00:1b:21:c4:95:7a -s 198.18.10.1:2000-198.18.10.20 -D 00:08:a2:09:33:da -d 198.19.10.1:2000-198.19.10.100

On the third window, ssh or connect to console of netgate for checking throughput
```
ssh root@netgate
netstat -ihw 1
```

BSD Router Project

Table of Contents