BSD Router Project

User Tools

Site Tools

Trace:
documentation:examples:ecmp

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
documentation:examples:ecmp [2020/01/26 19:46] – [Testing Load balancing] olivierdocumentation:examples:ecmp [2025/01/17 18:53] (current) – [R2 (ECMP router)] olivier
Line 1: Line 1:
 ====== Equal-cost multi-path routing (ECMP) ====== ====== Equal-cost multi-path routing (ECMP) ======
- 
-This lab is testing new ECMP routing code. 
  
 ===== Presentation ===== ===== Presentation =====
  
 +<note warning>Bhyve doesn't support emulating multiqueue NIC, so RSS flow-id could not be tested using a bhyve based lab: Had to use physical lab</note>
 ==== Network diagram ==== ==== Network diagram ====
  
 Here is the logical and physical view: Here is the logical and physical view:
  
-{{:documentation:examples:labs.examples.ecmp.png|}}+{{:documentation:examples:bsdrp-lab-mpath.png|}}
  
 ===== Setting-up the lab ===== ===== Setting-up the lab =====
Line 15: Line 14:
 ==== Downloading BSD Router Project images ==== ==== Downloading BSD Router Project images ====
  
-Download BSDRP serial image (prevent to have to use an X display) on Sourceforge.+Download BSDRP serial image on Sourceforge and upload them to the 2 ECMP routers.
  
-==== Download Lab scripts ===== 
- 
-More information on these BSDRP lab scripts available on [[documentation:examples:How to build a BSDRP router lab]]. 
- 
-Start the lab with 6 routers. 
-With bhyve under FreeBSD: 
-<code> 
-user:~ # BSDRP-lab-bhyve.sh -i BSDRP.amd64/BSDRP-1.71-full-amd64-serial.img.xz -n 6 
-BSD Router Project (http://bsdrp.net) - bhyve full-meshed lab script 
-Setting-up a virtual lab with 6 VM(s): 
-- Working directory: /tmp/BSDRP 
-- Each VM have 1 core(s) and 256M RAM 
-- Switch mode: bridge + tap 
-- 0 LAN(s) between all VM 
-- Full mesh Ethernet links between each VM 
-VM 1 have the following NIC: 
-- vtnet0 connected to VM 2. 
-- vtnet1 connected to VM 3. 
-- vtnet2 connected to VM 4. 
-- vtnet3 connected to VM 5. 
-- vtnet4 connected to VM 6. 
-VM 2 have the following NIC: 
-- vtnet0 connected to VM 1. 
-- vtnet1 connected to VM 3. 
-- vtnet2 connected to VM 4. 
-- vtnet3 connected to VM 5. 
-- vtnet4 connected to VM 6. 
-VM 3 have the following NIC: 
-- vtnet0 connected to VM 1. 
-- vtnet1 connected to VM 2. 
-- vtnet2 connected to VM 4. 
-- vtnet3 connected to VM 5. 
-- vtnet4 connected to VM 6. 
-VM 4 have the following NIC: 
-- vtnet0 connected to VM 1. 
-- vtnet1 connected to VM 2. 
-- vtnet2 connected to VM 3. 
-- vtnet3 connected to VM 5. 
-- vtnet4 connected to VM 6. 
-VM 5 have the following NIC: 
-- vtnet0 connected to VM 1. 
-- vtnet1 connected to VM 2. 
-- vtnet2 connected to VM 3. 
-- vtnet3 connected to VM 4. 
-- vtnet4 connected to VM 6. 
-VM 6 have the following NIC: 
-- vtnet0 connected to VM 1. 
-- vtnet1 connected to VM 2. 
-- vtnet2 connected to VM 3. 
-- vtnet3 connected to VM 4. 
-- vtnet4 connected to VM 5. 
-For connecting to VM'serial console, you can use: 
-- VM 1 : cu -l /dev/nmdm1B 
-- VM 2 : cu -l /dev/nmdm2B 
-- VM 3 : cu -l /dev/nmdm3B 
-- VM 4 : cu -l /dev/nmdm4B 
-- VM 5 : cu -l /dev/nmdm5B 
-- VM 6 : cu -l /dev/nmdm6B 
-</code> 
  
 ===== Static routing setup ===== ===== Static routing setup =====
  
-==== VM 1 (client) ====+==== Client ====
  
-VM1 is configured as a simple host with multiples aliases:+A simple host with static routes:
  
 <code> <code>
-sysrc hostname=VM1 \ +sysrc hostname=client \ 
- gateway_enable=NO \ +  gateway_enable=NO \ 
- ipv6_gateway_enable=NO \ +  ipv6_gateway_enable=NO \ 
- ifconfig_vtnet0="inet 10.0.12.1/24" \ +  ifconfig_igb1="inet 10.0.12.1/24" \ 
- ifconfig_vtnet0_alias1="inet 10.0.12.11/32" \ +  ifconfig_igb1_ipv6="inet6 2001:db8:12::3 prefixlen 64" \ 
- ifconfig_vtnet0_alias2="inet 10.0.12.21/32" \ +  route_LAB="-net 10.0.0.0/16 10.0.12.2" \ 
- ifconfig_vtnet0_alias3="inet 10.0.12.31/32" \ +  static_routes="LAB" \ 
- ifconfig_vtnet0_alias4="inet 10.0.12.41/32" \ +  ipv6_static_routes="LAB" \ 
- ifconfig_vtnet0_alias5="inet 10.0.12.51/32" \ +  ipv6_route_LAB="2001:db8:: -prefixlen 32 2001:db8:12::2"
- ifconfig_vtnet0_ipv6="inet6 2001:db8:12::1 prefixlen 64" \ +
- ifconfig_vtnet0_alias61="inet6 2001:db8:12::11 prefixlen 64" \ +
- ifconfig_vtnet0_alias62="inet6 2001:db8:12::21 prefixlen 64" \ +
- ifconfig_vtnet0_alias63="inet6 2001:db8:12::31 prefixlen 64" \ +
- ifconfig_vtnet0_alias64="inet6 2001:db8:12::41 prefixlen 64" \ +
- ifconfig_vtnet0_alias65="inet6 2001:db8:12::51 prefixlen 64" \ +
- defaultrouter="10.0.12.2" \ +
- ipv6_defaultrouter="2001:db8:12::2"+
 service hostname restart service hostname restart
 service netif restart service netif restart
Line 107: Line 39:
 </code> </code>
  
-==== VM 2 (ECMP router) ====+==== R1 (ECMP router) ====
  
-VM 2 is a router with ECMP: 2 static routes toward the same destination but using 2 different next-hop.+R1 is a router with ECMP: 2 static routes toward the same destination but using 2 different next-hop.
  
 <code> <code>
-sysrc hostname=VM2 \ + 
- ifconfig_vtnet0="inet 10.0.12.2/24" \ +sysrc hostname=R1 \ 
- ifconfig_vtnet1="inet 10.0.23.2/24" \ +  gateway_enable=YES \ 
- ifconfig_vtnet2="inet 10.0.24.2/24" \ +  ipv6_gateway_enable=YES \ 
- ifconfig_vtnet0_ipv6="inet6 2001:db8:12::2 prefixlen 64" \ +  ifconfig_igb0="inet 10.0.12.2/24" \ 
- ifconfig_vtnet1_ipv6="inet6 2001:db8:23::2 prefixlen 64" \ +  ifconfig_igb0_ipv6="inet6 2001:db8:12::2 prefixlen 64" \ 
- ifconfig_vtnet2_ipv6="inet6 2001:db8:24::2 prefixlen 64" \ +  ifconfig_igb1="inet 10.0.231.2/24" \ 
- static_routes="VM3VM6 VM3VM5 VM4VM6 VM4VM5" \ +  ifconfig_igb1_ipv6="inet6 2001:db8:231::2 prefixlen 64" \ 
- route_VM3VM6="-net 10.0.56.0/24 10.0.23.3" \ +  ifconfig_igb2="inet 10.0.232.2/24" \ 
- route_VM3VM5="-net 10.0.35.0/24 10.0.23.3" \ +  ifconfig_igb2_ipv6="inet6 2001:db8:232::2 prefixlen 64" \ 
- route_VM4VM6="-net 10.0.56.0/24 10.0.24.4" \ +  static_routes="MPATH1 MPATH2" \ 
- route_VM4VM5="-net 10.0.45.0/24 10.0.24.4" \ +  route_MPATH1="-net 10.0.0.0/16 10.0.231.3" \ 
- ipv6_static_routes="VM3VM6 VM3VM5 VM4VM6 VM4VM5" \ +  route_MPATH2="-net 10.0.0.0/16 10.0.232.3" \ 
- ipv6_route_VM3VM6="2001:db8:56:: -prefixlen 64 2001:db8:23::3" \ +  ipv6_static_routes="MPATH1 MPATH2" \ 
- ipv6_route_VM3VM5="2001:db8:35:: -prefixlen 64 2001:db8:23::3" \ +  ipv6_route_MPATH1="2001:db8:: -prefixlen 32 2001:db8:231::3" \ 
- ipv6_route_VM4VM6="2001:db8:56:: -prefixlen 64 2001:db8:24::4" \ +  ipv6_route_MPATH2="2001:db8:: -prefixlen 32 2001:db8:232::3"
- ipv6_route_VM4VM5="2001:db8:45:: -prefixlen 64 2001:db8:24::4"+
 service hostname restart service hostname restart
 service netif restart service netif restart
Line 138: Line 69:
  
 <code> <code>
-[root@VM2]~# netstat -rn4 | grep 10.0.56.0 +root@R1:~ # netstat -rn4 | grep 10.0.0.0/16 
-10.0.56.0/24       10.0.24.4          UGS      vtnet2 +10.0.0.0/16        10.0.231.3         UGS        igb1 
-10.0.56.0/24       10.0.23.3          UGS      vtnet1 +10.0.0.0/16        10.0.232.3         UGS        igb2 
-[root@VM2]~# route -n get 10.0.56.0/24 + 
-   route to: 10.0.56.0 +root@R1:~ # netstat -4onW
-destination: 10.0.56.0 +
-       mask: 255.255.255.0 +
-    gateway: 10.0.24.4 +
-        fib: 0 +
-  interface: vtnet2 +
-      flags: <UP,GATEWAY,DONE,STATIC> +
- recvpipe  sendpipe  ssthresh  rtt,msec    mtu        weight    expire +
-       0         0         0         0      1500       100         0 +
-[root@VM2]~# netstat -4onW+
 Nexthop data Nexthop data
  
 Internet: Internet:
 Idx   Type         IFA                Gateway             Flags      Use Mtu         Netif     Addrif Refcnt Prepend Idx   Type         IFA                Gateway             Flags      Use Mtu         Netif     Addrif Refcnt Prepend
-4       v4/resolve 10.0.23.2          vtnet1/resolve                   0   1500     vtnet1               1 +1       v4/resolve 127.0.0.1          lo0/resolve        H             0  16384        lo0               2 
-6       v4/resolve 10.0.24.2          vtnet2/resolve                   0   1500     vtnet2               1 +2       v4/resolve 10.0.12.2          igb0/resolve                     0   1500       igb0               2 
-2       v4/resolve 10.0.12.2          vtnet0/resolve                   3   1500     vtnet0               1 +3       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0      igb0     2 
-1       v4/resolve 127.0.0.1          lo0/resolve        HS            6  16384        lo0               1 +4       v4/resolve 10.0.231.2         igb1/resolve                     0   1500       igb1               2 
-7       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0    vtnet2     1 +5       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0      igb1     2 
-5       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0    vtnet1     1 +6       v4/resolve 10.0.232.2         igb2/resolve                     0   1500       igb2               2 
-3       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0    vtnet0     1 +7       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0      igb2     2 
-9            v4/gw 10.0.24.2          10.0.24.4          GS            3   1500     vtnet2               2 +8            v4/gw 10.0.231.2         10.0.231.3         GS            0   1500       igb1               1 
-8            v4/gw 10.0.23.2          10.0.23.3          GS            0   1500     vtnet1               2 +9            v4/gw 10.0.232.2         10.0.232.3         GS            0   1500       igb2               1
-Nexthop groups data +
-BUF: 192+
  
-Internet: +root@R1:~ # netstat -6onW 
-MpIdx NHIdx Weigh Slots            Gateway Netif      Refcnt +Nexthop data 
-1      ---- ---- ----              ----      ----    1 + 
-          9   100     1          10.0.24.4    vtnet2 +Internet6: 
-          8   100     1          10.0.23.3    vtnet1+Idx   Type         IFA                           Gateway                        Flags      Use Mtu       Netif   Addrif Refcnt Prepend 
 +1       v6/resolve ::1                           lo0/resolve                   HS            0  16384      lo0             2 
 +2       v6/resolve fe80::1%lo0                   lo0/resolve                   HS            0  16384      lo0             2 
 +3       v6/resolve fe80::1%lo0                   lo0/resolve                                 0  16384      lo0             2 
 +4       v6/resolve ::1                           lo0/resolve                   HS            0  16384      lo0    igb0     3 
 +5       v6/resolve fe80::20d:b9ff:fe41:ca3c%igb0 igb0/resolve                                0   1500     igb0             3 
 +6       v6/resolve ::1                           lo0/resolve                   HS            0  16384      lo0    igb1     3 
 +7       v6/resolve fe80::20d:b9ff:fe41:ca3d%igb1 igb1/resolve                                0   1500     igb1             3 
 +8       v6/resolve ::1                           lo0/resolve                   HS            0  16384      lo0    igb2     3 
 +9       v6/resolve fe80::20d:b9ff:fe41:ca3e%igb2 igb2/resolve                                0   1500     igb2             3 
 +10           v6/gw ::1                           ::1                           GRS           0  16384      lo0             5 
 +11           v6/gw 2001:db8:231::2               2001:db8:231::3               GS            0   1500     igb1             1 
 +12           v6/gw 2001:db8:232::2               2001:db8:232::3               GS            0   1500     igb2             1
 </code> </code>
-==== VM 3 (router) ====+==== R2 (ECMP router) ====
  
-VM 3 is a simple router.+R2 is like R1, a router with ECMP: 2 static routing toward the same destination but using 2 different next-hop..
  
 <code> <code>
-sysrc hostname=VM3 \ +sysrc hostname=R2 \ 
- ifconfig_vtnet1="inet 10.0.23.3/24" \ +  gateway_enable=YES \ 
- ifconfig_vtnet3="inet 10.0.35.3/24" \ +  ipv6_gateway_enable=YES \ 
- ifconfig_vtnet1_ipv6="inet6 2001:db8:23::3 prefixlen 64" \ +  ifconfig_igb0="inet 10.0.34.3/24" \ 
- ifconfig_vtnet3_ipv6="inet6 2001:db8:35::3 prefixlen 64" \ +  ifconfig_igb0_ipv6="inet6 2001:db8:34::3 prefixlen 64" \ 
- static_routes="VM6 VM1" \ +  ifconfig_igb1="inet 10.0.231.3/24" \ 
- route_VM1="-net 10.0.12.0/24 10.0.23.2" \ +  ifconfig_igb1_ipv6="inet6 2001:db8:231::3 prefixlen 64" \ 
- route_VM6="-net 10.0.56.0/24 10.0.35.5" \ +  ifconfig_igb2="inet 10.0.232.3/24" \ 
- ipv6_static_routes="VM6 VM1" \ +  ifconfig_igb2_ipv6="inet6 2001:db8:232::3 prefixlen 64" \ 
- ipv6_route_VM1="2001:db8:12:: -prefixlen 64 2001:db8:23::2" \ +  static_routes="MPATH1 MPATH2" \ 
- ipv6_route_VM6="2001:db8:56:: -prefixlen 64 2001:db8:35::5"+  route_MPATH1="-net 10.0.0.0/16 10.0.231.4" \ 
 +  route_MPATH2="-net 10.0.0.0/16 10.0.232.4" \ 
 +  ipv6_static_routes="MPATH1 MPATH2" \ 
 +  ipv6_route_MPATH1="2001:db8:: -prefixlen 32 2001:db8:231::4" \ 
 +  ipv6_route_MPATH2="2001:db8:: -prefixlen 32 2001:db8:232::4"
 service hostname restart service hostname restart
 service netif restart service netif restart
Line 195: Line 131:
 config save config save
 </code> </code>
 +==== Server ====
  
-==== VM 4 (router) ==== +A simple host with some static routes:
- +
-VM 4 is like VM 3, a simple router.+
  
 <code> <code>
-sysrc hostname=VM4 \ +sysrc hostname=server \ 
- ifconfig_vtnet1="inet 10.0.24.4/24" \ +  gateway_enable=NO \ 
- ifconfig_vtnet3="inet 10.0.45.4/24" \ +  ipv6_gateway_enable=NO \ 
- ifconfig_vtnet1_ipv6="inet6 2001:db8:24::4 prefixlen 64" \ +  ifconfig_igb1="inet 10.0.34.4/24" \ 
- ifconfig_vtnet3_ipv6="inet6 2001:db8:45::4 prefixlen 64" \ +  ifconfig_igb1_ipv6="inet6 2001:db8:34::4 prefixlen 64" \ 
- static_routes="VM6 VM1" \ +  static_routes="LAB" \ 
- route_VM1="-net 10.0.12.0/24 10.0.24.2" \ +  route_LAB="-net 10.0.0.0/16 10.0.34.3" \ 
- route_VM6="-net 10.0.56.0/24 10.0.45.5" \ +  ipv6_static_routes="LAB" \ 
- ipv6_static_routes="VM6 VM1" \ +  ipv6_route_LAB="2001:db8:: -prefixlen 32 2001:db8:34::3"
- ipv6_route_VM1="2001:db8:12:: -prefixlen 64 2001:db8:24::2" \ +
- ipv6_route_VM6="2001:db8:56:: -prefixlen 64 2001:db8:45::5"+
 service hostname restart service hostname restart
 service netif restart service netif restart
Line 218: Line 151:
 </code> </code>
  
-==== VM 5 (ECMP router) ====+===== FRR Multipath setup =====
  
-VM 5 is like VM 2, a router with ECMP: 2 static routing toward the same destination but using 2 different next-hop..+Replacing static routes by FRR (OSPF) compiled with MULTIPATH option.
  
-<code> +==== R1 (ECMP router) ====
-sysrc hostname=VM5 \ +
- ifconfig_vtnet2="inet 10.0.35.5/24" \ +
- ifconfig_vtnet3="inet 10.0.45.5/24" \ +
- ifconfig_vtnet4="inet 10.0.56.5/24" \ +
- ifconfig_vtnet2_ipv6="inet6 2001:db8:35::5 prefixlen 64" \ +
- ifconfig_vtnet3_ipv6="inet6 2001:db8:45::5 prefixlen 64" \ +
- ifconfig_vtnet4_ipv6="inet6 2001:db8:56::5 prefixlen 64" \ +
- static_routes="VM3VM1 VM3VM2 VM4VM1 VM4VM2" \ +
- route_VM3VM1="-net 10.0.12.0/24 10.0.35.3" \ +
- route_VM3VM2="-net 10.0.23.0/24 10.0.35.3" \ +
- route_VM4VM1="-net 10.0.12.0/24 10.0.45.4" \ +
- route_VM4VM2="-net 10.0.24.0/24 10.0.45.4" \ +
- ipv6_static_routes="VM3VM1 VM3VM2 VM4VM1 VM4VM2" \ +
- ipv6_route_VM3VM1="2001:db8:12:: -prefixlen 64 2001:db8:35::3" \ +
- ipv6_route_VM3VM2="2001:db8:23:: -prefixlen 64 2001:db8:35::3" \ +
- ipv6_route_VM4VM1="2001:db8:12:: -prefixlen 64 2001:db8:45::4" \ +
- ipv6_route_VM4VM2="2001:db8:24:: -prefixlen 64 2001:db8:45::4" +
-service hostname restart +
-service netif restart +
-service routing restart +
-config save +
-</code>+
  
-==== VM 6 (server) ====+In place of static routes, OSPF with FRR is used:
  
-VM 6, like VM 1 is configured as a simple host with multiple aliases:+<code> 
 +sysrc frr_vtysh_boot="YES" \ 
 +  frr_enable="YES" \ 
 +  frr_daemons="zebra ospfd ospf6d" \ 
 +  watchfrr_flags=" -d -r /usr/sbin/servicebBfrrbBrestartbB%s -s /usr/sbin/servicebBfrrbBstartbB%s -k /usr/sbin/servicebBfrrbBstopbB%s -b bB -t 30 zebra ospfd ospf6d" \ 
 +  watchfrr_enable="YES"
  
-<code> +cat > /usr/local/etc/frr/frr.conf <EOF 
-sysrc hostname=VM6 \ +frr version 8.4.1 
- gateway_enable=NO \ +frr defaults traditional 
- ipv6_gateway_enable=NO \ +hostname R1 
- ifconfig_vtnet4="inet 10.0.56.6/24" \ +! 
- ifconfig_vtnet4_alias1="inet 10.0.56.16/32" \ +interface igb0 
- ifconfig_vtnet4_alias2="inet 10.0.56.26/32" \ + ip ospf passive 
- ifconfig_vtnet4_alias3="inet 10.0.56.36/32" \ + ipv6 ospf6 area 0.0.0.0 
- ifconfig_vtnet4_alias4="inet 10.0.56.46/32" \ + ipv6 ospf6 passive 
- ifconfig_vtnet4_alias5="inet 10.0.56.56/32" \ +exit 
- ifconfig_vtnet4_ipv6="inet6 2001:db8:56::6 prefixlen 64" \ +! 
- ifconfig_vtnet4_alias61="inet6 2001:db8:56::16 prefixlen 64" \ +interface igb1 
- ifconfig_vtnet4_alias62="inet6 2001:db8:56::26 prefixlen 64" \ + ipv6 ospf6 area 0.0.0.0 
- ifconfig_vtnet4_alias63="inet6 2001:db8:56::36 prefixlen 64" \ +exit 
- ifconfig_vtnet4_alias64="inet6 2001:db8:56::46 prefixlen 64" \ +! 
- ifconfig_vtnet4_alias65="inet6 2001:db8:56::56 prefixlen 64" \ +interface igb2 
- defaultrouter="10.0.56.5" \ + ipv6 ospf6 area 0.0.0.0 
- ipv6_defaultrouter="2001:db8:56::5" +exit 
-service hostname restart +! 
-service netif restart +router ospf 
-service routing restart + ospf router-id 1.1.1.1 
-config save+ network 10.0.12.0/24 area 0 
 + network 10.0.231.0/24 area 0 
 + network 10.0.232.0/24 area 0 
 +exit 
 +! 
 +router ospf6 
 +exit 
 +! 
 +EOF 
 +service frr start 
 +service watchfrr start
 </code> </code>
  
-==== Testing Load balancing ====+==== R2 (ECMP router) ====
  
-Flows from VM1 to VM6 should be "flow-id shared" by VM2 toward VM3 and VM4. Let's check using multiple sources and destination IP addresses. +Same as R1 with OSPF and FRR:
-Using ping record feature like with this example:+
 <code> <code>
-[root@VM1]~# ping -c1 -R -S 10.0.12.21 10.0.56.26 +sysrc frr_vtysh_boot="YES" \ 
-PING 10.0.56.26 (10.0.56.26) from 10.0.12.21: 56 data bytes +  frr_enable="YES" \ 
-64 bytes from 10.0.56.26: icmp_seq=0 ttl=61 time=0.455 ms +  frr_daemons="zebra staticd ospfd ospf6d" \ 
-RR:     10.0.24.2 +  watchfrr_flags=" -d -r /usr/sbin/servicebBfrrbBrestartbB%s -s /usr/sbin/servicebBfrrbBstartbB%s -k /usr/sbin/servicebBfrrbBstopbB%s -b bB -t 30 zebra ospfd ospf6d" \ 
-        10.0.45.4 +  watchfrr_enable="YES"
-        10.0.56.5 +
-        10.0.56.26 +
-        10.0.45.5 +
-        10.0.24.4 +
-        10.0.12.2 +
-        10.0.12.21+
  
---- 10.0.56.26 ping statistics --- +cat > /usr/local/etc/frr/frr.conf <EOF 
-1 packets transmitted, 1 packets received, 0.0% packet loss +frr version 8.4.1 
-round-trip min/avg/max/stddev = 0.455/0.455/0.455/0.000 ms+frr defaults traditional 
 +hostname R2 
 +! 
 +ip route 10.0.0.0/16 10.0.34.4 
 +ipv6 route 2001:db8::/32 2001:db8:231::4 
 +! 
 +interface igb0 
 + ip ospf passive 
 + ipv6 ospf6 area 0.0.0.0 
 + ipv6 ospf6 passive 
 +exit 
 +! 
 +interface igb1 
 + ipv6 ospf6 area 0.0.0.0 
 +exit 
 +! 
 +interface igb2 
 + ipv6 ospf6 area 0.0.0.0 
 +exit 
 +! 
 +router ospf 
 + ospf router-id 2.2.2.2 
 + redistribute static 
 + network 10.0.34.0/24 area 0 
 + network 10.0.231.0/24 area 0 
 + network 10.0.232.0/24 area 0 
 +exit 
 +! 
 +router ospf6 
 + redistribute static 
 +exit 
 +! 
 +EOF 
 +service frr start 
 +service watchfrr start
 </code> </code>
  
-^ Source ^ Destination ^ Ongoing path selected by VM2 ^ Returning path selected by VM5^ +==== Checking routes installed ====
-| 10.0.12.1 | 10.0.35.5 | VM3 | VM4 | +
-| 10.0.12.1 | 10.0.45.5 | VM4 | VM4 | +
-| 10.0.12.1 | 10.0.56.6 | VM3 | VM4 | +
-| 10.0.12.11 | 10.0.56.16 | VM3 | VM4 | +
-| 10.0.12.21 | 10.0.56.26 | VM3 | VM4 | +
-| 10.0.12.31 | 10.0.56.36 | VM3 | VM4 | +
-| 10.0.12.41 | 10.0.56.46 | VM3 | VM4 | +
-| 10.0.12.51 | 10.0.56.56 | VM3 | VM4 | +
-| 2001:db8:12::1 | 2001:db8:56::6 | error | error | +
-| 2001:db8:12::11 | 2001:db8:56::16 | error | error | +
-| 2001:db8:12::21 | 2001:db8:56::26 | error | error | +
-| 2001:db8:12::31 | 2001:db8:56::36 | error | error | +
-| 2001:db8:12::41 | 2001:db8:56::46 | error | error | +
-| 2001:db8:12::51 | 2001:db8:56::56 | error | error | +
  
-Notice inet6 bug: Cannot ping itself neither neighbor+On R1:
 <code> <code>
-[root@VM1]~# ifconfig vtnet0 inet6 +root@R1:~ # vtysh 
-vtnet0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500 +Hello, this is FRRouting (version 8.4.1). 
-        options=80028<VLAN_MTU,JUMBO_MTU,LINKSTATE> +Copyright 1996-2005 Kunihiro Ishiguro, et al.
-        inet6 fe80::5a9c:fcff:fe01:201%vtnet0 prefixlen 64 scopeid 0x1 +
-        inet6 2001:db8:12::1 prefixlen 64 +
-        inet6 2001:db8:12::11 prefixlen 64 +
-        inet6 2001:db8:12::21 prefixlen 64 +
-        inet6 2001:db8:12::31 prefixlen 64 +
-        inet6 2001:db8:12::41 prefixlen 64 +
-        inet6 2001:db8:12::51 prefixlen 64 +
-        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> +
-[root@VM1]~# ping6 -c 1 fe80::5a9c:fcff:fe01:201%vtnet0 +
-PING6(56=40+8+8 bytes) fe80::5a9c:fcff:fe01:201%vtnet0 --> fe80::5a9c:fcff:fe01:201%vtnet0+
  
---- fe80::5a9c:fcff:fe01:201%vtnet0 ping6 statistics --- +R1# sh ip route 10.0.0.0 
-1 packets transmitted, 0 packets received, 100.0% packet loss +Routing entry for 10.0.0.0/16 
-[root@VM1]~# ping6 -c 12001:db8:12::2 +  Known via "ospf", distance 110, metric 20, best 
-ping6: illegal number of packets -- 12001:db8:12::2 +  Last update 00:02:26 ago 
-[root@VM1]~# ping6 -c 1 2001:db8:12::2 +  * 10.0.231.3, via igb1, weight 1 
-PING6(56=40+8+8 bytes) 2001:db8:12::1 --> 2001:db8:12::2+  * 10.0.232.3, via igb2, weight 1
  
---- 2001:db8:12::2 ping6 statistics --- +R1# sh ipv6 route 2001:db8:: 
-1 packets transmitted, 0 packets received, 100.0% packet loss+Routing entry for 2001:db8::/32 
 +  Known via "ospf6", distance 110, metric 20, best 
 +  Last update 00:02:39 ago 
 +  * fe80::20d:b9ff:fe45:7ad5, via igb1, weight 1 
 +  * fe80::20d:b9ff:fe45:7ad6, via igb2, weight 1
 </code> </code>
  
-==== Testing Fail Over ====+===== Test Load balancing IP packets =====
  
-VM4 is the preferred hop, so shutdown this VM to check behavior:+Flows from the client to the server should be "flow-id shared" between the 2 paths. Let's check using multiple sources and destination IP addresses using pkt-gen on client and server, then using systat on R1 and R2 to check their load-distribution.
  
 +On server:
 <code> <code>
-[root@VM4]~# shutdown -p now +root@server:~ # pkt-gen -i igb1 -f rx
-Shutdown NOW!+
 </code> </code>
  
 +On client:
 <code> <code>
-[root@VM2]~# netstat -4onW +root@client:~ # pkt-gen -i igb1 -f tx -n 8000000 -l 60 -d 10.0.255.1:2000-10.0.255.254 -D 00:0d:b9:41:ca:3c -s 10.0.254.1:2000-10.0.254.254 -S 00:0d:b9:45:7f:b0 -w 4 -R 20000 
-Nexthop data+</code>
  
-Internet: +On R1: 
-Idx   Type         IFA                Gateway             Flags      Use Mtu         Netif     Addrif Refcnt Prepend +<code> 
-4       v4/resolve 10.0.23.2          vtnet1/resolve                   0   1500     vtnet1               1 +systat -ifstat -match igb0,igb1,igb2 -pps 
-6       v4/resolve 10.0.24.2          vtnet2/resolve                   0   1500     vtnet2               1 + 
-2       v4/resolve 10.0.12.2          vtnet0/resolve                  11   1500     vtnet0               1 +                    /0   /1   /2   /3   /4   /5   /6   /7   /8   /9   /10 
-1       v4/resolve 127.0.0.1          lo0/resolve        HS            6  16384        lo0               1 +     Load Average   |
-7       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0    vtnet2     1 +
-5       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0    vtnet1     1 +
-3       v4/resolve 127.0.0.1          lo0/resolve        HS            0  16384        lo0    vtnet0     1 +
-9            v4/gw 10.0.24.2          10.0.24.4          GS           10   1500     vtnet2               2 +
-8            v4/gw 10.0.23.2          10.0.23.3          GS            2   1500     vtnet1               2 +
-Nexthop groups data +
-BUF: 192+
  
-Internet: +      Interface           Traffic               Peak                Total 
-MpIdx NHIdx Weigh Slots            Gateway Netif      Refcnt +           igb2  in      0.000 Kp/s          0.000 Kp/s           71.247 Mp 
-1      ---- ---- ----              ----      ----    1 +                 out     9.762 Kp/s          9.777 Kp/s           76.892 Mp 
-          9   100     1          10.0.24.4    vtnet2 + 
-          8   100     1          10.0.23.3    vtnet1+           igb1  in      0.000 Kp/s          0.000 Kp/s           71.392 Mp 
 +                 out     9.770 Kp/s          9.771 Kp/s           80.341 Mp 
 + 
 +           igb0  in     19.533 Kp/s         19.534 Kp/s           90.007 Mp 
 +                 out     0.000 Kp/s          0.000 Kp/s            0.243 Kp 
 +                 
 </code> </code>
  
 +=> We confirm that 20 Kps entering igb0 and are equally split by exiting by igb1 and igb2
 +
 +On R2:
 <code> <code>
-[root@VM1]~# ping -c1 -R -S 10.0.12.21 10.0.56.26 +systat -ifstat -match igb0,igb1,igb2 -pps
-PING 10.0.56.26 (10.0.56.26) from 10.0.12.21: 56 data bytes+
  
---- 10.0.56.26 ping statistics --- +                    /0   /1   /2   /3   /4   /5   /6   /7   /8   /9   /10 
-1 packets transmitted, 0 packets received, 100.0% packet loss+     Load Average   | 
 + 
 +      Interface           Traffic               Peak                Total 
 +           igb2  in      9.768 Kp/s          9.771 Kp/s          300.830 Kp 
 +                 out     0.000 Kp/s          0.000 Kp/s            0.000 Kp 
 + 
 +           igb1  in      9.763 Kp/s          9.768 Kp/s          300.785 Kp 
 +                 out     0.000 Kp/s          0.000 Kp/s            0.006 Kp 
 + 
 +           igb0  in      0.000 Kp/s          0.001 Kp/s            0.240 Kp 
 +                 out    19.530 Kp/s         19.531 Kp/s          601.615 Kp
 </code> </code>
 +
 +=> R2 has no choice than receiving packets from igb1 and igb2, and forwarding them through igb0.
 +
documentation/examples/ecmp.1580064403.txt.gz · Last modified: 2020/01/26 19:46 by olivier
Except where otherwise noted, content on this wiki is licensed under the following license: BSD 2-Clause
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki