documentation:examples:ecmp
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
documentation:examples:ecmp [2020/09/21 13:00] – [Testing Load balancing] olivier | documentation:examples:ecmp [2022/12/11 18:39] – [R2 (ECMP router)] olivier | ||
---|---|---|---|
Line 1: | Line 1: | ||
====== Equal-cost multi-path routing (ECMP) ====== | ====== Equal-cost multi-path routing (ECMP) ====== | ||
- | This lab is testing new ECMP routing code from [[https:// | + | This lab need a FreeBSD 13-head r366390 minimum ([[https:// |
===== Presentation ===== | ===== Presentation ===== | ||
Line 20: | Line 20: | ||
===== Static routing setup ===== | ===== Static routing setup ===== | ||
- | ==== VM 1 (client) | + | ==== Client |
- | VM1 is configured as a simple host with multiples aliases: | + | A simple host with static routes: |
< | < | ||
- | sysrc hostname=VM1 \ | + | sysrc hostname=client |
gateway_enable=NO \ | gateway_enable=NO \ | ||
ipv6_gateway_enable=NO \ | ipv6_gateway_enable=NO \ | ||
- | ifconfig_igb1=" | + | ifconfig_igb1=" |
- | ifconfig_igb1_alias1=" | + | ifconfig_igb1_ipv6=" |
- | ifconfig_igb1_alias2=" | + | static_routes=" |
- | ifconfig_igb1_alias3=" | + | route_LAB=" |
- | ifconfig_igb1_alias4=" | + | ipv6_static_routes=" |
- | ifconfig_igb1_alias5=" | + | ipv6_route_LAB=" |
- | ifconfig_igb1_ipv6=" | + | |
- | ifconfig_igb1_alias61=" | + | |
- | ifconfig_igb1_alias62=" | + | |
- | ifconfig_igb1_alias63=" | + | |
- | ifconfig_igb1_alias64=" | + | |
- | ifconfig_igb1_alias65=" | + | |
- | static_routes=" | + | |
- | route_LAB=" | + | |
- | ipv6_static_routes=" | + | |
- | ipv6_route_LAB=" | + | |
service hostname restart | service hostname restart | ||
service netif restart | service netif restart | ||
Line 50: | Line 40: | ||
</ | </ | ||
- | ==== VM 2 (ECMP router) ==== | + | ==== R1 (ECMP router) ==== |
- | VM 2 is a router with ECMP: 2 static routes toward the same destination but using 2 different next-hop. | + | R1 is a router with ECMP: 2 static routes toward the same destination but using 2 different next-hop. |
< | < | ||
- | sysrc hostname=VM2 \ | + | |
+ | sysrc hostname=R1 \ | ||
gateway_enable=YES \ | gateway_enable=YES \ | ||
ipv6_gateway_enable=YES \ | ipv6_gateway_enable=YES \ | ||
- | ifconfig_igb0=" | + | ifconfig_igb0=" |
- | ifconfig_igb0_ipv6=" | + | ifconfig_igb0_ipv6=" |
- | ifconfig_igb1=" | + | ifconfig_igb1=" |
- | ifconfig_igb1_ipv6=" | + | ifconfig_igb1_ipv6=" |
- | ifconfig_igb2=" | + | ifconfig_igb2=" |
- | ifconfig_igb2_ipv6=" | + | ifconfig_igb2_ipv6=" |
static_routes=" | static_routes=" | ||
- | route_MPATH1=" | + | route_MPATH1=" |
- | route_MPATH2=" | + | route_MPATH2=" |
ipv6_static_routes=" | ipv6_static_routes=" | ||
- | ipv6_route_MPATH1=" | + | ipv6_route_MPATH1=" |
- | ipv6_route_MPATH2=" | + | ipv6_route_MPATH2=" |
service hostname restart | service hostname restart | ||
service netif restart | service netif restart | ||
Line 79: | Line 70: | ||
< | < | ||
- | [root@VM2]~# # netstat -rn4 | grep 10.0.0.0/ | + | root@R1:~ # netstat -rn4 | grep 10.0.0.0/ |
- | 10.0.0.0/ | + | 10.0.0.0/ |
- | 10.0.0.0/ | + | 10.0.0.0/ |
- | [root@VM2]~# route -n get 10.0.0.0/ | + | root@R1:~ # netstat -4onW |
- | route to: 10.0.0.0 | + | |
- | destination: | + | |
- | mask: 255.255.0.0 | + | |
- | gateway: 10.0.112.2 | + | |
- | fib: 0 | + | |
- | interface: igb1 | + | |
- | flags: < | + | |
- | | + | |
- | | + | |
- | + | ||
- | [root@VM2]~# netstat -4onW | + | |
Nexthop data | Nexthop data | ||
Internet: | Internet: | ||
Idx | Idx | ||
- | 1 | + | 1 |
- | 2 | + | 2 |
- | 3 | + | 3 |
- | 4 | + | 4 |
- | 5 | + | 5 |
- | 6 | + | 6 |
- | 7 | + | 7 |
- | 8 v4/gw 10.0.112.1 10.0.112.2 GS 0 | + | 8 v4/gw 10.0.231.2 10.0.231.3 GS 0 |
- | 9 v4/gw 10.0.212.1 10.0.212.2 GS 0 | + | 9 v4/gw 10.0.232.2 10.0.232.3 GS 0 |
- | + | ||
- | [root@VM2]~# | + | |
- | 2001: | + | |
- | 2001: | + | |
- | + | ||
- | [root@VM2]~# | + | |
- | route to: 2001: | + | |
- | destination: | + | |
- | mask: ffff: | + | |
- | gateway: 2001: | + | |
- | fib: 0 | + | |
- | interface: igb2 | + | |
- | flags: < | + | |
- | | + | |
- | | + | |
- | [root@VM2]~# netstat -6onW | + | root@R1:~ # netstat -6onW |
Nexthop data | Nexthop data | ||
Internet6: | Internet6: | ||
Idx | Idx | ||
- | 1 | + | 1 |
- | 2 | + | 2 |
- | 3 | + | 3 |
- | 4 | + | 4 |
- | 5 | + | 5 |
- | 6 | + | 6 |
- | 7 | + | 7 |
- | 8 | + | 8 |
- | 9 v6/resolve 2001: | + | 9 |
- | 10 | + | 10 v6/gw ::1 :: |
- | 11 v6/resolve ::1 | + | 11 v6/gw 2001:db8:231::2 2001:db8:231::3 GS 0 |
- | 12 v6/gw ::1 :: | + | 12 v6/gw 2001:db8:232::2 2001:db8:232::3 GS 0 |
- | 13 v6/gw 2001:db8:112::1 2001:db8:112::2 GS 0 | + | |
- | 14 v6/gw 2001:db8:212::1 2001:db8:212::2 GS | + | |
- | 15 v6/resolve 2001: | + | |
</ | </ | ||
+ | ==== R2 (ECMP router) ==== | ||
- | + | R2 is like R1, a router with ECMP: 2 static routing toward the same destination but using 2 different next-hop.. | |
- | Look like this router will prefer igb1 for inet4 and igb2 for inet6. | + | |
- | + | ||
- | ==== VM 5 (ECMP router) ==== | + | |
- | + | ||
- | VM 5 is like VM 2, a router with ECMP: 2 static routing toward the same destination but using 2 different next-hop.. | + | |
< | < | ||
- | sysrc hostname=VM5 \ | + | sysrc hostname=R2 \ |
gateway_enable=YES \ | gateway_enable=YES \ | ||
ipv6_gateway_enable=YES \ | ipv6_gateway_enable=YES \ | ||
- | ifconfig_igb0=" | + | ifconfig_igb0=" |
- | ifconfig_igb0_ipv6=" | + | ifconfig_igb0_ipv6=" |
- | ifconfig_igb1=" | + | ifconfig_igb1=" |
- | ifconfig_igb1_ipv6=" | + | ifconfig_igb1_ipv6=" |
- | ifconfig_igb2=" | + | ifconfig_igb2=" |
- | ifconfig_igb2_ipv6=" | + | ifconfig_igb2_ipv6=" |
- | static_routes=" | + | static_routes=" |
- | | + | |
- | | + | |
- | ipv6_static_routes=" | + | route_SRC1=" |
- | ipv6_route_MPATH1=" | + | route_SRC2=" |
- | ipv6_route_MPATH2=" | + | ipv6_static_routes=" |
+ | ipv6_route_MPATH1=" | ||
+ | ipv6_route_MPATH2=" | ||
+ | ipv6_route_SRC1=" | ||
+ | ipv6_route_SRC2=" | ||
service hostname restart | service hostname restart | ||
service netif restart | service netif restart | ||
Line 174: | Line 136: | ||
config save | config save | ||
</ | </ | ||
+ | ==== Server ==== | ||
+ | |||
+ | A simple host with some static routes: | ||
- | And checking: | ||
< | < | ||
- | # route get 10.0.0.0/16 | + | sysrc hostname=server \ |
- | route to: 10.0.0.0 | + | gateway_enable=NO \ |
- | destination: | + | ipv6_gateway_enable=NO \ |
- | mask: 255.255.0.0 | + | ifconfig_igb1=" |
- | gateway: | + | |
- | fib: 0 | + | static_routes=" |
- | | + | route_12=" |
- | flags: < | + | |
- | recvpipe | + | route_232=" |
- | 0 | + | |
+ | | ||
+ | | ||
+ | ipv6_route_232=" | ||
+ | service hostname restart | ||
+ | service netif restart | ||
+ | service routing restart | ||
+ | config save | ||
+ | </ | ||
+ | ===== FRR Multipath setup ===== | ||
- | # route -6 get 2001:db8::/32 | + | Replacing static routes by FRR (OSPF) compiled with MULTIPATH option. |
- | route to: 2001:db8:: | + | |
- | destination: | + | ==== R1 (ECMP router) ==== |
- | mask: ffff:ffff:: | + | |
- | | + | In place of static routes, OSPF with FRR is used: |
- | | + | |
- | interface: igb1 | + | < |
- | | + | sysrc frr_vtysh_boot=" |
- | recvpipe | + | frr_enable=" |
- | | + | frr_daemons=" |
- | | + | watchfrr_flags=" |
+ | | ||
+ | |||
+ | cat > / | ||
+ | frr version 8.4.1 | ||
+ | frr defaults traditional | ||
+ | hostname R1 | ||
+ | ! | ||
+ | interface igb0 | ||
+ | ip ospf passive | ||
+ | ipv6 ospf6 area 0.0.0.0 | ||
+ | ipv6 ospf6 passive | ||
+ | exit | ||
+ | ! | ||
+ | interface igb1 | ||
+ | ipv6 ospf6 area 0.0.0.0 | ||
+ | exit | ||
+ | ! | ||
+ | interface igb2 | ||
+ | ipv6 ospf6 area 0.0.0.0 | ||
+ | exit | ||
+ | ! | ||
+ | router ospf | ||
+ | ospf router-id 1.1.1.1 | ||
+ | | ||
+ | | ||
+ | | ||
+ | exit | ||
+ | ! | ||
+ | router ospf6 | ||
+ | exit | ||
+ | ! | ||
+ | EOF | ||
+ | service frr start | ||
+ | service watchfrr start | ||
</ | </ | ||
- | Look like this router | + | ==== R2 (ECMP router) ==== |
- | ==== VM 6 (server) ==== | + | Same as R1 with OSPF and FRR: |
+ | < | ||
+ | sysrc frr_vtysh_boot=" | ||
+ | frr_enable=" | ||
+ | frr_daemons="zebra staticd ospfd ospf6d" | ||
+ | watchfrr_flags=" -d -r / | ||
+ | watchfrr_enable=" | ||
- | VM 6, like VM 1 is configured as a simple host with multiple aliases: | + | cat > / |
+ | frr version 8.4.1 | ||
+ | frr defaults traditional | ||
+ | hostname R2 | ||
+ | ! | ||
+ | ip route 10.0.0.0/16 10.0.34.4 | ||
+ | ipv6 route 2001:db8::/32 2001: | ||
+ | ! | ||
+ | interface igb0 | ||
+ | ip ospf passive | ||
+ | ipv6 ospf6 area 0.0.0.0 | ||
+ | ipv6 ospf6 passive | ||
+ | exit | ||
+ | ! | ||
+ | interface igb1 | ||
+ | ipv6 ospf6 area 0.0.0.0 | ||
+ | exit | ||
+ | ! | ||
+ | interface igb2 | ||
+ | ipv6 ospf6 area 0.0.0.0 | ||
+ | exit | ||
+ | ! | ||
+ | router ospf | ||
+ | ospf router-id 2.2.2.2 | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | exit | ||
+ | ! | ||
+ | router ospf6 | ||
+ | | ||
+ | exit | ||
+ | ! | ||
+ | EOF | ||
+ | service frr start | ||
+ | service watchfrr start | ||
+ | </ | ||
+ | ==== Checking routes installed ==== | ||
+ | |||
+ | On R1: | ||
< | < | ||
- | sysrc hostname=VM6 \ | + | root@R1:~ # vtysh |
- | | + | Hello, this is FRRouting (version 8.4.1). |
- | | + | Copyright 1996-2005 Kunihiro Ishiguro, et al. |
- | | + | |
- | | + | R1# sh ip route 10.0.34.0/24 |
- | | + | Routing entry for 10.0.34.0/24 |
- | | + | |
- | | + | |
- | | + | |
- | | + | |
- | | + | |
- | | + | R1# sh ipv6 route 2001:db8:34::/64 |
- | | + | Routing entry for 2001:db8:34::/64 |
- | | + | |
- | | + | Last update 00:02:15 ago |
- | | + | * fe80::20d:b9ff:fe45:7ad5, via igb1, weight 1 |
- | | + | |
- | | + | |
- | | + | route1# sh ipv6 route 2001: |
- | service hostname restart | + | Routing entry for 2001: |
- | service netif restart | + | |
- | service routing restart | + | |
- | config save | + | |
+ | | ||
</ | </ | ||
- | ==== Testing | + | ===== Test Load balancing |
- | Flows from the client to the server should be " | + | Flows from the client to the server should be " |
+ | |||
+ | On server: | ||
+ | < | ||
+ | root@server: | ||
+ | </ | ||
+ | |||
+ | On client: | ||
+ | < | ||
+ | root@client: | ||
+ | </ | ||
+ | |||
+ | On R1: | ||
+ | < | ||
+ | systat -ifstat -match igb0, | ||
+ | |||
+ | /0 / | ||
+ | Load Average | ||
+ | |||
+ | Interface | ||
+ | | ||
+ | | ||
+ | |||
+ | | ||
+ | | ||
+ | |||
+ | | ||
+ | | ||
+ | |||
+ | </ | ||
+ | |||
+ | => We confirm that 20 Kps entering igb0 and are equally split by exiting by igb1 and igb2 | ||
+ | |||
+ | On R2: | ||
+ | < | ||
+ | systat -ifstat -match igb0, | ||
+ | |||
+ | /0 / | ||
+ | Load Average | ||
+ | |||
+ | Interface | ||
+ | | ||
+ | | ||
+ | |||
+ | | ||
+ | | ||
+ | |||
+ | | ||
+ | | ||
+ | </ | ||
- | ^ Source ^ Destination ^ Ongoing path selected by VM2 ^ Returning path selected by VM5^ | + | => R2 has no choice than receiving packets from igb1 and igb2, and forwarding them through igb0. |
- | | 10.0.31.3 | 10.0.24.4 | igb1 | igb2 | | + | |
- | | 10.0.31.13 | 10.0.24.14 | igb1 | igb1 | | + | |
- | | 10.0.31.23 | 10.0.24.24 | igb1 | igb2 | | + | |
- | | 10.0.31.33 | 10.0.24.34 | igb1 | igb2 | | + | |
- | | 10.0.31.43 | 10.0.24.44 | igb1 | igb1 | | + | |
- | | 10.0.31.43 | 10.0.24.44 | igb1 | igb2 | | + | |
- | | 2001: | + | |
- | | 2001: | + | |
- | | 2001: | + | |
- | | 2001: | + | |
- | | 2001: | + | |
- | | 2001: | + | |
documentation/examples/ecmp.txt · Last modified: 2024/03/28 23:19 by olivier