BSD Router Project

User Tools

Site Tools

Trace:
documentation:examples:aggregating_multiple_isp_links_with_mlvpn

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision		Previous revision
Next revisionBoth sides next revision
documentation:examples:aggregating_multiple_isp_links_with_mlvpn [2017/07/07 00:28] – external edit 127.0.0.1documentation:examples:aggregating_multiple_isp_links_with_mlvpn [2020/02/21 21:37] – [Virtual Lab setp] olivier
Line 13: Line 13:
 {{:documentation:examples:bsdrp-lab-mlvpn-details.png|}} {{:documentation:examples:bsdrp-lab-mlvpn-details.png|}}
  
-===== Virtual Lab setp =====+===== Virtual Lab setup =====
  
-This chapter will describe how to start each routers and configuring the 3 centrals routers.+This chapter will describe how to start each routers and configuring the 4 centrals routers.
  
 More information on these BSDRP lab scripts available on [[documentation:examples:How to build a BSDRP router lab]]. More information on these BSDRP lab scripts available on [[documentation:examples:How to build a BSDRP router lab]].
Line 22: Line 22:
  
 <code> <code>
-# ./tools/BSDRP-lab-bhyve.sh -n 5+# ./tools/BSDRP-lab-bhyve.sh -n 6
 BSD Router Project (http://bsdrp.net) - bhyve full-meshed lab script BSD Router Project (http://bsdrp.net) - bhyve full-meshed lab script
-Setting-up a virtual lab with 5 VM(s): +Setting-up a virtual lab with 6 VM(s): 
-- Working directory: /tmp/BSDRP +- Working directory: /root/BSDRP-VMs 
-- Each VM have 1 core(s) and 256M RAM+- Each VM has a total of 1 (1 cores and 1 threads) and 512M RAM 
 +- Emulated NIC: virtio-net
 - Switch mode: bridge + tap - Switch mode: bridge + tap
 - 0 LAN(s) between all VM - 0 LAN(s) between all VM
 - Full mesh Ethernet links between each VM - Full mesh Ethernet links between each VM
-VM 1 have the following NIC: +VM 1 has the following NIC: 
-- vtnet0 connected to VM 2. +- vtnet0 connected to VM 2 
-- vtnet1 connected to VM 3. +- vtnet1 connected to VM 3 
-- vtnet2 connected to VM 4. +- vtnet2 connected to VM 4 
-- vtnet3 connected to VM 5. +- vtnet3 connected to VM 5 
-VM 2 have the following NIC: +- vtnet4 connected to VM 6 
-- vtnet0 connected to VM 1. +VM 2 has the following NIC: 
-- vtnet1 connected to VM 3. +- vtnet0 connected to VM 1 
-- vtnet2 connected to VM 4. +- vtnet1 connected to VM 3 
-- vtnet3 connected to VM 5. +- vtnet2 connected to VM 4 
-VM 3 have the following NIC: +- vtnet3 connected to VM 5 
-- vtnet0 connected to VM 1. +- vtnet4 connected to VM 6 
-- vtnet1 connected to VM 2. +VM 3 has the following NIC: 
-- vtnet2 connected to VM 4. +- vtnet0 connected to VM 1 
-- vtnet3 connected to VM 5. +- vtnet1 connected to VM 2 
-VM 4 have the following NIC: +- vtnet2 connected to VM 4 
-- vtnet0 connected to VM 1. +- vtnet3 connected to VM 5 
-- vtnet1 connected to VM 2. +- vtnet4 connected to VM 6 
-- vtnet2 connected to VM 3. +VM 4 has the following NIC: 
-- vtnet3 connected to VM 5. +- vtnet0 connected to VM 1 
-VM 5 have the following NIC: +- vtnet1 connected to VM 2 
-- vtnet0 connected to VM 1. +- vtnet2 connected to VM 3 
-- vtnet1 connected to VM 2. +- vtnet3 connected to VM 5 
-- vtnet2 connected to VM 3. +- vtnet4 connected to VM 6 
-- vtnet3 connected to VM 4. +VM 5 has the following NIC: 
-For connecting to VM'serial console, you can use: +- vtnet0 connected to VM 1 
-- VM 1 : cu -l /dev/nmdm1B +- vtnet1 connected to VM 2 
-- VM 2 : cu -l /dev/nmdm2B +- vtnet2 connected to VM 3 
-- VM 3 : cu -l /dev/nmdm3B +- vtnet3 connected to VM 4 
-- VM 4 : cu -l /dev/nmdm4B +- vtnet4 connected to VM 6 
-- VM 5 : cu -l /dev/nmdm5B+VM 6 has the following NIC: 
 +- vtnet0 connected to VM 1 
 +- vtnet1 connected to VM 2 
 +- vtnet2 connected to VM 3 
 +- vtnet3 connected to VM 4 
 +To connect VM'serial console, you can use: 
 +- VM 1 : cu -l /dev/nmdm-BSDRP.1B 
 +- VM 2 : cu -l /dev/nmdm-BSDRP.2B 
 +- VM 3 : cu -l /dev/nmdm-BSDRP.3B 
 +- VM 4 : cu -l /dev/nmdm-BSDRP.4B 
 +- VM 5 : cu -l /dev/nmdm-BSDRP.5B 
 +- VM 6 : cu -l /dev/nmdm-BSDRP.6B
 </code> </code>
  
Line 251: Line 263:
  
 <code> <code>
-[root@R1]~# setfib 2 ping -c 2 10.0.45.5 +[root@VM1]~# setfib 2 ping -c 2 10.0.56.6 
-PING 10.0.45.5 (10.0.45.5): 56 data bytes +PING 10.0.56.6 (10.0.56.6): 56 data bytes 
-64 bytes from 10.0.45.5: icmp_seq=0 ttl=62 time=2.057 ms +64 bytes from 10.0.56.6: icmp_seq=0 ttl=62 time=16.473 ms 
-64 bytes from 10.0.45.5: icmp_seq=1 ttl=62 time=1.336 ms+64 bytes from 10.0.56.6: icmp_seq=1 ttl=62 time=20.017 ms
  
---- 10.0.45.5 ping statistics ---+--- 10.0.56.6 ping statistics ---
 2 packets transmitted, 2 packets received, 0.0% packet loss 2 packets transmitted, 2 packets received, 0.0% packet loss
-round-trip min/avg/max/stddev = 1.336/1.696/2.057/0.361 ms +round-trip min/avg/max/stddev = 16.473/18.245/20.017/1.772 ms 
-[root@R1]~# setfib 3 ping -c 2 10.0.45.5 +[root@VM1]~# setfib 3 ping -c 2 10.0.56.6 
-PING 10.0.45.5 (10.0.45.5): 56 data bytes +PING 10.0.56.6 (10.0.56.6): 56 data bytes 
-64 bytes from 10.0.45.5: icmp_seq=0 ttl=62 time=1.806 ms +64 bytes from 10.0.56.6: icmp_seq=0 ttl=62 time=18.202 ms 
-64 bytes from 10.0.45.5: icmp_seq=1 ttl=62 time=1.852 ms+64 bytes from 10.0.56.6: icmp_seq=1 ttl=62 time=11.193 ms
  
---- 10.0.45.5 ping statistics ---+--- 10.0.56.6 ping statistics ---
 2 packets transmitted, 2 packets received, 0.0% packet loss 2 packets transmitted, 2 packets received, 0.0% packet loss
-round-trip min/avg/max/stddev = 1.806/1.829/1.852/0.023 ms+round-trip min/avg/max/stddev = 11.193/14.698/18.202/3.504 ms 
 +[root@VM1]~# setfib 4 ping -c 2 10.0.56.6 
 +PING 10.0.56.6 (10.0.56.6): 56 data bytes 
 +64 bytes from 10.0.56.6: icmp_seq=0 ttl=62 time=10.973 ms 
 +64 bytes from 10.0.56.6: icmp_seq=1 ttl=62 time=14.465 ms
  
 +--- 10.0.56.6 ping statistics ---
 +2 packets transmitted, 2 packets received, 0.0% packet loss
 +round-trip min/avg/max/stddev = 10.973/12.719/14.465/1.746 ms
 </code> </code>
  
Line 274: Line 293:
 Test bandwidth of each link by starting an iperf on MLVPN server: Test bandwidth of each link by starting an iperf on MLVPN server:
 <code> <code>
-[root@R5]# iperf -s+[root@VM6]# iperf3 -s
 </code> </code>
  
 Then from the MLVPN client, test bandwidth for each ISP links: Then from the MLVPN client, test bandwidth for each ISP links:
 <code> <code>
-[root@R1]~# setfib 2 iperf -c 10.0.45.5 
------------------------------------------------------------- 
-Client connecting to 10.0.45.5, TCP port 5001 
-TCP window size: 32.5 KByte (default) 
------------------------------------------------------------- 
-[  3] local 10.0.12.1 port 59888 connected with 10.0.45.5 port 5001 
-[ ID] Interval       Transfer     Bandwidth 
-[  3]  0.0-10.1 sec  11.8 MBytes  9.75 Mbits/sec 
  
-[root@R1]~# setfib 3 iperf -c 10.0.45.5 +[root@VM1]~# setfib 2 iperf3 -c 10.0.56.6 
------------------------------------------------------------- +(...) 
-Client connecting to 10.0.45.5, TCP port 5001 +[ ID] Interval           Transfer     Bitrate         Retr 
-TCP window size: 32.5 KByte (default) +[  5]   0.00-10.00  sec  11.5 MBytes  9.62 Mbits/sec    0             sender 
------------------------------------------------------------- +[  5]   0.00-10.06  sec  11.4 MBytes  9.53 Mbits/sec                  receiver
-[  3] local 10.0.13.1 port 53380 connected with 10.0.45.5 port 5001 +
-[ ID] Interval       Transfer     Bandwidth +
-[  3]  0.0-10.1 sec  11.8 MBytes  9.75 Mbits/sec+
  
 +[root@VM1]~# setfib 3 iperf3 -c 10.0.56.6
 +(...)
 +[ ID] Interval           Transfer     Bitrate         Retr
 +[  5]   0.00-10.00  sec  11.4 MBytes  9.57 Mbits/sec    3             sender
 +[  5]   0.00-10.06  sec  11.4 MBytes  9.47 Mbits/sec                  receiver
 +
 +
 +[root@VM1]~# setfib 4 iperf3 -c 10.0.56.6
 +Connecting to host 10.0.56.6, port 5201
 +(...)
 +[ ID] Interval           Transfer     Bitrate         Retr
 +[  5]   0.00-10.00  sec  11.5 MBytes  9.62 Mbits/sec    0             sender
 +[  5]   0.00-10.06  sec  11.4 MBytes  9.53 Mbits/sec                  receiver
 </code> </code>
  
Line 304: Line 325:
 MLVPN can be started in debug mode:  MLVPN can be started in debug mode: 
 <code> <code>
-[root@R1]# mlvpn --debug -n mlvpn -u mlvpn +[root@VM1]~# mlvpn --debug -n mlvpn -u mlvpn --config /usr/local/etc/mlvpn/mlvpn.conf 
-2016-04-19T23:48:21 [INFO/config] new password set +2020-02-21T21:25:12 [INFO/config] new password set 
-2016-04-19T23:48:21 [INFO/config] dsl2 tunnel added +2020-02-21T21:25:12 [INFO/config] dsl2 tunnel added 
-2016-04-19T23:48:21 [INFO/config] dsl3 tunnel added +2020-02-21T21:25:12 [INFO/config] dsl3 tunnel added 
-2016-04-19T23:48:21 [INFO] created interface `tun0' +2020-02-21T21:25:12 [INFO/config] dsl4 tunnel added 
-2016-04-19T23:48:21 [INFO] dsl2 bind to 10.0.12.1 +2020-02-21T21:25:12 [INFO] created interface `tun0' 
-2016-04-19T23:48:21 [INFO] dsl3 bind to 10.0.13.1 +2020-02-21T21:25:12 [INFO] dsl2 bind to 10.0.12.1 
-2016-04-19T23:48:21 [INFO/protocol] dsl3 authenticated +2020-02-21T21:25:12 [INFO] dsl3 bind to 10.0.13.1 
-2016-04-19T23:48:21 [INFO/protocol] dsl2 authenticated+2020-02-21T21:25:12 [INFO] dsl4 bind to 10.0.14.1 
 +2020-02-21T21:25:12 [INFO/protocol] dsl2 authenticated 
 +2020-02-21T21:25:12 [INFO/protocol] dsl3 authenticated 
 +2020-02-21T21:25:12 [INFO/protocol] dsl4 authenticated
 </code> </code>
  
 tun interface need to be check (correct IP address and non-1500 MTU): tun interface need to be check (correct IP address and non-1500 MTU):
 <code> <code>
-[root@R1]# ifconfig tun0+[root@VM1]~# ifconfig tun0
 tun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1452 tun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1452
         options=80000<LINKSTATE>         options=80000<LINKSTATE>
-        inet6 fe80::5a9c:fcff:fe01:201%tun0 prefixlen 64 scopeid 0x7 +        inet6 fe80::5a9c:fcff:fe01:201%tun0 prefixlen 64 scopeid 0x9 
-        inet 10.0.15.1 --> 10.0.15.5 netmask 0xfffffffc+        inet 10.0.16.1 --> 10.0.16.2 netmask 0xfffffffc 
 +        groups: tun
         nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>         nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
-        Opened by PID 2326+        Opened by PID 92891
 </code> </code>
  
 And static route(s) needs to be installed (10.5.5.5/32 in this example): And static route(s) needs to be installed (10.5.5.5/32 in this example):
 <code> <code>
-[root@R1]~# netstat -rn4 +[root@VM1]~# route get 10.6.6.6 
-Routing tables +   route to: 10.6.6.6 
- +destination: 10.6.6.6 
-Internet: +       mask: 255.255.255.255 
-Destination        Gateway            Flags      Netif Expire +    gateway: 10.0.16.2 
-10.0.12.0/24       link#1             U        vtnet0 +        fib: 0 
-10.0.13.0/24       link#2             U        vtnet1 +  interface: tun0 
-10.0.15.1          link#7             UHS         lo0 +      flags: <UP,GATEWAY,DONE,STATIC> 
-10.0.15.5          link#7             UH         tun0 + recvpipe  sendpipe  ssthresh  rtt,msec    mtu        weight    expire 
-10.5.5.5/32        10.0.15.5          UGS        tun0 +       0         0         0         0      1452         1         0
-127.0.0.1          link#6             UH          lo0+
 </code> </code>
 ==== Aggregated bandwidth ==== ==== Aggregated bandwidth ====
Line 345: Line 369:
  
 <code> <code>
-[root@R1]# iperf --bind 10.1.1.1 -c 10.5.5.5 -t 60 +[root@VM1]~# iperf3 -B 10.1.1.1 -c 10.6.6.6 
------------------------------------------------------------- +(...) 
-Client connecting to 10.5.5.5, TCP port 5001 +[ ID] Interval           Transfer     Bitrate         Retr 
-Binding to local address 10.1.1.1 +[  5]   0.00-10.00  sec  7.89 MBytes  6.62 Mbits/sec  428             sender 
-TCP window size: 32.3 KByte (default) +[  5]   0.00-10.01  sec  7.85 MBytes  6.58 Mbits/sec                  receiver
------------------------------------------------------------- +
-[  3] local 10.1.1.1 port 5001 connected with 10.5.5.5 port 5001 +
-[ ID] Interval       Transfer     Bandwidth +
-[  3]  0.0-60.0 sec   129 MBytes  18.1 Mbits/sec+
 </code> </code>
 +
 +Ouch, not expected performance
documentation/examples/aggregating_multiple_isp_links_with_mlvpn.txt · Last modified: 2020/02/21 21:42 by olivier
Except where otherwise noted, content on this wiki is licensed under the following license: BSD 2-Clause
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki