User Tools

Site Tools


documentation:examples:ipsec_performance_of_a_netgate_rcc-ve_4860

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

documentation:examples:ipsec_performance_of_a_netgate_rcc-ve_4860 [2017/09/04 01:23] (current)
Line 1: Line 1:
 +====== IPSec performance lab of Netgate RCC-VE 4860 ======
 +{{description>​IPSec performance lab of Netgate RCC-VE 4860}}
  
 +===== Hardware detail ======
 +
 +This lab will test a [[http://​store.netgate.com/​ADI/​RCC-VE-4860.aspx|Netgate RCC-VE 4860]] ([[Netgate RCC-VE 4860|dmesg]]):​
 +   * Quad cores Intel Atom C2558 (2.40GHz)
 +     * AES-NI supporting AES-CBC,​AES-XTS,​AES-GCM,​AES-ICM
 +   * 2 Gigabit Intel i211
 +   * 4 Gigabit Intel i350
 +   * 8Gb of RAM
 +===== Method used =====
 +
 +The benchmarking method used here is detailed in [[documentation:​examples:​Setting up a VPN (IPSec, GRE, etc...) performance benchmark lab]].
 +
 +==== Diagram ====
 +
 +<​code>​
 ++---------------------+ ​  ​+-------------------------------------+ ​   +----------------------------------------+
 +|          R1         ​| ​  ​| ​   Netgate RCC-VE 4860 (AES-NI) ​    ​| ​   |                     ​R3 ​                |
 +|   ​Packet generator ​ |   ​| ​          ​Device under Test         ​| ​   |              IPSec endpoint ​           |
 +|     and receiver ​   |   ​| ​                                    ​| ​   |                 ​(AES-NI) ​              |
 +|                     ​| ​  ​| ​                                    ​| ​   |                                        |
 +|igb2: 198.18.0.201/​24|=>​=| igb2: 198.18.0.209/​24 ​              ​| ​   |                                        |
 +|       ​2001:​2::​201/​64| ​  | 2001:​2::​209/​64 ​                     |    |                                        |
 +|    00:​1b:​21:​d4:​3f:​2a| ​  | 00:​08:​a2:​09:​33:​da ​                  ​| ​   |                                        |
 +|                     ​| ​  ​| ​                                    ​| ​   |                                        |
 +|                     ​| ​  ​| ​              igb3: 198.18.1.209/​24 |==>=| igb2: 198.18.1.203/​24 ​                 |
 +|                     ​| ​  ​| ​                 2001:​2:​0:​1::​209/​64 |    |    2001:​2:​0:​1::​203/​64 ​                 |
 +|                     ​| ​  ​| ​                  ​00:​08:​a2:​09:​33:​db |    |     ​00:​1b:​21:​c4:​95:​7a ​                 |
 +|                     ​| ​  ​| ​                                    ​| ​   |                                        |
 +|                     ​| ​  ​| ​             static routes ​         |    |             ​static routes ​             |
 +|                     ​| ​  ​| ​    ​198.19.0.0/​16 => 198.18.1.203 ​  ​| ​   |     ​198.19.0.0/​16 => 198.19.0.201 ​     |
 +|                     ​| ​  ​| ​    ​198.18.0.0/​16 => 198.18.0.201 ​  ​| ​   |     ​198.18.0.0/​16 => 198.18.1.209 ​     |
 +|                     ​| ​  ​| ​      ​2001:​2::/​49 => 2001:​2::​201 ​   |    |       ​2001:​2::/​49 => 2001:​2:​0:​1::​209 ​  |
 +|                     ​| ​  ​|2001:​2:​0:​8000::/​49 => 2001:​2:​0:​1::​203| ​   | 2001:​2:​0:​8000::/​49=>​2001:​2:​0:​8000::​201 |
 +|                     ​| ​  ​| ​                                    ​| ​   |                                        |
 +|igb3: 198.19.0.201/​24| ​  ​| ​                                    ​| ​   |         igb3: 198.19.0.203/​24 ​         |
 +|2001:​2:​0:​8000::​201/​64| ​  ​| ​                                    ​| ​   |         ​2001:​2:​0:​8000::​203/​64 ​         |
 +|   ​00:​1b:​21:​d4:​3f:​2b |   ​| ​                                    ​| ​   |          00:​1b:​21:​c4:​95:​7b ​            |
 ++---------------------+ ​  ​+-------------------------------------+ ​   +----------------------------------------+
 +          ||                                                                           ||
 +   ==================================<​============================================
 +</​code>​
 +===== Devices configuration =====
 +
 +
 +
 +==== Netgate (DUT) ====
 +
 +Configure IP address, routes and static IPSec:
 +
 +<​code>​
 +# IPv4 router
 +gateway_enable="​YES"​
 +ifconfig_igb2="​198.18.0.209/​24 -tso4 -tso6 -lro"
 +ifconfig_igb3="​198.18.1.209/​24 -tso4 -tso6 -lro"
 +static_routes="​generator receiver"​
 +route_generator="​-net 198.18.0.0/​16 198.18.0.201"​
 +route_receiver="​-net 198.19.0.0/​16 198.18.1.203"​
 +static_arp_pairs="​receiver generator"​
 +static_arp_generator="​198.18.0.201 00:​1b:​21:​d4:​3f:​2a"​
 +static_arp_receiver="​198.18.1.203 00:​1b:​21:​c4:​95:​7a"​
 +
 +# IPv6 router
 +ipv6_gateway_enable="​YES"​
 +ipv6_activate_all_interfaces="​YES"​
 +ifconfig_igb2_ipv6="​inet6 2001:2::209 prefixlen 64"
 +ifconfig_igb3_ipv6="​inet6 2001:​2:​0:​1::​209 prefixlen 64"
 +ipv6_static_routes="​generator receiver"​
 +ipv6_route_generator="​2001:​2::​ -prefixlen 49 2001:​2::​201"​
 +ipv6_route_receiver="​2001:​2:​0:​8000::​ -prefixlen 49 2001:​2:​0:​1::​203"​
 +static_ndp_pairs="​receiver generator"​
 +static_ndp_generator="​2001:​2::​201 00:​1b:​21:​d4:​3f:​2a"​
 +static_ndp_receiver="​2001:​2:​0:​1::​203 00:​1b:​21:​c4:​95:​7a"​
 +
 +# Enabling IPSec
 +ipsec_enable="​YES"​
 +
 +# Enabling AES-NI
 +kld_list="​aesni"​
 +</​code>​
 +
 +/​etc/​ipsec.conf :
 +<​code>​
 +flush;
 +spdflush;
 +spdadd 198.18.0.0/​16 198.19.0.0/​16 any -P out ipsec esp/​tunnel/​198.18.1.209-198.18.1.203/​require;​
 +spdadd 198.19.0.0/​16 198.18.0.0/​16 any -P in ipsec esp/​tunnel/​198.18.1.203-198.18.1.209/​require;​
 +add 198.18.1.203 198.18.1.209 esp 0x1000 -E aes-gcm-16 "​12345678901234567890";​
 +add 198.18.1.209 198.18.1.203 esp 0x1001 -E aes-gcm-16 "​12345678901234567890";​
 +spdadd 2001:2::/49 2001:​2:​0:​8000::/​49 any -P out ipsec esp/​tunnel/​2001:​2:​0:​1::​209-2001:​2:​0:​1::​203/​require;​
 +spdadd 2001:​2:​0:​8000::/​49 2001:2::/49 any -P in ipsec esp/​tunnel/​2001:​2:​0:​1::​203-2001:​2:​0:​1::​209/​require;​
 +add 2001:​2:​0:​1::​203 2001:​2:​0:​1::​209 esp 0x1002 -E aes-gcm-16 "​12345678901234567890";​
 +add 2001:​2:​0:​1::​209 2001:​2:​0:​1::​203 esp 0x1003 -E aes-gcm-16 "​12345678901234567890";​
 +</​code>​
 +
 +==== R3 (Reference device) ====
 +
 +Configure IP address, routes and static IPSec.
 +/​etc/​rc.conf:​
 +
 +<​code>​
 +# IPv4 router
 +gateway_enable="​YES"​
 +ifconfig_igb2="​inet 198.18.1.203/​24"​
 +ifconfig_igb3="​inet 198.19.0.203/​24"​
 +
 +static_routes="​generator receiver"​
 +route_generator="​-net 198.18.0.0/​16 198.18.1.209"​
 +route_receiver="​-net 198.19.0.0/​16 198.19.0.201"​
 +static_arp_pairs="​receiver generator"​
 +static_arp_generator="​198.18.1.209 00:​08:​a2:​09:​33:​db"​
 +static_arp_receiver="​198.19.0.201 00:​1b:​21:​d4:​3f:​2b"​
 +
 +# IPv6 router
 +ipv6_gateway_enable="​YES"​
 +ipv6_activate_all_interfaces="​YES"​
 +ifconfig_igb2_ipv6="​inet6 2001:​2:​0:​1::​203 prefixlen 64"
 +ifconfig_igb3_ipv6="​inet6 2001:​2:​0:​8000::​203 prefixlen 64"
 +
 +ipv6_static_routes="​generator receiver"​
 +ipv6_route_generator="​2001:​2::​ -prefixlen 49 2001:​2:​0:​1::​209"​
 +ipv6_route_receiver="​2001:​2:​0:​8000::​ -prefixlen 49 2001:​2:​0:​8000::​201"​
 +static_ndp_pairs="​receiver generator"​
 +static_ndp_generator="​2001:​2:​0:​1::​209 00:​08:​a2:​09:​33:​db"​
 +static_ndp_receiver="​2001:​2:​0:​8000::​201 00:​1b:​21:​d4:​3f:​2b"​
 +
 +# Enabling IPSec
 +kld_list="​aesni"​
 +ipsec_enable="​YES"​
 +</​code>​
 +
 +/​etc/​ipsec.conf:​
 +
 +<​code>​
 +flush;
 +spdflush;
 +spdadd 198.18.0.0/​16 198.19.0.0/​16 any -P in ipsec esp/​tunnel/​198.18.1.209-198.18.1.203/​require;​
 +spdadd 198.19.0.0/​16 198.18.0.0/​16 any -P out ipsec esp/​tunnel/​198.18.1.203-198.18.1.209/​require;​
 +add 198.18.1.203 198.18.1.209 esp 0x1000 -E aes-gcm-16 "​12345678901234567890";​
 +add 198.18.1.209 198.18.1.203 esp 0x1001 -E aes-gcm-16 "​12345678901234567890";​
 +spdadd 2001:2::/49 2001:​2:​0:​8000::/​49 any -P in ipsec esp/​tunnel/​2001:​2:​0:​1::​209-2001:​2:​0:​1::​203/​require;​
 +spdadd 2001:​2:​0:​8000::/​49 2001:2::/49 any -P out ipsec esp/​tunnel/​2001:​2:​0:​1::​203-2001:​2:​0:​1::​209/​require;​
 +add 2001:​2:​0:​1::​203 2001:​2:​0:​1::​209 esp 0x1002 -E aes-gcm-16 "​12345678901234567890";​
 +add 2001:​2:​0:​1::​209 2001:​2:​0:​1::​203 esp 0x1003 -E aes-gcm-16 "​12345678901234567890";​
 +</​code>​
 +===== Using IPSec bench "​Equilibrium throughput"​ method =====
 +
 +Once done, we start using a fast method for measuring the "IPsec equilibrium throughput"​ of the DUT.
 +
 +Notice that the reference device (IBM x3550-M3) used in front of the Netgate has a [[IPSec performance lab of an IBM System x3550 M3 with Intel 82580|equilibrium throughput of 843Mb/s]]. Then if the value measured during this bench is close to 843Mb/s we had to found a more powerful reference device.
 +
 +From the packet generator/​receiver a simple script that use netmap-pktgen will do the job:
 +<​code>​
 +[root@R1]~# equilibrium -u -4 -d 00:​08:​a2:​09:​33:​da -t igb2 -r igb3
 +Benchmark tool using equilibrium throughput method
 +- Benchmark mode: Bandwitdh (bps) for VPN gateway
 +- UDP load = 500B, IPv4 packet size=528B, Ethernet frame size=542B
 +- Link rate = 1000 Mb/s
 +- Tolerance = 0.01
 +Iteration 1
 +  - Offering load = 500 Mb/s
 +  - Step = 250 Mb/s
 +  - Measured forwarding rate = 399 Mb/s
 +Iteration 2
 +  - Offering load = 250 Mb/s
 +  - Step = 250 Mb/s
 +  - Trend = decreasing
 +  - Measured forwarding rate = 250 Mb/s
 +Iteration 3
 +  - Offering load = 375 Mb/s
 +  - Step = 125 Mb/s
 +  - Trend = increasing
 +  - Measured forwarding rate = 375 Mb/s
 +Iteration 4
 +  - Offering load = 437 Mb/s
 +  - Step = 62 Mb/s
 +  - Trend = increasing
 +  - Measured forwarding rate = 399 Mb/s
 +Iteration 5
 +  - Offering load = 406 Mb/s
 +  - Step = 31 Mb/s
 +  - Trend = decreasing
 +  - Measured forwarding rate = 399 Mb/s
 +Iteration 6
 +  - Offering load = 391 Mb/s
 +  - Step = 15 Mb/s
 +  - Trend = decreasing
 +  - Measured forwarding rate = 391 Mb/s
 +Iteration 7
 +  - Offering load = 398 Mb/s
 +  - Step = 7 Mb/s
 +  - Trend = increasing
 +  - Measured forwarding rate = 398 Mb/s
 +Estimated Equilibrium Ethernet throughput= 398 Mb/s (maximum value seen: 399 Mb/s)
 +</​code>​
 +
 +Using AES-GCM-128 and aesni kernel module loaded on the NetGate RCC-VE 4860, we can estimate an IPSec Equilibrium throughput of about 400Mb/s.
 +
 +{{bench-ipsec-netgate-12head.png}}
documentation/examples/ipsec_performance_of_a_netgate_rcc-ve_4860.txt ยท Last modified: 2017/09/04 01:23 (external edit)