====== FreeBSD 11.2RでConnectX-3 Pro ENで40GBASE-SR4環境を構築 ======
===== 試した環境 =====
* FreeBSD 11.2-RELEASE-p7
* Mellanox ConnectX-3 Pro EN (MCX314A-BCCT)
* Mellanox Firmware Tools (MFT) 4.11.0
===== 手順 =====
==== ドライバの読み込み ====
FreeBSD 10.4-RELEASEあたりから、ConnectX用のカーネルモジュールがGENERICに含まれるようになったため、mlx4enをkldloadするだけで使える。なお、以前のバージョンではmlx4とmlxenの2つに分かれていたっぽい。
mlx4enがConnectX-3以前用のモジュールで、mlx5enがConnectX-4以降用のモジュールとなる。大変に紛らわしい。
# kldload mlx4en
# echo 'mlx4en_load="YES"' >> /boot/loader.conf
正しく動いてればNICとしてmlxenが生えてくる。
$ ifconfig
mlxen0: flags=8843 metric 0 mtu 9000
options=ed07bb
ether e4:1d:2d:xx:yy:e0
hwaddr e4:1d:2d:xx:yy:e0
inet 192.168.123.1 netmask 0xffffff00 broadcast 192.168.123.255
nd6 options=29
media: Ethernet autoselect (40Gbase-CR4 )
status: active
mlxen1: flags=8802 metric 0 mtu 1500
options=ed07bb
ether e4:1d:2d:xx:yy:e1
hwaddr e4:1d:2d:xx:yy:e1
nd6 options=29
media: Ethernet autoselect
status: no carrier
==== ファームウェアの更新 ====
Mellanox Firmware Tools (MFT)かmlxupを使ってカードのファームウェアの更新を行う。mlxupの方がコマンド一発で自動更新してくれて便利なんだけど、存在を知らずにMFTを使ってしまった…。MFTの方がいろいろユーティリティ付いてて良いんだもんね！（負け惜しみ
- MFTの動作にはpython2と/usr/bin/bashにbashが必要なので準備しておく。
- [[http://www.mellanox.com/page/management_tools]]からFreeBSD用のMFTを落として展開。
- ちなみにmlxupはこっち→[[http://www.mellanox.com/page/mlxup_firmware_tool]]
- install.shを実行してインストール
FreeBSDの作法を無視して/usr/binに色々インストールしやがるけど気にしない。
無事インストールできれば、''mst status''でカードの状態が表示される。
$ mst status
MST devices:
------------
pci0:2:0:0 - MT27520 Family [ConnectX-3 Pro]
カードの詳細情報を確認。-dの引数にはmst statusで得られたPCIバスを与える。
# flint -d pci0:2:0:0 q
Image type: FS2
FW Version: 2.32.5100
FW Release Date: 3.9.2014
Product Version: 02.32.51.00
Rom Info: type=PXE version=3.4.306 proto=ETH
Device ID: 4103
Description: Node Port1 Port2 Sys image
GUIDs: ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
MACs: e41d2dxxyye0 e41d2dxxyye1
VSD:
PSID: MT_1090111023
ファームウェアの更新。
ファームは[[http://www.mellanox.com/page/firmware_download]]から当該カードを選んで落としてくだしあ。
# flint -d pci0:2:0:0 -i fw-ConnectX3Pro-rel-2_42_5000-MCX314A-BCC_Ax-FlexBoot-3.4.752.bin b
Current FW version on flash: 2.32.5100
New FW version: 2.42.5000
Burning FS2 FW image without signatures - OK
Restoring signature - OK
マシンを再起動して正しくファームが更新されてるか確認。
# flint -d pci0:2:0:0 q
パスワード:
Image type: FS2
FW Version: 2.42.5000
FW Release Date: 5.9.2017
Product Version: 02.42.50.00
Rom Info: type=PXE version=3.4.752
Device ID: 4103
Description: Node Port1 Port2 Sys image
GUIDs: ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
MACs: e41d2dxxyye0 e41d2dxxyye1
VSD:
PSID: MT_1090111023
===== iperfしてみる =====
同じカードを搭載したWindowsクライアントとの間でiperfしてみる。サバクラの構成は下表のとおり。
^ ^ サーバ ^ クライアント ^
^ OS | FreeBSD 11.2-RELEASE (x64) | Windows 10 Pro. (x64) |
^ M/B | Supermicro X10DRi | MSI X370 SLI PLUS |
^ CPU | Xeon E5-2648L v3 @1.8GHz ×2 | Ryzen 7 1700 @3.0GHz |
^ RAM | Registered DDR4-2400 16GB×4 (2133MHz駆動) | DDR4-2666 8GB×4 |
^ NIC接続| PCIe 3.0 x8 (CPU1側のx16に接続) | PCIe 3.0 x8 \\ PCIe 2.0 x4 |
iperf中の様子をタスクマネージャで見ると↓こんな感じ。瞬間風速20Gbpsがアツい。
{{ :freebsd:40gbe_iperf_win10_freebsd11r_mtu1500.gif |}}
==== PCIe 2.0×4接続 ====
クライアント側NICをPCI Express 2.0 x4接続した時の結果。
バス帯域が片方向20Gbpsのためか、ジャンボフレームにしても11Gbps止まりとなった。
=== MTU=1500 ===
> iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 50129 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 848 MBytes 7.12 Gbits/sec
[ 4] 1.00-2.00 sec 1.02 GBytes 8.73 Gbits/sec
[ 4] 2.00-3.00 sec 1.03 GBytes 8.89 Gbits/sec
[ 4] 3.00-4.00 sec 1.03 GBytes 8.82 Gbits/sec
[ 4] 4.00-5.00 sec 984 MBytes 8.25 Gbits/sec
[ 4] 5.00-6.00 sec 844 MBytes 7.08 Gbits/sec
[ 4] 6.00-7.00 sec 1.07 GBytes 9.15 Gbits/sec
[ 4] 7.00-8.00 sec 1.08 GBytes 9.29 Gbits/sec
[ 4] 8.00-9.00 sec 1.08 GBytes 9.31 Gbits/sec
[ 4] 9.00-10.00 sec 1.02 GBytes 8.76 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 9.94 GBytes 8.54 Gbits/sec sender
[ 4] 0.00-10.00 sec 9.94 GBytes 8.54 Gbits/sec receiver
iperf Done.
=== MTU=9000 ===
> iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 64419 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.23 GBytes 10.6 Gbits/sec
[ 4] 1.00-2.00 sec 1.30 GBytes 11.1 Gbits/sec
[ 4] 2.00-3.00 sec 1.30 GBytes 11.2 Gbits/sec
[ 4] 3.00-4.00 sec 1.30 GBytes 11.2 Gbits/sec
[ 4] 4.00-5.00 sec 1.30 GBytes 11.2 Gbits/sec
[ 4] 5.00-6.00 sec 1.29 GBytes 11.1 Gbits/sec
[ 4] 6.00-7.00 sec 1.27 GBytes 10.9 Gbits/sec
[ 4] 7.00-8.00 sec 1.31 GBytes 11.2 Gbits/sec
[ 4] 8.00-9.00 sec 1.30 GBytes 11.1 Gbits/sec
[ 4] 9.00-10.00 sec 1.30 GBytes 11.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 12.9 GBytes 11.1 Gbits/sec sender
[ 4] 0.00-10.00 sec 12.9 GBytes 11.1 Gbits/sec receiver
iperf Done.
==== PCIe 3.0×8接続 ====
クライアント側NICをPCI Express 3.0 x8接続した時の結果。
バス帯域は片方向64Gbpsとなり、十分な速度が出ている。とはいえ理論値の40Gbpsには及ばない。まだチューニングの余地はありそうだ。
=== MTU=1500 ===
1スレッド
>iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 52041 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.55 GBytes 13.3 Gbits/sec
[ 4] 1.00-2.00 sec 1.73 GBytes 14.9 Gbits/sec
[ 4] 2.00-3.00 sec 1.70 GBytes 14.6 Gbits/sec
[ 4] 3.00-4.00 sec 1.78 GBytes 15.3 Gbits/sec
[ 4] 4.00-5.00 sec 1.84 GBytes 15.8 Gbits/sec
[ 4] 5.00-6.00 sec 1.83 GBytes 15.7 Gbits/sec
[ 4] 6.00-7.00 sec 1.79 GBytes 15.4 Gbits/sec
[ 4] 7.00-8.00 sec 1.90 GBytes 16.3 Gbits/sec
[ 4] 8.00-9.00 sec 2.26 GBytes 19.4 Gbits/sec
[ 4] 9.00-10.00 sec 2.31 GBytes 19.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 18.7 GBytes 16.1 Gbits/sec sender
[ 4] 0.00-10.00 sec 18.7 GBytes 16.1 Gbits/sec receiver
iperf Done.
2スレッド
>iperf3.exe -c 192.168.123.1 -P 2
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 52830 connected to 192.168.123.1 port 5201
[ 6] local 192.168.123.2 port 52831 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.28 GBytes 11.0 Gbits/sec
[ 6] 0.00-1.00 sec 1.27 GBytes 10.9 Gbits/sec
[SUM] 0.00-1.00 sec 2.54 GBytes 21.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 1.41 GBytes 12.1 Gbits/sec
[ 6] 1.00-2.00 sec 1.41 GBytes 12.1 Gbits/sec
[SUM] 1.00-2.00 sec 2.82 GBytes 24.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 1.39 GBytes 11.9 Gbits/sec
[ 6] 2.00-3.00 sec 1.39 GBytes 11.9 Gbits/sec
[SUM] 2.00-3.00 sec 2.78 GBytes 23.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 1.36 GBytes 11.7 Gbits/sec
[ 6] 3.00-4.00 sec 1.36 GBytes 11.7 Gbits/sec
[SUM] 3.00-4.00 sec 2.72 GBytes 23.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 1.37 GBytes 11.7 Gbits/sec
[ 6] 4.00-5.00 sec 1.36 GBytes 11.7 Gbits/sec
[SUM] 4.00-5.00 sec 2.73 GBytes 23.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 1.32 GBytes 11.3 Gbits/sec
[ 6] 5.00-6.00 sec 1.32 GBytes 11.3 Gbits/sec
[SUM] 5.00-6.00 sec 2.64 GBytes 22.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 1.31 GBytes 11.3 Gbits/sec
[ 6] 6.00-7.00 sec 1.31 GBytes 11.3 Gbits/sec
[SUM] 6.00-7.00 sec 2.62 GBytes 22.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 1.35 GBytes 11.6 Gbits/sec
[ 6] 7.00-8.00 sec 1.35 GBytes 11.6 Gbits/sec
[SUM] 7.00-8.00 sec 2.69 GBytes 23.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 1.25 GBytes 10.7 Gbits/sec
[ 6] 8.00-9.00 sec 1.24 GBytes 10.7 Gbits/sec
[SUM] 8.00-9.00 sec 2.49 GBytes 21.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 1.34 GBytes 11.5 Gbits/sec
[ 6] 9.00-10.00 sec 1.34 GBytes 11.5 Gbits/sec
[SUM] 9.00-10.00 sec 2.68 GBytes 23.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 13.4 GBytes 11.5 Gbits/sec sender
[ 4] 0.00-10.00 sec 13.4 GBytes 11.5 Gbits/sec receiver
[ 6] 0.00-10.00 sec 13.4 GBytes 11.5 Gbits/sec sender
[ 6] 0.00-10.00 sec 13.4 GBytes 11.5 Gbits/sec receiver
[SUM] 0.00-10.00 sec 26.7 GBytes 23.0 Gbits/sec sender
[SUM] 0.00-10.00 sec 26.7 GBytes 23.0 Gbits/sec receiver
iperf Done.
4スレッド
>iperf3.exe -c 192.168.123.1 -P 4
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 52840 connected to 192.168.123.1 port 5201
[ 6] local 192.168.123.2 port 52841 connected to 192.168.123.1 port 5201
[ 8] local 192.168.123.2 port 52842 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 52843 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 330 MBytes 2.76 Gbits/sec
[ 6] 0.00-1.00 sec 324 MBytes 2.72 Gbits/sec
[ 8] 0.00-1.00 sec 319 MBytes 2.68 Gbits/sec
[ 10] 0.00-1.00 sec 317 MBytes 2.66 Gbits/sec
[SUM] 0.00-1.00 sec 1.26 GBytes 10.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 508 MBytes 4.26 Gbits/sec
[ 6] 1.00-2.00 sec 508 MBytes 4.26 Gbits/sec
[ 8] 1.00-2.00 sec 507 MBytes 4.25 Gbits/sec
[ 10] 1.00-2.00 sec 506 MBytes 4.25 Gbits/sec
[SUM] 1.00-2.00 sec 1.98 GBytes 17.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 497 MBytes 4.17 Gbits/sec
[ 6] 2.00-3.00 sec 497 MBytes 4.17 Gbits/sec
[ 8] 2.00-3.00 sec 496 MBytes 4.16 Gbits/sec
[ 10] 2.00-3.00 sec 496 MBytes 4.16 Gbits/sec
[SUM] 2.00-3.00 sec 1.94 GBytes 16.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 518 MBytes 4.34 Gbits/sec
[ 6] 3.00-4.00 sec 518 MBytes 4.34 Gbits/sec
[ 8] 3.00-4.00 sec 517 MBytes 4.33 Gbits/sec
[ 10] 3.00-4.00 sec 517 MBytes 4.33 Gbits/sec
[SUM] 3.00-4.00 sec 2.02 GBytes 17.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 492 MBytes 4.12 Gbits/sec
[ 6] 4.00-5.00 sec 491 MBytes 4.12 Gbits/sec
[ 8] 4.00-5.00 sec 490 MBytes 4.11 Gbits/sec
[ 10] 4.00-5.00 sec 489 MBytes 4.10 Gbits/sec
[SUM] 4.00-5.00 sec 1.92 GBytes 16.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 446 MBytes 3.74 Gbits/sec
[ 6] 5.00-6.00 sec 442 MBytes 3.71 Gbits/sec
[ 8] 5.00-6.00 sec 440 MBytes 3.69 Gbits/sec
[ 10] 5.00-6.00 sec 438 MBytes 3.67 Gbits/sec
[SUM] 5.00-6.00 sec 1.72 GBytes 14.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 514 MBytes 4.31 Gbits/sec
[ 6] 6.00-7.00 sec 514 MBytes 4.31 Gbits/sec
[ 8] 6.00-7.00 sec 513 MBytes 4.30 Gbits/sec
[ 10] 6.00-7.00 sec 513 MBytes 4.30 Gbits/sec
[SUM] 6.00-7.00 sec 2.01 GBytes 17.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 528 MBytes 4.43 Gbits/sec
[ 6] 7.00-8.00 sec 528 MBytes 4.43 Gbits/sec
[ 8] 7.00-8.00 sec 528 MBytes 4.43 Gbits/sec
[ 10] 7.00-8.00 sec 527 MBytes 4.42 Gbits/sec
[SUM] 7.00-8.00 sec 2.06 GBytes 17.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 516 MBytes 4.33 Gbits/sec
[ 6] 8.00-9.00 sec 516 MBytes 4.33 Gbits/sec
[ 8] 8.00-9.00 sec 480 MBytes 4.02 Gbits/sec
[ 10] 8.00-9.00 sec 514 MBytes 4.32 Gbits/sec
[SUM] 8.00-9.00 sec 1.98 GBytes 17.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 552 MBytes 4.63 Gbits/sec
[ 6] 9.00-10.00 sec 552 MBytes 4.63 Gbits/sec
[ 8] 9.00-10.00 sec 551 MBytes 4.62 Gbits/sec
[ 10] 9.00-10.00 sec 551 MBytes 4.62 Gbits/sec
[SUM] 9.00-10.00 sec 2.16 GBytes 18.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 4.79 GBytes 4.11 Gbits/sec sender
[ 4] 0.00-10.00 sec 4.78 GBytes 4.11 Gbits/sec receiver
[ 6] 0.00-10.00 sec 4.77 GBytes 4.10 Gbits/sec sender
[ 6] 0.00-10.00 sec 4.77 GBytes 4.10 Gbits/sec receiver
[ 8] 0.00-10.00 sec 4.73 GBytes 4.06 Gbits/sec sender
[ 8] 0.00-10.00 sec 4.73 GBytes 4.06 Gbits/sec receiver
[ 10] 0.00-10.00 sec 4.75 GBytes 4.08 Gbits/sec sender
[ 10] 0.00-10.00 sec 4.75 GBytes 4.08 Gbits/sec receiver
[SUM] 0.00-10.00 sec 19.0 GBytes 16.4 Gbits/sec sender
[SUM] 0.00-10.00 sec 19.0 GBytes 16.4 Gbits/sec receiver
iperf Done.
8スレッド
>iperf3.exe -c 192.168.123.1 -P 8
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 52879 connected to 192.168.123.1 port 5201
[ 6] local 192.168.123.2 port 52880 connected to 192.168.123.1 port 5201
[ 8] local 192.168.123.2 port 52881 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 52882 connected to 192.168.123.1 port 5201
[ 12] local 192.168.123.2 port 52883 connected to 192.168.123.1 port 5201
[ 14] local 192.168.123.2 port 52884 connected to 192.168.123.1 port 5201
[ 16] local 192.168.123.2 port 52885 connected to 192.168.123.1 port 5201
[ 18] local 192.168.123.2 port 52886 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 234 MBytes 1.96 Gbits/sec
[ 6] 0.00-1.00 sec 234 MBytes 1.96 Gbits/sec
[ 8] 0.00-1.00 sec 232 MBytes 1.95 Gbits/sec
[ 10] 0.00-1.00 sec 230 MBytes 1.93 Gbits/sec
[ 12] 0.00-1.00 sec 226 MBytes 1.89 Gbits/sec
[ 14] 0.00-1.00 sec 224 MBytes 1.88 Gbits/sec
[ 16] 0.00-1.00 sec 224 MBytes 1.88 Gbits/sec
[ 18] 0.00-1.00 sec 224 MBytes 1.88 Gbits/sec
[SUM] 0.00-1.00 sec 1.78 GBytes 15.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 265 MBytes 2.22 Gbits/sec
[ 6] 1.00-2.00 sec 265 MBytes 2.22 Gbits/sec
[ 8] 1.00-2.00 sec 265 MBytes 2.22 Gbits/sec
[ 10] 1.00-2.00 sec 264 MBytes 2.22 Gbits/sec
[ 12] 1.00-2.00 sec 264 MBytes 2.22 Gbits/sec
[ 14] 1.00-2.00 sec 264 MBytes 2.22 Gbits/sec
[ 16] 1.00-2.00 sec 264 MBytes 2.22 Gbits/sec
[ 18] 1.00-2.00 sec 264 MBytes 2.22 Gbits/sec
[SUM] 1.00-2.00 sec 2.07 GBytes 17.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 267 MBytes 2.24 Gbits/sec
[ 6] 2.00-3.00 sec 267 MBytes 2.24 Gbits/sec
[ 8] 2.00-3.00 sec 266 MBytes 2.23 Gbits/sec
[ 10] 2.00-3.00 sec 266 MBytes 2.23 Gbits/sec
[ 12] 2.00-3.00 sec 266 MBytes 2.23 Gbits/sec
[ 14] 2.00-3.00 sec 266 MBytes 2.23 Gbits/sec
[ 16] 2.00-3.00 sec 264 MBytes 2.22 Gbits/sec
[ 18] 2.00-3.00 sec 264 MBytes 2.22 Gbits/sec
[SUM] 2.00-3.00 sec 2.08 GBytes 17.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 267 MBytes 2.24 Gbits/sec
[ 6] 3.00-4.00 sec 267 MBytes 2.24 Gbits/sec
[ 8] 3.00-4.00 sec 267 MBytes 2.24 Gbits/sec
[ 10] 3.00-4.00 sec 266 MBytes 2.24 Gbits/sec
[ 12] 3.00-4.00 sec 267 MBytes 2.24 Gbits/sec
[ 14] 3.00-4.00 sec 266 MBytes 2.24 Gbits/sec
[ 16] 3.00-4.00 sec 266 MBytes 2.23 Gbits/sec
[ 18] 3.00-4.00 sec 266 MBytes 2.23 Gbits/sec
[SUM] 3.00-4.00 sec 2.08 GBytes 17.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 192 MBytes 1.61 Gbits/sec
[ 6] 4.00-5.00 sec 192 MBytes 1.61 Gbits/sec
[ 8] 4.00-5.00 sec 191 MBytes 1.60 Gbits/sec
[ 10] 4.00-5.00 sec 190 MBytes 1.59 Gbits/sec
[ 12] 4.00-5.00 sec 189 MBytes 1.59 Gbits/sec
[ 14] 4.00-5.00 sec 188 MBytes 1.58 Gbits/sec
[ 16] 4.00-5.00 sec 186 MBytes 1.56 Gbits/sec
[ 18] 4.00-5.00 sec 186 MBytes 1.56 Gbits/sec
[SUM] 4.00-5.00 sec 1.48 GBytes 12.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 263 MBytes 2.21 Gbits/sec
[ 6] 5.00-6.00 sec 263 MBytes 2.21 Gbits/sec
[ 8] 5.00-6.00 sec 263 MBytes 2.21 Gbits/sec
[ 10] 5.00-6.00 sec 263 MBytes 2.20 Gbits/sec
[ 12] 5.00-6.00 sec 262 MBytes 2.20 Gbits/sec
[ 14] 5.00-6.00 sec 263 MBytes 2.20 Gbits/sec
[ 16] 5.00-6.00 sec 262 MBytes 2.20 Gbits/sec
[ 18] 5.00-6.00 sec 262 MBytes 2.20 Gbits/sec
[SUM] 5.00-6.00 sec 2.05 GBytes 17.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 214 MBytes 1.80 Gbits/sec
[ 6] 6.00-7.00 sec 214 MBytes 1.80 Gbits/sec
[ 8] 6.00-7.00 sec 214 MBytes 1.80 Gbits/sec
[ 10] 6.00-7.00 sec 214 MBytes 1.80 Gbits/sec
[ 12] 6.00-7.00 sec 214 MBytes 1.79 Gbits/sec
[ 14] 6.00-7.00 sec 214 MBytes 1.79 Gbits/sec
[ 16] 6.00-7.00 sec 214 MBytes 1.79 Gbits/sec
[ 18] 6.00-7.00 sec 213 MBytes 1.79 Gbits/sec
[SUM] 6.00-7.00 sec 1.67 GBytes 14.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 271 MBytes 2.27 Gbits/sec
[ 6] 7.00-8.00 sec 271 MBytes 2.27 Gbits/sec
[ 8] 7.00-8.00 sec 270 MBytes 2.27 Gbits/sec
[ 10] 7.00-8.00 sec 270 MBytes 2.27 Gbits/sec
[ 12] 7.00-8.00 sec 270 MBytes 2.26 Gbits/sec
[ 14] 7.00-8.00 sec 270 MBytes 2.27 Gbits/sec
[ 16] 7.00-8.00 sec 269 MBytes 2.26 Gbits/sec
[ 18] 7.00-8.00 sec 270 MBytes 2.26 Gbits/sec
[SUM] 7.00-8.00 sec 2.11 GBytes 18.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 227 MBytes 1.90 Gbits/sec
[ 6] 8.00-9.00 sec 226 MBytes 1.90 Gbits/sec
[ 8] 8.00-9.00 sec 226 MBytes 1.89 Gbits/sec
[ 10] 8.00-9.00 sec 226 MBytes 1.89 Gbits/sec
[ 12] 8.00-9.00 sec 226 MBytes 1.89 Gbits/sec
[ 14] 8.00-9.00 sec 226 MBytes 1.89 Gbits/sec
[ 16] 8.00-9.00 sec 225 MBytes 1.89 Gbits/sec
[ 18] 8.00-9.00 sec 224 MBytes 1.88 Gbits/sec
[SUM] 8.00-9.00 sec 1.76 GBytes 15.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 214 MBytes 1.79 Gbits/sec
[ 6] 9.00-10.00 sec 213 MBytes 1.79 Gbits/sec
[ 8] 9.00-10.00 sec 212 MBytes 1.78 Gbits/sec
[ 10] 9.00-10.00 sec 211 MBytes 1.77 Gbits/sec
[ 12] 9.00-10.00 sec 212 MBytes 1.78 Gbits/sec
[ 14] 9.00-10.00 sec 212 MBytes 1.78 Gbits/sec
[ 16] 9.00-10.00 sec 209 MBytes 1.75 Gbits/sec
[ 18] 9.00-10.00 sec 208 MBytes 1.74 Gbits/sec
[SUM] 9.00-10.00 sec 1.65 GBytes 14.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 2.36 GBytes 2.02 Gbits/sec sender
[ 4] 0.00-10.00 sec 2.36 GBytes 2.02 Gbits/sec receiver
[ 6] 0.00-10.00 sec 2.36 GBytes 2.02 Gbits/sec sender
[ 6] 0.00-10.00 sec 2.35 GBytes 2.02 Gbits/sec receiver
[ 8] 0.00-10.00 sec 2.35 GBytes 2.02 Gbits/sec sender
[ 8] 0.00-10.00 sec 2.35 GBytes 2.02 Gbits/sec receiver
[ 10] 0.00-10.00 sec 2.34 GBytes 2.01 Gbits/sec sender
[ 10] 0.00-10.00 sec 2.34 GBytes 2.01 Gbits/sec receiver
[ 12] 0.00-10.00 sec 2.34 GBytes 2.01 Gbits/sec sender
[ 12] 0.00-10.00 sec 2.34 GBytes 2.01 Gbits/sec receiver
[ 14] 0.00-10.00 sec 2.34 GBytes 2.01 Gbits/sec sender
[ 14] 0.00-10.00 sec 2.34 GBytes 2.01 Gbits/sec receiver
[ 16] 0.00-10.00 sec 2.33 GBytes 2.00 Gbits/sec sender
[ 16] 0.00-10.00 sec 2.33 GBytes 2.00 Gbits/sec receiver
[ 18] 0.00-10.00 sec 2.33 GBytes 2.00 Gbits/sec sender
[ 18] 0.00-10.00 sec 2.32 GBytes 2.00 Gbits/sec receiver
[SUM] 0.00-10.00 sec 18.7 GBytes 16.1 Gbits/sec sender
[SUM] 0.00-10.00 sec 18.7 GBytes 16.1 Gbits/sec receiver
iperf Done.
=== MTU=9000 ====
1スレッド
>iperf3.exe -c 192.168.123.1
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 52963 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 2.70 GBytes 23.2 Gbits/sec
[ 4] 1.00-2.00 sec 2.78 GBytes 23.9 Gbits/sec
[ 4] 2.00-3.00 sec 3.05 GBytes 26.2 Gbits/sec
[ 4] 3.00-4.00 sec 3.05 GBytes 26.2 Gbits/sec
[ 4] 4.00-5.00 sec 3.06 GBytes 26.3 Gbits/sec
[ 4] 5.00-6.00 sec 3.06 GBytes 26.3 Gbits/sec
[ 4] 6.00-7.00 sec 3.01 GBytes 25.8 Gbits/sec
[ 4] 7.00-8.00 sec 3.04 GBytes 26.2 Gbits/sec
[ 4] 8.00-9.00 sec 3.05 GBytes 26.2 Gbits/sec
[ 4] 9.00-10.00 sec 3.07 GBytes 26.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 29.9 GBytes 25.7 Gbits/sec sender
[ 4] 0.00-10.00 sec 29.9 GBytes 25.7 Gbits/sec receiver
iperf Done.
2スレッド
>iperf3.exe -c 192.168.123.1 -P 2
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 53014 connected to 192.168.123.1 port 5201
[ 6] local 192.168.123.2 port 53015 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.55 GBytes 13.3 Gbits/sec
[ 6] 0.00-1.00 sec 1.48 GBytes 12.7 Gbits/sec
[SUM] 0.00-1.00 sec 3.03 GBytes 26.0 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 1.63 GBytes 14.0 Gbits/sec
[ 6] 1.00-2.00 sec 1.62 GBytes 13.9 Gbits/sec
[SUM] 1.00-2.00 sec 3.25 GBytes 27.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 1.60 GBytes 13.8 Gbits/sec
[ 6] 2.00-3.00 sec 1.60 GBytes 13.7 Gbits/sec
[SUM] 2.00-3.00 sec 3.20 GBytes 27.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 1.32 GBytes 11.3 Gbits/sec
[ 6] 3.00-4.00 sec 1.31 GBytes 11.3 Gbits/sec
[SUM] 3.00-4.00 sec 2.63 GBytes 22.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 1.65 GBytes 14.2 Gbits/sec
[ 6] 4.00-5.00 sec 1.64 GBytes 14.1 Gbits/sec
[SUM] 4.00-5.00 sec 3.29 GBytes 28.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 1.61 GBytes 13.8 Gbits/sec
[ 6] 5.00-6.00 sec 1.60 GBytes 13.8 Gbits/sec
[SUM] 5.00-6.00 sec 3.21 GBytes 27.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 1.66 GBytes 14.2 Gbits/sec
[ 6] 6.00-7.00 sec 1.65 GBytes 14.2 Gbits/sec
[SUM] 6.00-7.00 sec 3.31 GBytes 28.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 1.65 GBytes 14.2 Gbits/sec
[ 6] 7.00-8.00 sec 1.65 GBytes 14.1 Gbits/sec
[SUM] 7.00-8.00 sec 3.30 GBytes 28.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 1.33 GBytes 11.4 Gbits/sec
[ 6] 8.00-9.00 sec 1.32 GBytes 11.4 Gbits/sec
[SUM] 8.00-9.00 sec 2.65 GBytes 22.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 1.66 GBytes 14.2 Gbits/sec
[ 6] 9.00-10.00 sec 1.65 GBytes 14.2 Gbits/sec
[SUM] 9.00-10.00 sec 3.31 GBytes 28.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 15.6 GBytes 13.4 Gbits/sec sender
[ 4] 0.00-10.00 sec 15.6 GBytes 13.4 Gbits/sec receiver
[ 6] 0.00-10.00 sec 15.5 GBytes 13.3 Gbits/sec sender
[ 6] 0.00-10.00 sec 15.5 GBytes 13.3 Gbits/sec receiver
[SUM] 0.00-10.00 sec 31.2 GBytes 26.8 Gbits/sec sender
[SUM] 0.00-10.00 sec 31.2 GBytes 26.8 Gbits/sec receiver
iperf Done.
4スレッド
>iperf3.exe -c 192.168.123.1 -P 4
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 53045 connected to 192.168.123.1 port 5201
[ 6] local 192.168.123.2 port 53046 connected to 192.168.123.1 port 5201
[ 8] local 192.168.123.2 port 53047 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 53048 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 800 MBytes 6.71 Gbits/sec
[ 6] 0.00-1.00 sec 794 MBytes 6.66 Gbits/sec
[ 8] 0.00-1.00 sec 791 MBytes 6.63 Gbits/sec
[ 10] 0.00-1.00 sec 779 MBytes 6.53 Gbits/sec
[SUM] 0.00-1.00 sec 3.09 GBytes 26.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 896 MBytes 7.50 Gbits/sec
[ 6] 1.00-2.00 sec 894 MBytes 7.49 Gbits/sec
[ 8] 1.00-2.00 sec 888 MBytes 7.44 Gbits/sec
[ 10] 1.00-2.00 sec 887 MBytes 7.43 Gbits/sec
[SUM] 1.00-2.00 sec 3.48 GBytes 29.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 574 MBytes 4.82 Gbits/sec
[ 6] 2.00-3.00 sec 573 MBytes 4.82 Gbits/sec
[ 8] 2.00-3.00 sec 565 MBytes 4.75 Gbits/sec
[ 10] 2.00-3.00 sec 562 MBytes 4.72 Gbits/sec
[SUM] 2.00-3.00 sec 2.22 GBytes 19.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 780 MBytes 6.55 Gbits/sec
[ 6] 3.00-4.00 sec 780 MBytes 6.55 Gbits/sec
[ 8] 3.00-4.00 sec 777 MBytes 6.52 Gbits/sec
[ 10] 3.00-4.00 sec 775 MBytes 6.50 Gbits/sec
[SUM] 3.00-4.00 sec 3.04 GBytes 26.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 889 MBytes 7.46 Gbits/sec
[ 6] 4.00-5.00 sec 888 MBytes 7.45 Gbits/sec
[ 8] 4.00-5.00 sec 886 MBytes 7.43 Gbits/sec
[ 10] 4.00-5.00 sec 884 MBytes 7.41 Gbits/sec
[SUM] 4.00-5.00 sec 3.46 GBytes 29.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 911 MBytes 7.64 Gbits/sec
[ 6] 5.00-6.00 sec 911 MBytes 7.64 Gbits/sec
[ 8] 5.00-6.00 sec 910 MBytes 7.64 Gbits/sec
[ 10] 5.00-6.00 sec 910 MBytes 7.63 Gbits/sec
[SUM] 5.00-6.00 sec 3.56 GBytes 30.6 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 900 MBytes 7.54 Gbits/sec
[ 6] 6.00-7.00 sec 899 MBytes 7.53 Gbits/sec
[ 8] 6.00-7.00 sec 896 MBytes 7.51 Gbits/sec
[ 10] 6.00-7.00 sec 897 MBytes 7.51 Gbits/sec
[SUM] 6.00-7.00 sec 3.51 GBytes 30.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 828 MBytes 6.95 Gbits/sec
[ 6] 7.00-8.00 sec 826 MBytes 6.94 Gbits/sec
[ 8] 7.00-8.00 sec 822 MBytes 6.91 Gbits/sec
[ 10] 7.00-8.00 sec 821 MBytes 6.90 Gbits/sec
[SUM] 7.00-8.00 sec 3.22 GBytes 27.7 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 951 MBytes 7.98 Gbits/sec
[ 6] 8.00-9.00 sec 950 MBytes 7.97 Gbits/sec
[ 8] 8.00-9.00 sec 947 MBytes 7.94 Gbits/sec
[ 10] 8.00-9.00 sec 946 MBytes 7.93 Gbits/sec
[SUM] 8.00-9.00 sec 3.70 GBytes 31.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 953 MBytes 7.99 Gbits/sec
[ 6] 9.00-10.00 sec 953 MBytes 7.99 Gbits/sec
[ 8] 9.00-10.00 sec 952 MBytes 7.98 Gbits/sec
[ 10] 9.00-10.00 sec 951 MBytes 7.98 Gbits/sec
[SUM] 9.00-10.00 sec 3.72 GBytes 31.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 8.28 GBytes 7.11 Gbits/sec sender
[ 4] 0.00-10.00 sec 8.28 GBytes 7.11 Gbits/sec receiver
[ 6] 0.00-10.00 sec 8.27 GBytes 7.10 Gbits/sec sender
[ 6] 0.00-10.00 sec 8.27 GBytes 7.10 Gbits/sec receiver
[ 8] 0.00-10.00 sec 8.24 GBytes 7.07 Gbits/sec sender
[ 8] 0.00-10.00 sec 8.23 GBytes 7.07 Gbits/sec receiver
[ 10] 0.00-10.00 sec 8.21 GBytes 7.06 Gbits/sec sender
[ 10] 0.00-10.00 sec 8.21 GBytes 7.05 Gbits/sec receiver
[SUM] 0.00-10.00 sec 33.0 GBytes 28.3 Gbits/sec sender
[SUM] 0.00-10.00 sec 33.0 GBytes 28.3 Gbits/sec receiver
iperf Done.
8スレッド
>iperf3.exe -c 192.168.123.1 -P 8
Connecting to host 192.168.123.1, port 5201
[ 4] local 192.168.123.2 port 53107 connected to 192.168.123.1 port 5201
[ 6] local 192.168.123.2 port 53108 connected to 192.168.123.1 port 5201
[ 8] local 192.168.123.2 port 53109 connected to 192.168.123.1 port 5201
[ 10] local 192.168.123.2 port 53110 connected to 192.168.123.1 port 5201
[ 12] local 192.168.123.2 port 53111 connected to 192.168.123.1 port 5201
[ 14] local 192.168.123.2 port 53112 connected to 192.168.123.1 port 5201
[ 16] local 192.168.123.2 port 53113 connected to 192.168.123.1 port 5201
[ 18] local 192.168.123.2 port 53114 connected to 192.168.123.1 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 412 MBytes 3.45 Gbits/sec
[ 6] 0.00-1.00 sec 416 MBytes 3.49 Gbits/sec
[ 8] 0.00-1.00 sec 411 MBytes 3.45 Gbits/sec
[ 10] 0.00-1.00 sec 405 MBytes 3.40 Gbits/sec
[ 12] 0.00-1.00 sec 397 MBytes 3.33 Gbits/sec
[ 14] 0.00-1.00 sec 390 MBytes 3.27 Gbits/sec
[ 16] 0.00-1.00 sec 386 MBytes 3.23 Gbits/sec
[ 18] 0.00-1.00 sec 375 MBytes 3.14 Gbits/sec
[SUM] 0.00-1.00 sec 3.12 GBytes 26.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 1.00-2.00 sec 286 MBytes 2.40 Gbits/sec
[ 6] 1.00-2.00 sec 296 MBytes 2.48 Gbits/sec
[ 8] 1.00-2.00 sec 290 MBytes 2.44 Gbits/sec
[ 10] 1.00-2.00 sec 283 MBytes 2.37 Gbits/sec
[ 12] 1.00-2.00 sec 278 MBytes 2.33 Gbits/sec
[ 14] 1.00-2.00 sec 267 MBytes 2.24 Gbits/sec
[ 16] 1.00-2.00 sec 258 MBytes 2.17 Gbits/sec
[ 18] 1.00-2.00 sec 247 MBytes 2.07 Gbits/sec
[SUM] 1.00-2.00 sec 2.15 GBytes 18.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 2.00-3.00 sec 348 MBytes 2.92 Gbits/sec
[ 6] 2.00-3.00 sec 360 MBytes 3.02 Gbits/sec
[ 8] 2.00-3.00 sec 354 MBytes 2.97 Gbits/sec
[ 10] 2.00-3.00 sec 345 MBytes 2.89 Gbits/sec
[ 12] 2.00-3.00 sec 334 MBytes 2.80 Gbits/sec
[ 14] 2.00-3.00 sec 319 MBytes 2.68 Gbits/sec
[ 16] 2.00-3.00 sec 308 MBytes 2.59 Gbits/sec
[ 18] 2.00-3.00 sec 293 MBytes 2.46 Gbits/sec
[SUM] 2.00-3.00 sec 2.60 GBytes 22.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 3.00-4.00 sec 462 MBytes 3.88 Gbits/sec
[ 6] 3.00-4.00 sec 477 MBytes 4.00 Gbits/sec
[ 8] 3.00-4.00 sec 471 MBytes 3.95 Gbits/sec
[ 10] 3.00-4.00 sec 465 MBytes 3.90 Gbits/sec
[ 12] 3.00-4.00 sec 449 MBytes 3.77 Gbits/sec
[ 14] 3.00-4.00 sec 435 MBytes 3.65 Gbits/sec
[ 16] 3.00-4.00 sec 419 MBytes 3.51 Gbits/sec
[ 18] 3.00-4.00 sec 392 MBytes 3.29 Gbits/sec
[SUM] 3.00-4.00 sec 3.49 GBytes 29.9 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 4.00-5.00 sec 445 MBytes 3.73 Gbits/sec
[ 6] 4.00-5.00 sec 461 MBytes 3.87 Gbits/sec
[ 8] 4.00-5.00 sec 456 MBytes 3.83 Gbits/sec
[ 10] 4.00-5.00 sec 450 MBytes 3.78 Gbits/sec
[ 12] 4.00-5.00 sec 438 MBytes 3.67 Gbits/sec
[ 14] 4.00-5.00 sec 422 MBytes 3.54 Gbits/sec
[ 16] 4.00-5.00 sec 408 MBytes 3.42 Gbits/sec
[ 18] 4.00-5.00 sec 383 MBytes 3.22 Gbits/sec
[SUM] 4.00-5.00 sec 3.38 GBytes 29.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 5.00-6.00 sec 454 MBytes 3.80 Gbits/sec
[ 6] 5.00-6.00 sec 466 MBytes 3.91 Gbits/sec
[ 8] 5.00-6.00 sec 459 MBytes 3.85 Gbits/sec
[ 10] 5.00-6.00 sec 451 MBytes 3.78 Gbits/sec
[ 12] 5.00-6.00 sec 442 MBytes 3.71 Gbits/sec
[ 14] 5.00-6.00 sec 429 MBytes 3.60 Gbits/sec
[ 16] 5.00-6.00 sec 414 MBytes 3.47 Gbits/sec
[ 18] 5.00-6.00 sec 390 MBytes 3.28 Gbits/sec
[SUM] 5.00-6.00 sec 3.42 GBytes 29.4 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 6.00-7.00 sec 351 MBytes 2.95 Gbits/sec
[ 6] 6.00-7.00 sec 365 MBytes 3.06 Gbits/sec
[ 8] 6.00-7.00 sec 360 MBytes 3.02 Gbits/sec
[ 10] 6.00-7.00 sec 355 MBytes 2.98 Gbits/sec
[ 12] 6.00-7.00 sec 342 MBytes 2.87 Gbits/sec
[ 14] 6.00-7.00 sec 322 MBytes 2.70 Gbits/sec
[ 16] 6.00-7.00 sec 320 MBytes 2.69 Gbits/sec
[ 18] 6.00-7.00 sec 302 MBytes 2.53 Gbits/sec
[SUM] 6.00-7.00 sec 2.65 GBytes 22.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 7.00-8.00 sec 389 MBytes 3.26 Gbits/sec
[ 6] 7.00-8.00 sec 400 MBytes 3.36 Gbits/sec
[ 8] 7.00-8.00 sec 396 MBytes 3.32 Gbits/sec
[ 10] 7.00-8.00 sec 385 MBytes 3.23 Gbits/sec
[ 12] 7.00-8.00 sec 377 MBytes 3.17 Gbits/sec
[ 14] 7.00-8.00 sec 362 MBytes 3.04 Gbits/sec
[ 16] 7.00-8.00 sec 353 MBytes 2.96 Gbits/sec
[ 18] 7.00-8.00 sec 332 MBytes 2.78 Gbits/sec
[SUM] 7.00-8.00 sec 2.92 GBytes 25.1 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 8.00-9.00 sec 458 MBytes 3.85 Gbits/sec
[ 6] 8.00-9.00 sec 475 MBytes 3.99 Gbits/sec
[ 8] 8.00-9.00 sec 472 MBytes 3.96 Gbits/sec
[ 10] 8.00-9.00 sec 464 MBytes 3.89 Gbits/sec
[ 12] 8.00-9.00 sec 448 MBytes 3.76 Gbits/sec
[ 14] 8.00-9.00 sec 431 MBytes 3.62 Gbits/sec
[ 16] 8.00-9.00 sec 416 MBytes 3.49 Gbits/sec
[ 18] 8.00-9.00 sec 393 MBytes 3.30 Gbits/sec
[SUM] 8.00-9.00 sec 3.47 GBytes 29.8 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 4] 9.00-10.00 sec 452 MBytes 3.79 Gbits/sec
[ 6] 9.00-10.00 sec 466 MBytes 3.91 Gbits/sec
[ 8] 9.00-10.00 sec 460 MBytes 3.86 Gbits/sec
[ 10] 9.00-10.00 sec 456 MBytes 3.83 Gbits/sec
[ 12] 9.00-10.00 sec 444 MBytes 3.72 Gbits/sec
[ 14] 9.00-10.00 sec 428 MBytes 3.59 Gbits/sec
[ 16] 9.00-10.00 sec 414 MBytes 3.48 Gbits/sec
[ 18] 9.00-10.00 sec 391 MBytes 3.28 Gbits/sec
[SUM] 9.00-10.00 sec 3.43 GBytes 29.5 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 3.96 GBytes 3.40 Gbits/sec sender
[ 4] 0.00-10.00 sec 3.96 GBytes 3.40 Gbits/sec receiver
[ 6] 0.00-10.00 sec 4.08 GBytes 3.51 Gbits/sec sender
[ 6] 0.00-10.00 sec 4.08 GBytes 3.51 Gbits/sec receiver
[ 8] 0.00-10.00 sec 4.03 GBytes 3.46 Gbits/sec sender
[ 8] 0.00-10.00 sec 4.03 GBytes 3.46 Gbits/sec receiver
[ 10] 0.00-10.00 sec 3.96 GBytes 3.41 Gbits/sec sender
[ 10] 0.00-10.00 sec 3.96 GBytes 3.41 Gbits/sec receiver
[ 12] 0.00-10.00 sec 3.86 GBytes 3.31 Gbits/sec sender
[ 12] 0.00-10.00 sec 3.86 GBytes 3.31 Gbits/sec receiver
[ 14] 0.00-10.00 sec 3.72 GBytes 3.19 Gbits/sec sender
[ 14] 0.00-10.00 sec 3.72 GBytes 3.19 Gbits/sec receiver
[ 16] 0.00-10.00 sec 3.61 GBytes 3.10 Gbits/sec sender
[ 16] 0.00-10.00 sec 3.61 GBytes 3.10 Gbits/sec receiver
[ 18] 0.00-10.00 sec 3.42 GBytes 2.93 Gbits/sec sender
[ 18] 0.00-10.00 sec 3.42 GBytes 2.93 Gbits/sec receiver
[SUM] 0.00-10.00 sec 30.6 GBytes 26.3 Gbits/sec sender
[SUM] 0.00-10.00 sec 30.6 GBytes 26.3 Gbits/sec receiver
iperf Done.
ジャンボフレームにすると流石の速度。スレッド数を増やすと速度も伸びるという情報があったが、自分の環境では4スレッドの時が最大で、単純に増やせば速くなるってものでもなかった。ここまで来ると、メモリ速度やその時その時のバス使用率など、マシンの足回りの影響が大きそう。
===== 参考サイト =====
* [[https://www.freebsd.org/cgi/man.cgi?query=mlx4en&apropos=0&sektion=4&manpath=FreeBSD+11.2-RELEASE&arch=default&format=html|mlx4en(4)]]
* [[https://wiki.freebsd.org/InfiniBand|InfiniBand - FreeBSD Wiki]]
* [[https://www.ragemax.com/2017/02/say-good-bye-10gbe-and-say-hello-40gbe.html|後ろへ向かって前進 Act.2: この自宅10GbE環境にお別れを！(こんにちは、40GbE)]]