port aggregation und so (SPAM aus dem BUMP-Thread :))

[Nuwien]

mal ein bischen Thread Necromantie betreiben....

hab hier vier nette Spielzeuge stehen: 2 brocade vdx6740 und dazu zwei potente server...

Setup ist:

Die zwei Brocades hägen jeweils mit 2*40Gbit an einander und es läuft dort das Inter Switch Link Protokoll von Brocade (stichwort Trill) und bilden eine Switch Fabric.

Beide Server sind jeweils mal mit switch-a und einmal mit switch-b verkabelt. (also insgesamt 2*10GE). Auf beiden Switches wurden jeweils zwei Portchannel configuriert. Pro Server einen. Beide Server sind also Vollredundant angebunden und sollen dennoch LACP machen (normalerweise geht das ja nur wenn der Portchannel auf jeweils einem einzigen Switch endet)

bonding config auf den Linux büchsen schaut so aus:

alias bond1 bonding

options bonding mode=802.3ad xmit_hash_policy=layer3+4 miimon=50

Bond hochgefahren, interfaces enslaved und dann mit iperf getestet:

Default MTU

Client connecting to 10.200.3.2, TCP port 5001

TCP window size: 23.5 KByte (default)

------------------------------------------------------------

[ 4] local 10.200.3.1 port 57582 connected with 10.200.3.2 port 5001

[ 5] local 10.200.3.1 port 57583 connected with 10.200.3.2 port 5001

[ 3] local 10.200.3.1 port 57581 connected with 10.200.3.2 port 5001

[ 6] local 10.200.3.1 port 57584 connected with 10.200.3.2 port 5001

[ ID] Interval Transfer Bandwidth

[ 4] 0.0-10.0 sec 2.48 GBytes 2.13 Gbits/sec

[ 5] 0.0-10.0 sec 7.51 GBytes 6.45 Gbits/sec

[ 3] 0.0-10.0 sec 2.70 GBytes 2.32 Gbits/sec

[ 6] 0.0-10.0 sec 796 MBytes 668 Mbits/sec

[sUM] 0.0-10.0 sec 13.5 GBytes 11.6 Gbits/sec

[ 4] 10.0-20.0 sec 6.18 GBytes 5.30 Gbits/sec

[ 5] 10.0-20.0 sec 5.46 GBytes 4.69 Gbits/sec

[ 3] 10.0-20.0 sec 5.19 GBytes 4.46 Gbits/sec

[ 6] 10.0-20.0 sec 501 MBytes 420 Mbits/sec

[sUM] 10.0-20.0 sec 17.3 GBytes 14.9 Gbits/sec

[ 4] 20.0-30.0 sec 5.06 GBytes 4.35 Gbits/sec

[ 5] 20.0-30.0 sec 5.27 GBytes 4.53 Gbits/sec

[ 3] 20.0-30.0 sec 4.98 GBytes 4.28 Gbits/sec

[ 6] 20.0-30.0 sec 5.05 GBytes 4.34 Gbits/sec

[sUM] 20.0-30.0 sec 20.4 GBytes 17.5 Gbits/sec

[ 4] 30.0-40.0 sec 5.24 GBytes 4.50 Gbits/sec

[ 5] 30.0-40.0 sec 5.84 GBytes 5.02 Gbits/sec

[ 3] 30.0-40.0 sec 2.48 GBytes 2.13 Gbits/sec

[ 6] 30.0-40.0 sec 5.18 GBytes 4.45 Gbits/sec

[sUM] 30.0-40.0 sec 18.7 GBytes 16.1 Gbits/sec

[ 4] 40.0-50.0 sec 5.25 GBytes 4.51 Gbits/sec

[ 5] 40.0-50.0 sec 5.78 GBytes 4.96 Gbits/sec

[ 3] 40.0-50.0 sec 2.18 GBytes 1.87 Gbits/sec

[ 6] 40.0-50.0 sec 5.24 GBytes 4.50 Gbits/sec

[sUM] 40.0-50.0 sec 18.5 GBytes 15.9 Gbits/sec

[ 4] 0.0-60.0 sec 29.3 GBytes 4.19 Gbits/sec

[ 5] 50.0-60.0 sec 5.32 GBytes 4.57 Gbits/sec

[ 5] 0.0-60.0 sec 35.2 GBytes 5.04 Gbits/sec

[ 3] 0.0-60.0 sec 22.4 GBytes 3.21 Gbits/sec

[ 6] 50.0-60.0 sec 5.11 GBytes 4.39 Gbits/sec

[ 6] 0.0-60.0 sec 21.8 GBytes 3.13 Gbits/sec

[sUM] 0.0-60.0 sec 109 GBytes 15.6 Gbits/sec

Danach MTU auf "over 9000" gesetzt:

------------------------------------------------------------

Client connecting to 10.200.3.2, TCP port 5001

TCP window size: 96.7 KByte (default)

------------------------------------------------------------

[ 6] local 10.200.3.1 port 57679 connected with 10.200.3.2 port 5001

[ 3] local 10.200.3.1 port 57675 connected with 10.200.3.2 port 5001

[ 4] local 10.200.3.1 port 57674 connected with 10.200.3.2 port 5001

[ 7] local 10.200.3.1 port 57676 connected with 10.200.3.2 port 5001

[ 5] local 10.200.3.1 port 57677 connected with 10.200.3.2 port 5001

[ 8] local 10.200.3.1 port 57678 connected with 10.200.3.2 port 5001

[ ID] Interval Transfer Bandwidth

[ 6] 0.0-10.0 sec 3.66 GBytes 3.14 Gbits/sec

[ 3] 0.0-10.0 sec 4.04 GBytes 3.47 Gbits/sec

[ 4] 0.0-10.0 sec 4.04 GBytes 3.47 Gbits/sec

[ 7] 0.0-10.0 sec 3.56 GBytes 3.06 Gbits/sec

[ 5] 0.0-10.0 sec 3.81 GBytes 3.28 Gbits/sec

[ 8] 0.0-10.0 sec 3.91 GBytes 3.35 Gbits/sec

[sUM] 0.0-10.0 sec 23.0 GBytes 19.8 Gbits/sec

[ 6] 10.0-20.0 sec 3.50 GBytes 3.01 Gbits/sec

[ 3] 10.0-20.0 sec 4.04 GBytes 3.47 Gbits/sec

[ 4] 10.0-20.0 sec 3.66 GBytes 3.15 Gbits/sec

[ 7] 10.0-20.0 sec 3.95 GBytes 3.40 Gbits/sec

[ 5] 10.0-20.0 sec 3.96 GBytes 3.40 Gbits/sec

[ 8] 10.0-20.0 sec 3.88 GBytes 3.33 Gbits/sec

[sUM] 10.0-20.0 sec 23.0 GBytes 19.8 Gbits/sec

[ 6] 20.0-30.0 sec 4.05 GBytes 3.48 Gbits/sec

[ 7] 20.0-30.0 sec 3.83 GBytes 3.29 Gbits/sec

[ 5] 20.0-30.0 sec 3.61 GBytes 3.10 Gbits/sec

[ 3] 20.0-30.0 sec 3.84 GBytes 3.30 Gbits/sec

[ 4] 20.0-30.0 sec 3.52 GBytes 3.02 Gbits/sec

[ 8] 20.0-30.0 sec 4.15 GBytes 3.57 Gbits/sec

[sUM] 20.0-30.0 sec 23.0 GBytes 19.8 Gbits/sec

[ 6] 30.0-40.0 sec 3.72 GBytes 3.19 Gbits/sec

[ 3] 30.0-40.0 sec 4.07 GBytes 3.49 Gbits/sec

[ 4] 30.0-40.0 sec 3.50 GBytes 3.01 Gbits/sec

[ 7] 30.0-40.0 sec 3.92 GBytes 3.37 Gbits/sec

[ 5] 30.0-40.0 sec 3.72 GBytes 3.19 Gbits/sec

[ 8] 30.0-40.0 sec 4.08 GBytes 3.51 Gbits/sec

[sUM] 30.0-40.0 sec 23.0 GBytes 19.8 Gbits/sec

[ 6] 40.0-50.0 sec 3.92 GBytes 3.37 Gbits/sec

[ 3] 40.0-50.0 sec 4.04 GBytes 3.47 Gbits/sec

[ 4] 40.0-50.0 sec 3.66 GBytes 3.14 Gbits/sec

[ 7] 40.0-50.0 sec 4.07 GBytes 3.50 Gbits/sec

[ 5] 40.0-50.0 sec 3.54 GBytes 3.04 Gbits/sec

[ 8] 40.0-50.0 sec 3.77 GBytes 3.24 Gbits/sec

[sUM] 40.0-50.0 sec 23.0 GBytes 19.8 Gbits/sec

[ 6] 50.0-60.0 sec 3.80 GBytes 3.26 Gbits/sec

[ 6] 0.0-60.0 sec 22.6 GBytes 3.24 Gbits/sec

[ 3] 50.0-60.0 sec 3.95 GBytes 3.39 Gbits/sec

[ 3] 0.0-60.0 sec 24.0 GBytes 3.43 Gbits/sec

[ 4] 50.0-60.0 sec 4.03 GBytes 3.46 Gbits/sec

[ 4] 0.0-60.0 sec 22.4 GBytes 3.21 Gbits/sec

[ 7] 0.0-60.0 sec 23.2 GBytes 3.32 Gbits/sec

[ 5] 0.0-60.0 sec 22.4 GBytes 3.21 Gbits/sec

[ 8] 0.0-60.0 sec 23.4 GBytes 3.35 Gbits/sec

[sUM] 0.0-60.0 sec 138 GBytes 19.8 Gbits/sec

Näher an die maximal möglichen 20Gbit/Sec kommt man wohl kaum.

[Protoberance]

Sehr schöne Werte. vdx6740 haben wir auch 4 Stück in einer Fabric laufen. Das ist aber nicht meine Baustelle. Die Jungs

im Bereich Server & Storage spielen mit den Geräten rum.

Hast du eigentlich für die vdx eine Backuplösung für die Config ? Leider funktioniert das nicht out of the box mit Rancid, daher dachte ich an eine

Lösung über TFTP.