STP / MLAG issue


Hi Taken this out from my general question (newbie) 2016-08-30T11:59:29.699401+10:00 hpswitch2 kernel: [ 4239.382534] lacp-ybortr2: Setting ad_actor_system to 44:38:39:ff:00:01 2016-08-30T11:59:29.706433+10:00 hpswitch2 kernel: [ 4239.389469] 8021q: adding VLAN 0 to HW filter on device lacp-ybortr2 2016-08-30T11:59:29.714404+10:00 hpswitch2 kernel: [ 4239.397008] lacp-ybosw3: Setting ad_actor_system to 44:38:39:ff:00:01 2016-08-30T11:59:29.721404+10:00 hpswitch2 kernel: [ 4239.404422] 8021q: adding VLAN 0 to HW filter on device lacp-ybosw3 2016-08-30T11:59:29.782539+10:00 hpswitch2 mstpd: one_clag_cmd: setting (1) clag state: up 2016-08-30T11:59:29.785219+10:00 hpswitch2 mstpd: clag_set_sys_mac_br: set br-trunk mac 44:38:39:ff:00:01 2016-08-30T11:59:29.785762+10:00 hpswitch2 mstpd: PSTSM_to_DISCARDING: br-trunk:lacp-ybortr2:0 entering Disabled role 2016-08-30T11:59:29.786172+10:00 hpswitch2 mstpd: PSTSM_to_DISCARDING: br-trunk:lacp-ybosw3:0 entering Disabled role 2016-08-30T11:59:29.786591+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:peerlink:0 entering blocking state(Disabled) 2016-08-30T11:59:29.786995+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:swp33:0 entering blocking state(Disabled) 2016-08-30T11:59:29.787413+10:00 hpswitch2 mstpd: MSTP_OUT_flush_all_fids: br-trunk:lacp-ybosw3:0 Flushing forwarding database 2016-08-30T11:59:29.787801+10:00 hpswitch2 mstpd: MSTP_OUT_flush_all_fids: br-trunk:peerlink:0 Flushing forwarding database 2016-08-30T11:59:29.788182+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:swp33:0 entering learning state(Designated) 2016-08-30T11:59:29.788581+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:swp33:0 entering forwarding state(Designated) 2016-08-30T11:59:30.160110+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:peerlink:0 entering learning state(Root) 2016-08-30T11:59:30.160717+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:peerlink:0 entering forwarding state(Root) 2016-08-30T11:59:31.605424+10:00 hpswitch2 kernel: [ 4241.289309] lacp-ybortr2: link status definitely up for interface swp17, 10000 Mbps full duplex 2016-08-30T11:59:31.605438+10:00 hpswitch2 kernel: [ 4241.289321] lacp-ybortr2: now running without any active interface! 2016-08-30T11:59:33.865040+10:00 hpswitch2 mstpd: set_if_up: Port lacp-ybortr2 : up 2016-08-30T11:59:33.866329+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:lacp-ybortr2:0 entering learning state(Designated) 2016-08-30T11:59:33.866975+10:00 hpswitch2 mstpd: MSTP_OUT_set_state: br-trunk:lacp-ybortr2:0 entering forwarding state(Designated) 2016-08-30T11:59:34.787822+10:00 hpswitch2 mstpd: one_clag_cmd: setting (1) mac 4c:5e:0c:c8:f3:80 2016-08-30T12:00:01.237033+10:00 hpswitch2 CRON[9268]: pam_unix(cron:session): session opened for user root by (uid=0) for some reason there is a STP issue that is causing these ports to keep flapping and I am not sure what is going on # This file describes the network interfaces available on your system # and how to activate them. For more information, see interfaces(5). source /etc/network/interfaces.d/*.intf # The loopback network interface auto lo iface lo inet loopback # The primary network interface auto eth0 #iface eth0 inet dhcp iface eth0 address 10.172.250.52/24 gateway 10.172.250.1 mtu 9216 # # MLAG auto peerlink iface peerlink bond-slaves swp49 swp52 mtu 9216 auto peerlink.4094 iface peerlink.4094 address 169.254.255.2 netmask 255.255.255.0 clagd-priority 8192 clagd-peer-ip 169.254.255.1 clagd-backup-ip 10.172.250.51 clagd-sys-mac 44:38:39:ff:00:01 # LACP to ybosw3 # swp1 - sw1 -> ybosw3 A te1/0/18 # swp1 - sw2 -> ybosw3 B te1/0/19 # swp2 - sw1 -> ybosw3 A te2/0/18 # swp2 - sw2 -> ybosw3 B te2/0/19 auto lacp-ybosw3 iface lacp-ybosw3 bond-slaves swp1 swp2 mtu 9216 clag-id 1 # LACP to ybortr2 # swp17 - sfp1 # swp17 - sfp2 auto lacp-ybortr2 iface lacp-ybortr2 bond-slaves swp17 mtu 9216 clag-id 2 mstpctl-portadminedge yes mstpctl-portbpdufilter yes #mstpctl-bpduguard yes # bridge that carries everything ?? auto br-trunk iface br-trunk mtu 9216 bridge-vlan-aware yes bridge-vids 4-5 8-11 17-19 24 80 95 99 201-205 207-209 212-222,250 bridge-pvid 1 bridge-ports lacp-ybosw3 lacp-ybortr2 swp33 peerlink bridge-stp on mstpctl-treeprio 32768 #mstpctl-treeprio 8192 # # vlans auto br-trunk.212 iface br-trunk.212 address 10.172.212.22 netmask 255.255.255.0 # vrrp setup #address-virtual 00:00:5E:00:01:ee 10.172.212.1/24 auto br-trunk.213 iface br-trunk.213 address 10.172.213.22 netmask 255.255.255.0 # # esx host # swp33 - sw1 - vmnic2 te1/0/20 # swp33 - sw1 - vmnic7 te2/0/20 auto swp33 iface swp33 mtu 9216 mstpctl-portadminedge yes mstpctl-bpduguard yes similiar setup on my hpsw1 switch auto lacp-ybortr2 iface lacp-ybortr2 bond-slaves swp17 mtu 9216 clag-id 2 mstpctl-portadminedge yes mstpctl-portbpdufilter yes why is this one causing problems when I have filter on it ??? why is it talking about vlan 0 ????

2 replies

Think i might have found my problem .... my switches MTU are set to 9216, which is what I set on the iface... but my l3 mtu is set at 9000. so on my rtr on its LACP end it saw a 9000 mtu device with cunulus seeing at 9216 link. seems like that was causing issuse. Now on my router I can set the l2mtu and the l3tmu. is there a way to set the l2mtu on cumulus I tried this auto br-trunk iface br-trunk #mtu 9216 mtu 9000 bridge-vlan-aware yes bridge-vids 4-5 8-11 17-19 24 80 95 99 201-205 207-209 212-222,250 bridge-pvid 1 bridge-ports lacp-ybosw3 lacp-ybortr2 swp33 peerlink bridge-stp on mstpctl-treeprio 32768 #mstpctl-treeprio 8192 with auto lacp-ybortr2 iface lacp-ybortr2 bond-slaves swp17 #mtu 9216 mtu 9000 clag-id 2 mstpctl-portadminedge yes mstpctl-portbpdufilter yes #mstpctl-bpduguard yes but I can't set br_trunk to mtu 9216 and leave the lacp-ybortr2 to 9000 A
Userlevel 4
The bridge MTU inheritance goes the other way (bottom up). Remove the MTU from the br-trunk and apply MTU to the other bonds or physical interfaces and you can have different MTUs per bond that are all part of the same trunk. I just tested it on my Cumulus VX, let me know if that works for you.

Reply