Bridge not working


I'm currently trying the most basic of setting up a bridge for a server and a firewall.
I've installed Cumulus on a switch and setup the bridge br0 for swp1-12

cumulus@xxx01$ brctl show
bridge name bridge id STP enabled interfaces
br0 8000.7072cff54afc yes swp1
swp10
swp11
swp12
swp2
swp3
swp4
swp5
swp6
swp7
swp8
swp9

However the fw and server can't see each other and when I do brctl showmacs br0 all interfaces show is local as yes
Looking at the physical device and in the fw the interfaces all looks good
the fw network is configure to
172.16.0.1/16
and the server
172.16.1.1/16

4 replies

Userlevel 4
What ports are the server and firewall on, and can you do a ip link show for those two ports?
server
3: swp1: mtu 1500 qdisc pfifo_fast master br0 state UP mode DEFAULT qlen 500
link/ether 70:72:cf:f5:4a:fc brd ff:ff:ff:ff:ff:ff

firewall
14: swp12: mtu 1500 qdisc pfifo_fast master br0 state UP mode DEFAULT qlen 500
link/ether 70:72:cf:f5:4b:07 brd ff:ff:ff:ff:ff:ff

Userlevel 2
I would open up a support case for this (and attach a cl-support) so they can see if it's a configuration issue or a bug.
From the cl-support which was uploaded to the support case, we confirmed that:

  • The bridge configuration was correctly
# ifquery -a auto lo 
iface lo inet loopback
auto eth0
iface eth0
address 172.17.2.10/16
gateway 172.17.0.1
auto br0
iface br0
bridge-ports glob swp1-12
bridge-stp on
  • The bridge and its slaves were correctly set in the kernel
# bridge -d link 3: swp1 state UP :  mtu 1500 master br0 state forwarding priority 32 cost 4 
hairpin off guard off root_block off fastleave off learning on flood on peerlink off duallink off

14: swp12 state UP : mtu 1500 master br0 state forwarding priority 32 cost 4
hairpin off guard off root_block off fastleave off learning on flood on peerlink off duallink off

  • The STP state and VLAN were correctly programmed in hardware
==================== Port Mapping ==================== # Automatically generated by /usr/lib/cumulus/update-ports. 
# Thu Aug 27 02:16:20 2015
# Do not edit.
# linux_intf sdk_intf unit is_fabric
swp1 ge1 0 0

swp12 ge34 0 0
====================
STP State
====================
# /usr/lib/cumulus/bcmcmd stg show
STG 0: contains 0 VLANs
Disable: ge,xe
STG 1: contains 1 VLAN (1)
Disable: ge,xe
STG 2: contains 52 VLANs (3301-3336,3338-3353)
Disable: ge,xe
STG 3: contains 1 VLAN (3500)
Disable: ge8-ge31,ge36-ge47,xe
Block: ge0,ge2-ge7,ge32-ge33,ge35
Forward: ge1,ge34

====================
VLAN Table
====================
vlan 3500 ports cpu,ge0-ge7,ge32-ge35 (0x0000000000000000000000000000000000000000000000000000001e000001ff), untagged ge0-ge7,ge32-ge35 (0x0000000000000000000000000000000000000000000000000000001e000001fe) MCAST_FLOOD_UNKNOWN

  • There were no packets being received by the interfaces in question.
=================== 
ethtool -S
===================

swp1 : # ethtool -S swp1
NIC statistics:
HwIfInOctets: 0
HwIfInUcastPkts: 0
HwIfInBcastPkts: 0
HwIfInMcastPkts: 0
HwIfOutOctets: 13540
HwIfOutUcastPkts: 0
HwIfOutMcastPkts: 196
HwIfOutBcastPkts: 0
HwIfInDiscards: 0
HwIfInL3Drops: 0
HwIfInBufferDrops: 0
HwIfInAclDrops: 0
HwIfInDot3LengthErrors: 0
HwIfInErrors: 0
SoftInErrors: 0
SoftInDrops: 0
SoftInFrameErrors: 0
HwIfOutDiscards: 0
HwIfOutErrors: 0
HwIfOutQDrops: 0
HwIfOutNonQDrops: 0
SoftOutErrors: 0
SoftOutDrops: 0
SoftOutTxFifoFull: 0
HwIfOutQLen: 0
HwIfInPausePkt: 0
HwIfOutPausePkt: 0
HwIfInPfc0Pkt: 0
HwIfOutPfc0Pkt: 0
HwIfInPfc1Pkt: 0
HwIfOutPfc1Pkt: 0
HwIfInPfc2Pkt: 0
HwIfOutPfc2Pkt: 0
HwIfInPfc3Pkt: 0
HwIfOutPfc3Pkt: 0
HwIfInPfc4Pkt: 0
HwIfOutPfc4Pkt: 0
HwIfInPfc5Pkt: 0
HwIfOutPfc5Pkt: 0
HwIfInPfc6Pkt: 0
HwIfOutPfc6Pkt: 0
HwIfInPfc7Pkt: 0
HwIfOutPfc7Pkt: 0

swp12 : # ethtool -S swp12
NIC statistics:
HwIfInOctets: 0
HwIfInUcastPkts: 0
HwIfInBcastPkts: 0
HwIfInMcastPkts: 0
HwIfOutOctets: 13564
HwIfOutUcastPkts: 0
HwIfOutMcastPkts: 196
HwIfOutBcastPkts: 0
HwIfInDiscards: 0
HwIfInL3Drops: 0
HwIfInBufferDrops: 0
HwIfInAclDrops: 0
HwIfInDot3LengthErrors: 0
HwIfInErrors: 0
SoftInErrors: 0
SoftInDrops: 0
SoftInFrameErrors: 0
HwIfOutDiscards: 0
HwIfOutErrors: 0
HwIfOutQDrops: 0
HwIfOutNonQDrops: 0
SoftOutErrors: 0
SoftOutDrops: 0
SoftOutTxFifoFull: 0
HwIfOutQLen: 0
HwIfInPausePkt: 0
HwIfOutPausePkt: 0
HwIfInPfc0Pkt: 0
HwIfOutPfc0Pkt: 0
HwIfInPfc1Pkt: 0
HwIfOutPfc1Pkt: 0
HwIfInPfc2Pkt: 0
HwIfOutPfc2Pkt: 0
HwIfInPfc3Pkt: 0
HwIfOutPfc3Pkt: 0
HwIfInPfc4Pkt: 0
HwIfOutPfc4Pkt: 0
HwIfInPfc5Pkt: 0
HwIfOutPfc5Pkt: 0
HwIfInPfc6Pkt: 0
HwIfOutPfc6Pkt: 0
HwIfInPfc7Pkt: 0
HwIfOutPfc7Pkt: 0
==================== 
Hardware Counters
====================
# /usr/lib/cumulus/bcmcmd show counters
T64.ge1 : 182 +182
T127.ge1 : 3 +3
T255.ge1 : 13 +13
TPOK.ge1 : 198 +198
TPKT.ge1 : 198 +198
TMCA.ge1 : 198 +198
TBYT.ge1 : 13,668 +13,668
UC_PERQ_PKT(3).ge1 : 198 +198
UC_PERQ_BYTE(3).ge1 : 13,668 +13,668
T64.ge34 : 183 +183 1/s
T127.ge34 : 3 +3
T255.ge34 : 13 +13
TPOK.ge34 : 199 +199 1/s
TPKT.ge34 : 199 +199 1/s
TMCA.ge34 : 199 +199 1/s
TBYT.ge34 : 13,756 +13,756 47/s
UC_PERQ_PKT(3).ge34 : 199 +199 1/s
UC_PERQ_BYTE(3).ge34 : 13,756 +13,756 47/s

Tobad's Cumulus Linux configuration was spot-on correct and the problem was found to be with one of the connecting devices.

Reply