Odd Issue - STP Flap followed by port flap

[mhoppes]

So tonight I saw an odd issue I've never seen before, but the other addition is this is the first STP flap since installing a MikroTik traffic shaper on the network.

As a storm rolled through the primary airFiber24 failed over to the 5GHz link, this happened a few times... eventually Port 12 just started going bizurk going up/down/up/down/up/down and finally was flapping so fast no traffic would pass over it until I got on scene and bypasssed the MikroTik and connected the switch directly to the EdgeRouter.

I'm inclined to blame the MikroTik since this setup has worked fine literally for over a year.

The odd part is neither device showed any errors besides the STP switch. Any thoughts? Actually looking at it now it looks like Port 12 went down at almost the exact moment STP kicked in (so packets would have been storming for 2 seconds trying to find a path)

Ignore the date.... NTP wasn't configured properly on this switch. It is now!

Code: Select all

 May 14 04:24:16 kernel: link state changed to 'down' on port 12
May 14 04:24:18 STP: set port 1 to discarding
May 14 04:24:18 STP: set port 3 to learning
May 14 04:24:18 STP: set port 3 to forwarding
May 14 04:24:18 kernel: link state changed to 'up' on port 12
May 14 04:24:20 STP: set port 1 to learning
May 14 04:24:21 STP: set port 1 to forwarding
May 14 04:24:30 kernel: link state changed to 'down' on port 12
May 14 04:24:32 kernel: link state changed to 'up' on port 12
May 14 04:24:49 kernel: link state changed to 'down' on port 12
May 14 04:24:51 kernel: link state changed to 'up' on port 12
May 14 04:25:08 kernel: link state changed to 'down' on port 12
May 14 04:25:10 kernel: link state changed to 'up' on port 12
May 14 04:25:27 kernel: link state changed to 'down' on port 12
May 14 04:25:29 kernel: link state changed to 'up' on port 12
May 14 04:25:41 kernel: link state changed to 'down' on port 12
May 14 04:25:43 kernel: link state changed to 'up' on port 12
May 14 04:26:00 kernel: link state changed to 'down' on port 12
May 14 04:26:02 kernel: link state changed to 'up' on port 12
May 14 04:26:19 kernel: link state changed to 'down' on port 12
May 14 04:26:21 kernel: link state changed to 'up' on port 12
May 14 04:26:38 kernel: link state changed to 'down' on port 12
May 14 04:26:40 kernel: link state changed to 'up' on port 12
May 14 04:26:57 kernel: link state changed to 'down' on port 12
May 14 04:26:59 kernel: link state changed to 'up' on port 12
May 14 04:27:16 kernel: link state changed to 'down' on port 12
May 14 04:27:18 kernel: link state changed to 'up' on port 12
May 14 04:27:35 kernel: link state changed to 'down' on port 12
May 14 04:27:37 kernel: link state changed to 'up' on port 12
May 14 04:27:54 kernel: link state changed to 'down' on port 12
May 14 04:27:56 kernel: link state changed to 'up' on port 12
May 14 04:28:13 kernel: link state changed to 'down' on port 12
May 14 04:28:15 kernel: link state changed to 'up' on port 12
May 14 04:28:32 kernel: link state changed to 'down' on port 12
May 14 04:28:34 kernel: link state changed to 'up' on port 12
May 14 04:28:51 kernel: link state changed to 'down' on port 12
May 14 04:28:53 kernel: link state changed to 'up' on port 12
May 14 04:29:10 kernel: link state changed to 'down' on port 12
May 14 04:29:12 kernel: link state changed to 'up' on port 12
May 14 04:29:29 kernel: link state changed to 'down' on port 12
May 14 04:29:31 kernel: link state changed to 'up' on port 12
May 14 04:29:48 kernel: link state changed to 'down' on port 12
May 14 04:29:50 kernel: link state changed to 'up' on port 12
May 14 04:30:07 kernel: link state changed to 'down' on port 12
May 14 04:30:09 kernel: link state changed to 'up' on port 12
May 14 04:30:26 kernel: link state changed to 'down' on port 12
May 14 04:30:28 kernel: link state changed to 'up' on port 12
May 14 04:30:45 kernel: link state changed to 'down' on port 12
May 14 04:30:47 kernel: link state changed to 'up' on port 12
May 14 04:31:04 kernel: link state changed to 'down' on port 12
May 14 04:31:06 kernel: link state changed to 'up' on port 12
May 14 04:31:23 kernel: link state changed to 'down' on port 12
May 14 04:31:25 kernel: link state changed to 'up' on port 12
May 14 04:31:42 kernel: link state changed to 'down' on port 12
May 14 04:31:44 kernel: link state changed to 'up' on port 12
May 14 04:32:01 kernel: link state changed to 'down' on port 12
May 14 04:32:03 kernel: link state changed to 'up' on port 12
May 14 04:32:20 kernel: link state changed to 'down' on port 12
May 14 04:32:22 kernel: link state changed to 'up' on port 12
May 14 04:32:39 kernel: link state changed to 'down' on port 12
May 14 04:32:41 kernel: link state changed to 'up' on port 12
May 14 04:32:58 kernel: link state changed to 'down' on port 12
May 14 04:33:00 kernel: link state changed to 'up' on port 12
May 14 04:33:17 kernel: link state changed to 'down' on port 12
May 14 04:33:19 kernel: link state changed to 'up' on port 12
May 14 04:33:36 kernel: link state changed to 'down' on port 12
May 14 04:33:38 kernel: link state changed to 'up' on port 12
May 14 04:33:55 kernel: link state changed to 'down' on port 12
May 14 04:33:57 kernel: link state changed to 'up' on port 12
May 14 04:34:14 kernel: link state changed to 'down' on port 12
May 14 04:34:16 kernel: link state changed to 'up' on port 12
May 14 04:34:33 kernel: link state changed to 'down' on port 12
May 14 04:34:35 kernel: link state changed to 'up' on port 12
May 14 04:34:52 kernel: link state changed to 'down' on port 12
May 14 04:34:54 kernel: link state changed to 'up' on port 12
May 14 04:35:06 kernel: link state changed to 'down' on port 12
May 14 04:35:08 kernel: link state changed to 'up' on port 12
May 14 04:35:25 kernel: link state changed to 'down' on port 12
May 14 04:35:27 kernel: link state changed to 'up' on port 12
May 14 04:35:44 kernel: link state changed to 'down' on port 12
May 14 04:35:46 kernel: link state changed to 'up' on port 12
May 14 04:36:03 kernel: link state changed to 'down' on port 12
May 14 04:36:05 kernel: link state changed to 'up' on port 12
May 14 04:36:22 kernel: link state changed to 'down' on port 12
May 14 04:36:24 kernel: link state changed to 'up' on port 12
May 14 04:36:41 kernel: link state changed to 'down' on port 12
May 14 04:36:43 kernel: link state changed to 'up' on port 12
May 14 04:37:00 kernel: link state changed to 'down' on port 12
May 14 04:37:02 kernel: link state changed to 'up' on port 12
May 14 04:37:19 kernel: link state changed to 'down' on port 12
May 14 04:37:21 kernel: link state changed to 'up' on port 12
May 14 04:37:38 kernel: link state changed to 'down' on port 12
May 14 04:37:40 kernel: link state changed to 'up' on port 12
May 14 04:37:57 kernel: link state changed to 'down' on port 12
May 14 04:37:59 kernel: link state changed to 'up' on port 12
May 14 04:38:11 kernel: link state changed to 'down' on port 12
May 14 04:38:13 kernel: link state changed to 'up' on port 12
May 14 04:38:30 kernel: link state changed to 'down' on port 12
May 14 04:38:32 kernel: link state changed to 'up' on port 12
May 14 04:38:49 kernel: link state changed to 'down' on port 12
May 14 04:38:51 kernel: link state changed to 'up' on port 12
May 14 04:39:08 kernel: link state changed to 'down' on port 12
May 14 04:39:10 kernel: link state changed to 'up' on port 12
May 14 04:39:27 kernel: link state changed to 'down' on port 12
May 14 04:39:29 kernel: link state changed to 'up' on port 12
May 14 04:39:46 kernel: link state changed to 'down' on port 12
May 14 04:39:48 kernel: link state changed to 'up' on port 12
May 14 04:40:05 kernel: link state changed to 'down' on port 12
May 14 04:40:07 kernel: link state changed to 'up' on port 12
May 14 04:40:24 kernel: link state changed to 'down' on port 12
May 14 04:40:26 kernel: link state changed to 'up' on port 12
May 14 04:40:43 kernel: link state changed to 'down' on port 12
May 14 04:40:45 kernel: link state changed to 'up' on port 12
May 14 04:40:58 STP: set port 3 to discarding
May 14 04:41:02 kernel: link state changed to 'down' on port 12
May 14 04:41:04 kernel: link state changed to 'up' on port 12
May 14 04:41:26 kernel: link state changed to 'down' on port 12
May 14 04:41:28 kernel: link state changed to 'up' on port 12
May 14 04:41:45 kernel: link state changed to 'down' on port 12
May 14 04:41:47 kernel: link state changed to 'up' on port 12
May 14 04:42:09 kernel: link state changed to 'down' on port 12
May 14 04:42:11 kernel: link state changed to 'up' on port 12
May 14 04:42:28 kernel: link state changed to 'down' on port 12
May 14 04:42:30 kernel: link state changed to 'up' on port 12
May 14 04:42:47 kernel: link state changed to 'down' on port 12
May 14 04:42:49 kernel: link state changed to 'up' on port 12
May 14 04:43:11 kernel: link state changed to 'down' on port 12
May 14 04:43:13 kernel: link state changed to 'up' on port 12
May 14 04:43:30 kernel: link state changed to 'down' on port 12
May 14 04:43:32 kernel: link state changed to 'up' on port 12
May 14 04:43:44 kernel: link state changed to 'down' on port 12
May 14 04:43:46 kernel: link state changed to 'up' on port 12
May 14 04:44:08 kernel: link state changed to 'down' on port 12
May 14 04:44:10 kernel: link state changed to 'up' on port 12
May 14 04:44:27 kernel: link state changed to 'down' on port 12
May 14 04:44:29 kernel: link state changed to 'up' on port 12
May 14 04:44:46 kernel: link state changed to 'down' on port 12
May 14 04:44:48 kernel: link state changed to 'up' on port 12
May 14 04:45:05 kernel: link state changed to 'down' on port 12
May 14 04:45:07 kernel: link state changed to 'up' on port 12
May 14 04:45:29 kernel: link state changed to 'down' on port 12
May 14 04:45:31 kernel: link state changed to 'up' on port 12
May 14 04:45:53 kernel: link state changed to 'down' on port 12
May 14 04:45:55 kernel: link state changed to 'up' on port 12
May 14 04:46:17 kernel: link state changed to 'down' on port 12
May 14 04:46:19 kernel: link state changed to 'up' on port 12
May 14 04:46:36 kernel: link state changed to 'down' on port 12
May 14 04:46:38 kernel: link state changed to 'up' on port 12
May 14 04:46:55 kernel: link state changed to 'down' on port 12
May 14 04:46:57 kernel: link state changed to 'up' on port 12
May 14 04:47:14 kernel: link state changed to 'down' on port 12
May 14 04:47:16 kernel: link state changed to 'up' on port 12
May 14 04:47:33 kernel: link state changed to 'down' on port 12
May 14 04:47:35 kernel: link state changed to 'up' on port 12
May 14 04:47:52 kernel: link state changed to 'down' on port 12
May 14 04:47:54 kernel: link state changed to 'up' on port 12
May 14 04:48:11 kernel: link state changed to 'down' on port 12
May 14 04:48:13 kernel: link state changed to 'up' on port 12
May 14 04:48:35 kernel: link state changed to 'down' on port 12
May 14 04:48:37 kernel: link state changed to 'up' on port 12
May 14 04:48:59 kernel: link state changed to 'down' on port 12
May 14 04:49:01 kernel: link state changed to 'up' on port 12
May 14 04:49:18 kernel: link state changed to 'down' on port 12
May 14 04:49:20 kernel: link state changed to 'up' on port 12
May 14 04:49:37 kernel: link state changed to 'down' on port 12
May 14 04:49:39 kernel: link state changed to 'up' on port 12
May 14 04:49:56 kernel: link state changed to 'down' on port 12
May 14 04:49:58 kernel: link state changed to 'up' on port 12
May 14 04:50:15 kernel: link state changed to 'down' on port 12
May 14 04:50:17 kernel: link state changed to 'up' on port 12
May 14 04:50:39 kernel: link state changed to 'down' on port 12
May 14 04:50:41 kernel: link state changed to 'up' on port 12
May 14 04:50:58 kernel: link state changed to 'down' on port 12
May 14 04:51:00 kernel: link state changed to 'up' on port 12
May 14 04:51:22 kernel: link state changed to 'down' on port 12
May 14 04:51:24 kernel: link state changed to 'up' on port 12
May 14 04:51:46 kernel: link state changed to 'down' on port 12
May 14 04:51:48 kernel: link state changed to 'up' on port 12
May 14 04:52:05 kernel: link state changed to 'down' on port 12
May 14 04:52:07 kernel: link state changed to 'up' on port 12
May 14 04:52:10 STP: set port 1 to discarding
May 14 04:52:10 STP: set port 3 to learning
May 14 04:52:10 STP: set port 3 to forwarding
May 14 04:52:12 STP: set port 1 to learning
May 14 04:52:13 STP: set port 1 to forwarding
May 14 04:52:29 kernel: link state changed to 'down' on port 12
May 14 04:52:31 kernel: link state changed to 'up' on port 12
May 14 04:52:48 kernel: link state changed to 'down' on port 12
May 14 04:52:50 kernel: link state changed to 'up' on port 12
May 14 04:53:02 kernel: link state changed to 'down' on port 12
May 14 04:53:04 kernel: link state changed to 'up' on port 12
May 14 04:53:26 kernel: link state changed to 'down' on port 12
May 14 04:53:28 kernel: link state changed to 'up' on port 12
May 14 04:53:50 kernel: link state changed to 'down' on port 12
May 14 04:53:52 kernel: link state changed to 'up' on port 12
May 14 04:54:14 kernel: link state changed to 'down' on port 12
May 14 04:54:16 kernel: link state changed to 'up' on port 12
May 14 04:54:33 kernel: link state changed to 'down' on port 12
May 14 04:54:35 kernel: link state changed to 'up' on port 12
May 14 04:54:52 kernel: link state changed to 'down' on port 12
May 14 04:54:54 kernel: link state changed to 'up' on port 12
May 14 04:55:11 kernel: link state changed to 'down' on port 12
May 14 04:55:13 kernel: link state changed to 'up' on port 12
May 14 04:55:35 kernel: link state changed to 'down' on port 12
May 14 04:55:37 kernel: link state changed to 'up' on port 12
May 14 04:55:59 kernel: link state changed to 'down' on port 12
May 14 04:56:01 kernel: link state changed to 'up' on port 12
May 14 04:56:11 kernel: link state changed to 'up' on port 2
May 14 04:56:23 kernel: link state changed to 'down' on port 12
May 14 04:56:25 kernel: link state changed to 'up' on port 12
May 14 04:56:47 kernel: link state changed to 'down' on port 12
May 14 04:56:49 kernel: link state changed to 'up' on port 12
May 14 04:57:03 kernel: link state changed to 'down' on port 2
May 14 04:57:06 kernel: link state changed to 'down' on port 12
May 14 04:57:08 kernel: link state changed to 'up' on port 12
May 14 04:57:15 kernel: link state changed to 'up' on port 2
May 14 04:57:25 kernel: link state changed to 'down' on port 12
May 14 04:57:27 kernel: link state changed to 'up' on port 12
May 14 04:57:44 kernel: link state changed to 'down' on port 12
May 14 04:57:46 kernel: link state changed to 'up' on port 12
May 14 04:58:03 kernel: link state changed to 'down' on port 12
May 14 04:58:05 kernel: link state changed to 'up' on port 12
May 14 04:58:24 kernel: link state changed to 'down' on port 12
May 14 04:58:27 kernel: link state changed to 'up' on port 12

[sirhc]

This is not STP flapping this was the port link between the MicroTik and the WISP Switch going up and down very fast.

The times you see STP kicking in is when the link is up long enough for STP to determine there is a link and then it goes up and down again in rapid succession.

What you have here is an unstable Ethernet Link to the MicroTik.

You say when you remove it from the mix and plug the switch directly into the AF the link stabilized immediately and work so I would look at that device.

[mhoppes]

Read my post again. The STP started the issue. When the storm came through the STP did what it was suppose to. As soon as that happened the Mikrotik went crazy.

The two radios running STP are on the switch and have nothing to do with the Mikrotik.

It's like when the packets backed up for a second during the STP transition the port between the Mikrotik and wisp switch just started flapping.

[sirhc]

As a storm rolled through the primary airFiber24 failed over to the 5GHz link, this happened a few times... eventually Port 12 just started going bizurk going up/down/up/down/up/down and finally was flapping so fast no traffic would pass over it until I got on scene and bypassed the MikroTik and connected the switch directly to the EdgeRouter.

I'm inclined to blame the MikroTik since this setup has worked fine literally for over a year.

So this is where I thought you said you by bypassing the MT device made it resume normal operations?

May 14 04:24:16 kernel: link state changed to 'down' on port 12
May 14 04:24:18 STP: set port 1 to discarding
May 14 04:24:18 STP: set port 3 to learning
May 14 04:24:18 STP: set port 3 to forwarding
May 14 04:24:18 kernel: link state changed to 'up' on port 12
May 14 04:24:20 STP: set port 1 to learning
May 14 04:24:21 STP: set port 1 to forwarding
May 14 04:24:30 kernel: link state changed to 'down' on port 12
May 14 04:24:32 kernel: link state changed to 'up' on port 12
May 14 04:24:49 kernel: link state changed to 'down' on port 12
May 14 04:24:51 kernel: link state changed to 'up' on port 12
May 14 04:25:08 kernel: link state changed to 'down' on port 12
May 14 04:25:10 kernel: link state changed to 'up' on port 12
May 14 04:25:27 kernel: link state changed to 'down' on port 12
May 14 04:25:29 kernel: link state changed to 'up' on port 12
May 14 04:25:41 kernel: link state changed to 'down' on port 12
May 14 04:25:43 kernel: link state changed to 'up' on port 12
May 14 04:26:00 kernel: link state changed to 'down' on port 12
May 14 04:26:02 kernel: link state changed to 'up' on port 12
May 14 04:26:19 kernel: link state changed to 'down' on port 12
May 14 04:26:21 kernel: link state changed to 'up' on port 12
May 14 04:26:38 kernel: link state changed to 'down' on port 12
May 14 04:26:40 kernel: link state changed to 'up' on port 12
May 14 04:26:57 kernel: link state changed to 'down' on port 12
May 14 04:26:59 kernel: link state changed to 'up' on port 12
May 14 04:27:16 kernel: link state changed to 'down' on port 12
May 14 04:27:18 kernel: link state changed to 'up' on port 12
May 14 04:27:35 kernel: link state changed to 'down' on port 12
May 14 04:27:37 kernel: link state changed to 'up' on port 12
May 14 04:27:54 kernel: link state changed to 'down' on port 12
May 14 04:27:56 kernel: link state changed to 'up' on port 12
May 14 04:28:13 kernel: link state changed to 'down' on port 12
May 14 04:28:15 kernel: link state changed to 'up' on port 12
May 14 04:28:32 kernel: link state changed to 'down' on port 12
May 14 04:28:34 kernel: link state changed to 'up' on port 12
May 14 04:28:51 kernel: link state changed to 'down' on port 12
May 14 04:28:53 kernel: link state changed to 'up' on port 12
May 14 04:29:10 kernel: link state changed to 'down' on port 12
May 14 04:29:12 kernel: link state changed to 'up' on port 12
May 14 04:29:29 kernel: link state changed to 'down' on port 12
May 14 04:29:31 kernel: link state changed to 'up' on port 12
May 14 04:29:48 kernel: link state changed to 'down' on port 12
May 14 04:29:50 kernel: link state changed to 'up' on port 12
May 14 04:30:07 kernel: link state changed to 'down' on port 12
May 14 04:30:09 kernel: link state changed to 'up' on port 12
May 14 04:30:26 kernel: link state changed to 'down' on port 12
May 14 04:30:28 kernel: link state changed to 'up' on port 12
May 14 04:30:45 kernel: link state changed to 'down' on port 12
May 14 04:30:47 kernel: link state changed to 'up' on port 12
May 14 04:31:04 kernel: link state changed to 'down' on port 12
May 14 04:31:06 kernel: link state changed to 'up' on port 12
May 14 04:31:23 kernel: link state changed to 'down' on port 12
May 14 04:31:25 kernel: link state changed to 'up' on port 12
May 14 04:31:42 kernel: link state changed to 'down' on port 12
May 14 04:31:44 kernel: link state changed to 'up' on port 12
May 14 04:32:01 kernel: link state changed to 'down' on port 12
May 14 04:32:03 kernel: link state changed to 'up' on port 12
May 14 04:32:20 kernel: link state changed to 'down' on port 12
May 14 04:32:22 kernel: link state changed to 'up' on port 12
May 14 04:32:39 kernel: link state changed to 'down' on port 12
May 14 04:32:41 kernel: link state changed to 'up' on port 12
May 14 04:32:58 kernel: link state changed to 'down' on port 12
May 14 04:33:00 kernel: link state changed to 'up' on port 12
May 14 04:33:17 kernel: link state changed to 'down' on port 12
May 14 04:33:19 kernel: link state changed to 'up' on port 12
May 14 04:33:36 kernel: link state changed to 'down' on port 12
May 14 04:33:38 kernel: link state changed to 'up' on port 12
May 14 04:33:55 kernel: link state changed to 'down' on port 12
May 14 04:33:57 kernel: link state changed to 'up' on port 12
May 14 04:34:14 kernel: link state changed to 'down' on port 12
May 14 04:34:16 kernel: link state changed to 'up' on port 12
May 14 04:34:33 kernel: link state changed to 'down' on port 12
May 14 04:34:35 kernel: link state changed to 'up' on port 12
May 14 04:34:52 kernel: link state changed to 'down' on port 12
May 14 04:34:54 kernel: link state changed to 'up' on port 12
May 14 04:35:06 kernel: link state changed to 'down' on port 12
May 14 04:35:08 kernel: link state changed to 'up' on port 12
May 14 04:35:25 kernel: link state changed to 'down' on port 12
May 14 04:35:27 kernel: link state changed to 'up' on port 12
May 14 04:35:44 kernel: link state changed to 'down' on port 12
May 14 04:35:46 kernel: link state changed to 'up' on port 12
May 14 04:36:03 kernel: link state changed to 'down' on port 12
May 14 04:36:05 kernel: link state changed to 'up' on port 12
May 14 04:36:22 kernel: link state changed to 'down' on port 12
May 14 04:36:24 kernel: link state changed to 'up' on port 12
May 14 04:36:41 kernel: link state changed to 'down' on port 12
May 14 04:36:43 kernel: link state changed to 'up' on port 12
May 14 04:37:00 kernel: link state changed to 'down' on port 12
May 14 04:37:02 kernel: link state changed to 'up' on port 12
May 14 04:37:19 kernel: link state changed to 'down' on port 12
May 14 04:37:21 kernel: link state changed to 'up' on port 12
May 14 04:37:38 kernel: link state changed to 'down' on port 12
May 14 04:37:40 kernel: link state changed to 'up' on port 12
May 14 04:37:57 kernel: link state changed to 'down' on port 12
May 14 04:37:59 kernel: link state changed to 'up' on port 12
May 14 04:38:11 kernel: link state changed to 'down' on port 12
May 14 04:38:13 kernel: link state changed to 'up' on port 12
May 14 04:38:30 kernel: link state changed to 'down' on port 12
May 14 04:38:32 kernel: link state changed to 'up' on port 12
May 14 04:38:49 kernel: link state changed to 'down' on port 12
May 14 04:38:51 kernel: link state changed to 'up' on port 12
May 14 04:39:08 kernel: link state changed to 'down' on port 12
May 14 04:39:10 kernel: link state changed to 'up' on port 12
May 14 04:39:27 kernel: link state changed to 'down' on port 12
May 14 04:39:29 kernel: link state changed to 'up' on port 12
May 14 04:39:46 kernel: link state changed to 'down' on port 12
May 14 04:39:48 kernel: link state changed to 'up' on port 12
May 14 04:40:05 kernel: link state changed to 'down' on port 12
May 14 04:40:07 kernel: link state changed to 'up' on port 12
May 14 04:40:24 kernel: link state changed to 'down' on port 12
May 14 04:40:26 kernel: link state changed to 'up' on port 12
May 14 04:40:43 kernel: link state changed to 'down' on port 12
May 14 04:40:45 kernel: link state changed to 'up' on port 12
May 14 04:40:58 STP: set port 3 to discarding
May 14 04:41:02 kernel: link state changed to 'down' on port 12
May 14 04:41:04 kernel: link state changed to 'up' on port 12
May 14 04:41:26 kernel: link state changed to 'down' on port 12
May 14 04:41:28 kernel: link state changed to 'up' on port 12
May 14 04:41:45 kernel: link state changed to 'down' on port 12
May 14 04:41:47 kernel: link state changed to 'up' on port 12
May 14 04:42:09 kernel: link state changed to 'down' on port 12
May 14 04:42:11 kernel: link state changed to 'up' on port 12
May 14 04:42:28 kernel: link state changed to 'down' on port 12
May 14 04:42:30 kernel: link state changed to 'up' on port 12
May 14 04:42:47 kernel: link state changed to 'down' on port 12
May 14 04:42:49 kernel: link state changed to 'up' on port 12
May 14 04:43:11 kernel: link state changed to 'down' on port 12
May 14 04:43:13 kernel: link state changed to 'up' on port 12
May 14 04:43:30 kernel: link state changed to 'down' on port 12
May 14 04:43:32 kernel: link state changed to 'up' on port 12
May 14 04:43:44 kernel: link state changed to 'down' on port 12
May 14 04:43:46 kernel: link state changed to 'up' on port 12
May 14 04:44:08 kernel: link state changed to 'down' on port 12
May 14 04:44:10 kernel: link state changed to 'up' on port 12
May 14 04:44:27 kernel: link state changed to 'down' on port 12
May 14 04:44:29 kernel: link state changed to 'up' on port 12
May 14 04:44:46 kernel: link state changed to 'down' on port 12
May 14 04:44:48 kernel: link state changed to 'up' on port 12
May 14 04:45:05 kernel: link state changed to 'down' on port 12
May 14 04:45:07 kernel: link state changed to 'up' on port 12
May 14 04:45:29 kernel: link state changed to 'down' on port 12
May 14 04:45:31 kernel: link state changed to 'up' on port 12
May 14 04:45:53 kernel: link state changed to 'down' on port 12
May 14 04:45:55 kernel: link state changed to 'up' on port 12
May 14 04:46:17 kernel: link state changed to 'down' on port 12
May 14 04:46:19 kernel: link state changed to 'up' on port 12
May 14 04:46:36 kernel: link state changed to 'down' on port 12
May 14 04:46:38 kernel: link state changed to 'up' on port 12
May 14 04:46:55 kernel: link state changed to 'down' on port 12
May 14 04:46:57 kernel: link state changed to 'up' on port 12
May 14 04:47:14 kernel: link state changed to 'down' on port 12
May 14 04:47:16 kernel: link state changed to 'up' on port 12
May 14 04:47:33 kernel: link state changed to 'down' on port 12
May 14 04:47:35 kernel: link state changed to 'up' on port 12
May 14 04:47:52 kernel: link state changed to 'down' on port 12
May 14 04:47:54 kernel: link state changed to 'up' on port 12
May 14 04:48:11 kernel: link state changed to 'down' on port 12
May 14 04:48:13 kernel: link state changed to 'up' on port 12
May 14 04:48:35 kernel: link state changed to 'down' on port 12
May 14 04:48:37 kernel: link state changed to 'up' on port 12
May 14 04:48:59 kernel: link state changed to 'down' on port 12
May 14 04:49:01 kernel: link state changed to 'up' on port 12
May 14 04:49:18 kernel: link state changed to 'down' on port 12
May 14 04:49:20 kernel: link state changed to 'up' on port 12
May 14 04:49:37 kernel: link state changed to 'down' on port 12
May 14 04:49:39 kernel: link state changed to 'up' on port 12
May 14 04:49:56 kernel: link state changed to 'down' on port 12
May 14 04:49:58 kernel: link state changed to 'up' on port 12
May 14 04:50:15 kernel: link state changed to 'down' on port 12
May 14 04:50:17 kernel: link state changed to 'up' on port 12
May 14 04:50:39 kernel: link state changed to 'down' on port 12
May 14 04:50:41 kernel: link state changed to 'up' on port 12
May 14 04:50:58 kernel: link state changed to 'down' on port 12
May 14 04:51:00 kernel: link state changed to 'up' on port 12
May 14 04:51:22 kernel: link state changed to 'down' on port 12
May 14 04:51:24 kernel: link state changed to 'up' on port 12
May 14 04:51:46 kernel: link state changed to 'down' on port 12
May 14 04:51:48 kernel: link state changed to 'up' on port 12
May 14 04:52:05 kernel: link state changed to 'down' on port 12
May 14 04:52:07 kernel: link state changed to 'up' on port 12
May 14 04:52:10 STP: set port 1 to discarding
May 14 04:52:10 STP: set port 3 to learning
May 14 04:52:10 STP: set port 3 to forwarding
May 14 04:52:12 STP: set port 1 to learning
May 14 04:52:13 STP: set port 1 to forwarding
May 14 04:52:29 kernel: link state changed to 'down' on port 12
May 14 04:52:31 kernel: link state changed to 'up' on port 12
May 14 04:52:48 kernel: link state changed to 'down' on port 12
May 14 04:52:50 kernel: link state changed to 'up' on port 12
May 14 04:53:02 kernel: link state changed to 'down' on port 12
May 14 04:53:04 kernel: link state changed to 'up' on port 12
May 14 04:53:26 kernel: link state changed to 'down' on port 12
May 14 04:53:28 kernel: link state changed to 'up' on port 12
May 14 04:53:50 kernel: link state changed to 'down' on port 12
May 14 04:53:52 kernel: link state changed to 'up' on port 12
May 14 04:54:14 kernel: link state changed to 'down' on port 12
May 14 04:54:16 kernel: link state changed to 'up' on port 12
May 14 04:54:33 kernel: link state changed to 'down' on port 12
May 14 04:54:35 kernel: link state changed to 'up' on port 12
May 14 04:54:52 kernel: link state changed to 'down' on port 12
May 14 04:54:54 kernel: link state changed to 'up' on port 12
May 14 04:55:11 kernel: link state changed to 'down' on port 12
May 14 04:55:13 kernel: link state changed to 'up' on port 12
May 14 04:55:35 kernel: link state changed to 'down' on port 12
May 14 04:55:37 kernel: link state changed to 'up' on port 12
May 14 04:55:59 kernel: link state changed to 'down' on port 12
May 14 04:56:01 kernel: link state changed to 'up' on port 12
May 14 04:56:11 kernel: link state changed to 'up' on port 2
May 14 04:56:23 kernel: link state changed to 'down' on port 12
May 14 04:56:25 kernel: link state changed to 'up' on port 12
May 14 04:56:47 kernel: link state changed to 'down' on port 12
May 14 04:56:49 kernel: link state changed to 'up' on port 12
May 14 04:57:03 kernel: link state changed to 'down' on port 2
May 14 04:57:06 kernel: link state changed to 'down' on port 12
May 14 04:57:08 kernel: link state changed to 'up' on port 12
May 14 04:57:15 kernel: link state changed to 'up' on port 2
May 14 04:57:25 kernel: link state changed to 'down' on port 12
May 14 04:57:27 kernel: link state changed to 'up' on port 12
May 14 04:57:44 kernel: link state changed to 'down' on port 12
May 14 04:57:46 kernel: link state changed to 'up' on port 12
May 14 04:58:03 kernel: link state changed to 'down' on port 12
May 14 04:58:05 kernel: link state changed to 'up' on port 12
May 14 04:58:24 kernel: link state changed to 'down' on port 12
May 14 04:58:27 kernel: link state changed to 'up' on port 12

Silly me I thought MT was plugged into port 12, so what is on port 12?

A storm rolls trough and this behavior starts?

OK so please examine all status indicators on switch looking for voltages, temperatures, or wattage out of wack which is a tail tail sign the switch is damaged somewhere along the I2C bus where sensors are located.

Beyond that check all the ports and device and look for something that is causing the behavior.

Try rebooting everything and do some testing.

Provide me with more information like a screen grab of the Status Tab so I know what is plugged in where on your switch.

At this point I do not even know the model, what is plugged in where, what firmware is this running, not really any information at all.

All I know is:
This occurred as a storm rolled through.
The model is not a WS-6-MINI, or a WS-8-250-XX.
There is at least 1 AF unit on one of the ports, presumably on a port between 1 and 4 depending on the model.
There is a MicroTik on one of the ports but no idea which port but apparently not port 12.

Things I need to know:
What Model is this?
What Firmware version?
What is plugged in where?
What have you done to isolate the issue?
Is it still occurring?
Did you eventually put it back as was and all is fine now?

Please provide me with some more information Matt.

[mhoppes]

No backup. I'm clearly not being clear.

airFiber is on port 1
NanoBridge is on port 3
MikroTik is on port 12.

Traffic flows from EdgeRouter through MikroTik into Port 12 of switch then out either Port 1 or 3, with Port 1 being the primary and port 3 being the STP fail over.

I *AM NOT* saying this is/was an issue with the switch. I fully believe this was a MikroTik issue.

What happened was the airFiber dropped the link in heavy rain. When the packets backed up and ARPed looking for a path the MikroTIk started flapping port 12 up/down/up/down and wouldn't stop until I got on scene and removed it from the puzzle.

[sirhc]

What was your outcome?

Did rebooting the MT fix the issue?

What firmware version are you running.

v1.3.3rc5 looks like it will become FINAL version and I am running it with no problems on my towers.

[mhoppes]

The outcome was I removed the MT from the mix and went back to the router going directly into the switch like we've had it for months.

Did not reboot the MT. It had once chance. It's done. I hate MikroTik... we broke up several years ago when Ubiquiti started making network gear, I took a chance because the EdgeRouter couldn't do what I needed. It burned me. Relationship is over .... it's like when you get back together thinking it will be better the second time around? Yeah, not so much.

Very good. I'll upgrade everything to 1.3.3 when that happens.

I still have (don't shoot me) some switches on 1.1.8... any known issues going from 1.1.8 to 1.3.3?

[sirhc]

no the upgrade path is fine

Sorry to hear your relationship is over, I know it hurts a lot but it will get better every day! - lol