Solved: After firmware upgrade, SG350X is not coming online automatically

JustTom · ‎12-02-2021

Hi folks

Just ran into this issue: I upgraded a SG350X to the latest firmware v2.5.8.15 (coming from v2.5.0.83).

It upgrades fine and all settings are preserved, but the switch only comes online if I unplug and replug an active network cable (in this case: the connection to another SG350X). This needs to be done after every reboot/reload. Clean reboot or unplugging the power doesn't make any difference.

This happens on more than 1 switch, so that leads me to believe I missed a configuration or an additional setting that was introduced since the switch was last upgraded. But I can't seem to find it.

Any idea's?

Kind regards

JustTom

JustTom · ‎12-09-2021

Long story short: I had to downgrade all of my switches (which resulted in all of them losing their config - so a heads up for everyone: please make sure to backup your configs on a regular basis (which luckily, I already did)) to an older version.

After that and then restoring the configs, all works as intended again.

View solution in original post

balaji.bandi · ‎12-02-2021

Is this just single connection, do you see any spanning loops, since its new firmware upgrade you see the issue, suggest to open SMB tac case for help

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

JustTom · ‎12-02-2021

Hi BB

Just FYI: the network layout hasn't changed and worked perfectly before.

The issue is present on our core switch (last switch before firewall/internet breakout), but also on switches that are connected to this core switch.

I also experience this issue on other switches that are connected to another core switch (other building) but where the core switch still has the older firmware version.

I'll open a support case.

Kr

JustTom

balaji.bandi · ‎12-02-2021

agreed, what other obnormal you see on the both the switch Lgos, that help us to find what is the issue, TAC is best for you to each they can easily asses upgrade issues

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

JustTom · ‎12-02-2021

I'll open a new support ticket, when I'm physically near the switch.

I'm not changing configs when I can't perform a reboot without knowing it's coming back online.

This is the RAM log of the switch after restart:

(I removed sensitive data)

*****

2147483596 2021-Oct-05 05:34:10 Warning %STP-W-PORTSTATUS: te1/0/1: STP status Forwarding
2147483597 2021-Oct-05 05:34:10 Informational %LINK-I-Up: te1/0/1
2147483598 2021-Oct-05 05:34:04 Warning %LINK-W-Down: te1/0/1
2147483599 2021-Oct-05 05:29:20 Informational %INIT-I-Startup: Warm Startup
2147483600 2021-Oct-05 05:28:00 Notice %SYSLOG-N-LOGGING: Logging started.
2147483601 2021-Oct-05 05:27:55 Warning %STP-W-PORTSTATUS: te1/0/4: STP status Forwarding
2147483602 2021-Oct-05 05:27:44 Warning %STP-W-PORTSTATUS: te1/0/12: STP status Forwarding
2147483603 2021-Oct-05 05:27:40 Warning %STP-W-PORTSTATUS: te1/0/10: STP status Forwarding
2147483604 2021-Oct-05 05:27:35 Informational %LINK-I-Up: Vlan xx6
2147483605 2021-Oct-05 05:27:35 Informational %LINK-I-Up: Vlan xx5
2147483606 2021-Oct-05 05:27:35 Informational %LINK-I-Up: Vlan xx4
2147483607 2021-Oct-05 05:27:35 Informational %LINK-I-Up: Vlan xx3
2147483608 2021-Oct-05 05:27:35 Informational %LINK-I-Up: Vlan xx2
2147483609 2021-Oct-05 05:27:35 Informational %LINK-I-Up: Vlan xx1
2147483610 2021-Oct-05 05:27:35 Informational %LINK-I-Up: te1/0/10
2147483611 2021-Oct-05 05:27:25 Informational %LINK-I-Up: te1/0/4
2147483612 2021-Oct-05 05:27:20 Informational %Entity-I-SEND-ENT-CONF-CHANGE-TRAP: entity configuration change trap.
2147483613 2021-Oct-05 05:27:20 Informational %Environment-I-FAN-STAT-CHNG: FAN# 3 status changed to operational.
2147483614 2021-Oct-05 05:27:20 Informational %Environment-I-FAN-STAT-CHNG: FAN# 2 status changed to operational.
2147483615 2021-Oct-05 05:27:20 Informational %Environment-I-FAN-STAT-CHNG: FAN# 1 status changed to operational.
2147483616 2021-Oct-05 05:27:17 Warning %STP-W-PORTSTATUS: te1/0/2: STP status Forwarding
2147483617 2021-Oct-05 05:27:17 Warning %STP-W-PORTSTATUS: te1/0/3: STP status Forwarding
2147483618 2021-Oct-05 05:27:17 Warning %STP-W-PORTSTATUS: te1/0/1: STP status Forwarding
2147483619 2021-Oct-05 05:27:16 Informational %LINK-I-Up: te1/0/3
2147483620 2021-Oct-05 05:27:16 Informational %LINK-I-Up: te1/0/2
2147483621 2021-Oct-05 05:27:16 Informational %LINK-I-Up: te1/0/1
2147483622 2021-Oct-05 05:27:15 Warning %STP-W-PORTSTATUS: te1/0/11: STP status Forwarding
2147483623 2021-Oct-05 05:27:14 Informational %NSFP-I-SFPGibicDetected: te1/0/12 SFP port is present, module type - 10G BASE-SR
2147483624 2021-Oct-05 05:27:14 Informational %NSFP-I-SFPGibicDetected: te1/0/11 SFP port is present, module type - 10G BASE-SR
2147483625 2021-Oct-05 05:27:14 Informational %LINK-I-Up: te1/0/12
2147483626 2021-Oct-05 05:27:14 Informational %LINK-I-Up: Vlan 1
2147483627 2021-Oct-05 05:27:14 Informational %LINK-I-Up: te1/0/11
2147483628 2021-Oct-05 05:27:14 Informational %LINK-I-Up: loopback1
2147483629 2021-Oct-05 05:27:14 Warning %LINK-W-Down: oob
2147483630 2021-Oct-05 05:27:14 Warning %LINK-W-Down: te1/0/12
2147483631 2021-Oct-05 05:27:13 Warning %LINK-W-Down: te1/0/11
2147483632 2021-Oct-05 05:27:13 Warning %LINK-W-Down: te1/0/10
2147483633 2021-Oct-05 05:27:13 Warning %LINK-W-Down: te1/0/9
2147483634 2021-Oct-05 05:27:13 Warning %LINK-W-Down: te1/0/8
2147483635 2021-Oct-05 05:27:13 Warning %LINK-W-Down: te1/0/7
2147483636 2021-Oct-05 05:27:12 Warning %LINK-W-Down: te1/0/6
2147483637 2021-Oct-05 05:27:12 Warning %LINK-W-Down: te1/0/5
2147483638 2021-Oct-05 05:27:12 Warning %LINK-W-Down: te1/0/4
2147483639 2021-Oct-05 05:27:12 Warning %LINK-W-Down: te1/0/3
2147483640 2021-Oct-05 05:27:12 Warning %LINK-W-Down: te1/0/2
2147483641 2021-Oct-05 05:27:12 Warning %LINK-W-Down: te1/0/1
2147483642 2021-Oct-05 05:27:09 Informational %SNMP-I-CDBITEMSNUM: Number of startup configuration items loaded: 197
2147483643 2021-Oct-05 05:27:09 Informational %SNMP-I-CDBITEMSNUM: Number of running configuration items loaded: 197
2147483644 2021-Oct-05 05:27:08 Informational %MLDP-I-CONTROLLER: Switching to the active mode.
2147483645 2021-Oct-05 05:27:05 Informational %Entity-I-SEND-ENT-CONF-CHANGE-TRAP: entity configuration change trap.
2147483646 2021-Oct-05 05:27:05 Warning %Environment-W-RPS-STAT-MSG: Power supply source changed to Main Power Supply.
2147483647 2021-Oct-05 05:27:00 Informational %INIT-I-InitCompleted: Initialization task is completed

*****

The lines in bold are the ones relating to me pulling out and putting back in a connected network cable (to another switch) in order to bring the switch online.

JustTom · ‎12-02-2021

Just an addition: I completely reconfigured one of our switches (also a SG350X) and also see this exact same issue. Hence my thaughts it was a configurational error, rather than a faulty firmware (version).

marce1000 · ‎12-02-2021

- Check logs too (before you need to do the re-connecting tasks )

M.

-- ' 'Good body every evening' ' this sentence was once spotted on a logo at the entrance of a Weight Watchers Club !

JustTom · ‎12-09-2021

Long story short: I had to downgrade all of my switches (which resulted in all of them losing their config - so a heads up for everyone: please make sure to backup your configs on a regular basis (which luckily, I already did)) to an older version.

After that and then restoring the configs, all works as intended again.