supervisor engine reload in 4500x series

[Ashwin Jingade]

In our infrastructure we are using 4500x series switch, its configured with VSS Cluster.

Since last week supervisor engine got rebooted 3 times.

Can some one help me to fix this issue ?

Logs:

%VSLP-5-RRP_ROLE_RESOLVED: Role resolved as ACTIVE  by VSLP
%EC-5-BUNDLE: Interface TenGigabitEthernet2/1/1 joined port-channel Port-channel20
%EC-5-BUNDLE: Interface TenGigabitEthernet2/1/2 joined port-channel Port-channel20
%C4K_REDUNDANCY-6-DUPLEX_MODE: The peer Supervisor has been detected
%SW_LEVEL-6-RESULT: Operational redundancy mode is UNKNOWN, due to software license-level mismatch at ACTIVE and STANDBY. Software Level on Active: ipbase; on Standby: ipbase.
%C4K_REDUNDANCY-6-MODE: ACTIVE supervisor initializing for sso mode

#sh ver :

Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500e-UNIVERSALK9-M), Version 03.04.03.SG RELEASE SOFTWARE (fc3)

 uptime is 1 year, 38 weeks, 6 days, 17 hours, 25 minutes
Uptime for this control processor is 1 day, 1 hour, 35 minutes

 sh sw vir

Executing the command on VSS member switch role = VSS Active, id = 2

Switch mode                  : Virtual Switch
Virtual switch domain number : 100
Local switch number          : 2
Local switch operational role: Virtual Switch Active
Peer switch number           : 1
Peer switch operational role : Virtual Switch Standby

Executing the command on VSS member switch role = VSS Standby, id = 1

Switch mode                  : Virtual Switch
Virtual switch domain number : 100
Local switch number          : 1
Local switch operational role: Virtual Switch Standby
Peer switch number           : 2
Peer switch operational role : Virtual Switch Active

[Mark Malone]

hey looks like a license issue

 Operational redundancy mode is UNKNOWN, due to software license-level mismatch at ACTIVE and STANDBY

can you check what both sups have in each switch when there active , if there different sups wont sync to vss

[Ashwin Jingade]

I am trying to get the details in virtual switch but I am not getting in to the virtual switch.

How do I get in to 2nd switch to check these details

Note: These switches are located in different location I have a access via remote.

 If we have any command kindly share the same.

Switch : 1

sh license image levels
Module name        Image level  Priority  Configured  Valid license
--------------------------------------------------------------------
WS-C4500X-32       entservices  1         NO          entservices
                   ipbase       2         NO          ipbase

Module Name     Role           Current Level     Reboot Level
--------------------------------------------------------------------
WS-C4500X-32    Active         ipbase            ipbase

[Mark Malone]

I only have 6500 vss so syntax is slightly different

I have a show license details standby

Is there northing with standby at the end for the secondary switch ? Are they too far away to go connect a console in

[Ashwin Jingade]

I have asked for console access to local support may be I am getting the same by tomorrow. As soon I get I will post the result.

It only support "#sh license detail"

sh license detail ?
  |  Output modifiers
  <cr>

output:

Index:  1       Feature: entservices  Version: 1.0
    License Type: Evaluation
      Evaluation total period: 8 weeks 4 days
      Evaluation period left: 8 weeks 4 days
    License State: Active, Not in Use, EULA not accepted
    License Count: Non-Counted
    License Priority: None
    Store Index: 0
    Store Name: Dynamic Evaluation License Storage
Index:  2       Feature: entservices  Version: 1.0
    License Type: PermanentRightToUse
    License State: Inactive
    License Count: Non-Counted
    Store Index: 1
    Store Name: Dynamic Evaluation License Storage
Index:  3       Feature: ipbase  Version: 1.0
    License Type: Permanent
    License State: Active, In Use
    License Count: Non-Counted
    License Priority: Medium
    Store Index: 0
    Store Name: Primary License Storage
Index:  4       Feature: ipbase  Version: 1.0
    License Type: Evaluation
      Evaluation total period: 8 weeks 4 days
      Evaluation period left: 8 weeks 4 days
    License State: Inactive
    License Count: Non-Counted
    License Priority: None
    Store Index: 2
    Store Name: Dynamic Evaluation License Storage
Index:  5       Feature: ipbase  Version: 1.0
    License Type: PermanentRightToUse
    License State: Inactive
    License Count: Non-Counted
    Store Index: 3
    Store Name: Dynamic Evaluation License Storage

[Madhukrishnan Gopinathan Nair · Accepted solution]

Hi Ashwin,

To check the license level on the standby login to standby sup using below

remote login module <standby module number>. You can get the module number using sh mod switch all or sh mod all (dont remeber exact syntax)

Then execute

sh ver

it will show the details of the installed license.

Hope this helps.

Madhu

[Ashwin Jingade]

Hi Mark

Both switches are having same image level and Sups module no changes.

I just saw the CISCO bug ID: CSCul23311

But no solution

Switch logs:

Switch 1:

sh lic ima lev
Module name        Image level  Priority  Configured  Valid license
--------------------------------------------------------------------
WS-C4500X-32       entservices  1         NO          entservices
                   ipbase       2         NO          ipbase

Module Name     Role           Current Level     Reboot Level
--------------------------------------------------------------------
WS-C4500X-32    Active         ipbase            ipbase

Switch 2:

sh lic ima level

Module name        Image level  Priority  Configured  Valid license
--------------------------------------------------------------------
WS-C4500X-32       entservices  1         NO          entservices
                   ipbase       2         NO          ipbase

Module Name     Role           Current Level     Reboot Level
--------------------------------------------------------------------
WS-C4500X-32    Active         ipbase            ipbase

[Madhukrishnan Gopinathan Nair]

That bug looks cosmetic, and i am not expecting the crash in your case is due to license mismatch either. Could you please check for crash dump ? Check it in standby bootflash or check the below command 

sh platform crashdump (command may not be exact). You may need to remote loggin to standby module as well and check for same command.

If you can't find any crashfiles, I would recommend to RMA the standby sup since it reloaded 3 times in a week to rule out hardware issues as well.

Hope this helps.

Madhu.

[Ashwin Jingade]

Hello Madhu

No I didn't find any crash dump issue in both switches.

Even I am discussing with my next level to working cisco TAC.

Hope its a hardware issue and it get resolved with the help of CISCO TAC.

If you have any suggestion apart from this let me know.

Output:

Sw1:

sh platform crashdump
Last Power Failure: 10/07/2014 12:30:24

No crash data available.

sh bootflash
-#- --length-- ---------date/time--------- path
  1       8323 May 07 2014 11:57:29 +00:00 startup-config.converted_vs-20140507-115721
  2  125611132 May 07 2014 11:11:07 +00:00 cat4500e-universalk9.SPA.03.04.03.SG.151-2.SG3.bin
  3       8323 May 07 2014 12:09:57 +00:00 startup-config.saved_vs-20140507-120957

1449472000 bytes available (125886464 bytes used)

Sw2:

sh platform crashdump

Last Power Failure: 06/02/2014 17:06:40

No crash data available.

sh bootflash
-#- --length-- ---------date/time--------- path
  1      11239 May 09 2014 08:42:03 +00:00 startup-config.saved_vs-20140509-084203
  2  125611132 May 07 2014 10:49:56 +00:00 cat4500e-universalk9.SPA.03.04.03.SG.151-2.SG3.bin
  3      23631 May 15 2014 13:08:29 +00:00 startup-config.saved_vs-20140515-130829

1449451520 bytes available (125906944 bytes used)

[Mark Malone]

what doe the show version show in the section where power on does be ion the 4500 that rebooted does it show traceback or anything unusual other than power-on

Were there any other logs collected from syslog or anything before these  reboots

[Ashwin Jingade]

In both switches it shows only : "System returned to ROM by reload"

Logs

Sw1:

#sh ver
Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500e-                                                                                                 UNIVERSALK9-M), Version 03.04.03.SG RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2013 by Cisco Systems, Inc.
Compiled Thu 19-Dec-13 14:08 by prod_rel_team

Cisco IOS-XE software, Copyright (c) 2005-2010, 2012 by cisco Systems, Inc.
All rights reserved.  Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0.  The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY.  You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0.  For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

ROM: 15.0(1r)SG10
R-ES-ZA-011 uptime is 1 year, 39 weeks, 19 hours, 6 minutes
Uptime for this control processor is 2 days, 3 hours, 16 minutes
System returned to ROM by SSO Switchover
System restarted at 08:08:52 CET Mon Feb 29 2016
Running default software

SW2:

sh ver
Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500e-UNIVERSALK9-M), Version 03.04.03.SG RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2013 by Cisco Systems, Inc.
Compiled Thu 19-Dec-13 14:08 by prod_rel_team

Cisco IOS-XE software, Copyright (c) 2005-2010, 2012 by cisco Systems, Inc.
All rights reserved.  Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0.  The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY.  You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0.  For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

ROM: 15.0(1r)SG10
R-ES-ZA-011 uptime is 1 year, 39 weeks, 19 hours, 8 minutes
Uptime for this control processor is 2 days, 2 hours, 55 minutes
System returned to ROM by reload
System restarted at 08:31:29 CET Mon Feb 29 2016
Running default software