cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1005
Views
0
Helpful
10
Replies

Cisco ME3600X All Port Channel goes to Suspended Mode without any changes

maileh
Level 1
Level 1

Hi below is my interfaces status , everything running and suddenly this is happen. We have to reboot the switch to back to normal. Lately it happens alot.

 

FYI This switch is the Root Bridge for our Spanning Tree Topology as well.

 

------------------ show interfaces status ------------------

 

Port Name Status Vlan Duplex Speed Type
Gi0/1 notconnect 1 auto auto 10/100/1000BaseTX
Gi0/2 *** Connection to connected routed full 1000 10/100/1000BaseTX
Gi0/3 *** Connection to connected routed full 1000 10/100/1000BaseTX
Gi0/4 "Connection to BSP connected 630 a-half a-100 10/100/1000BaseTX
Gi0/5 *** Connection to suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/6 *** Connection to suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/7 ***LACP to FW1 for suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/8 *** Trunk connecti suspended trunk a-full 1000 10/100/1000BaseTX
Gi0/9 *** Trunk connecti suspended trunk a-full 1000 10/100/1000BaseTX
Gi0/10 *** Connection to connected trunk full 1000 10/100/1000BaseTX
Gi0/11 *** LACP for HA-93 suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/12 *** LACP for HA-93 suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/13 *** Connection to connected 52 a-full a-1000 10/100/1000BaseTX
Gi0/14 "Connect to Corpor connected routed a-full a-1000 10/100/1000BaseTX
Gi0/15 *** Connection to connected trunk a-full a-1000 10/100/1000BaseTX
Gi0/16 *** L2VPN - 2BRAS connected trunk full 1000 10/100/1000BaseTX
Gi0/17 connected routed full 1000 10/100/1000BaseTX
Gi0/18 *** Connection to connected 481 a-full a-1000 10/100/1000BaseTX
Gi0/19 *** VLAN trunk to connected trunk full 1000 10/100/1000BaseTX
Gi0/20 ***LACP to FW1 for suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/21 *** Connection to connected trunk full 1000 10/100/1000BaseTX
Gi0/22 *** Connection to suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/23 *** Connection to suspended trunk a-full a-1000 10/100/1000BaseTX
Gi0/24 *** Connection to connected trunk a-full a-1000 10/100/1000BaseTX
Te0/1 Trunk for VRRP to notconnect 1 full 10G Not Present
Te0/2 notconnect 1 full 10G Not Present
Po5 *** Port-Channel5: notconnect 1 auto auto
Po10 *** Port-Channel10 notconnect 1 auto auto
Po13 ***LACP to FW for notconnect 1 auto auto
Po15 *** Port-Channel15 notconnect 1 auto auto
Po20 *** Port-Channel20 notconnect 1 auto auto

 

Here Selected Process with its Memory Utilization when this happens i think could be related but i am not sure.

3221319 LLDP Protocol

43099197 IPv6 Input

9267655 LACP Protocol

29743155 VRRP

205091061 Spanning Tree

510943115 IP Input

 

And here are the same Utilization when its normal operation after reboot.

61924 LLDP Protocol

812272 IPv6 Input

183221 LACP Protocol

3889689 Spanning Tree

7243060 IP Input

 

Right i have no leads where to look for but i just bring it here in case someone has this issue before with this type of switch.

 

 

 

10 Replies 10

Leo Laohoo
Hall of Fame
Hall of Fame
Post the complete output to the following commands:
1. sh version;
2. sh logs; and
3. sh post

ha-cs1#sh version
Cisco IOS Software, ME360x Software (ME360x-UNIVERSALK9-M), Version 15.3(3)S, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2013 by Cisco Systems, Inc.
Compiled Thu 25-Jul-13 18:05 by prod_rel_team

ROM: Bootstrap program is WHALES boot loader
BOOTLDR: ME360x Boot Loader (ME360X-HBOOT-M), Version 12.2 [sourdutt-loader_release_ledfix 100]

ha-cs1 uptime is 3 days, 6 hours, 35 minutes
System returned to ROM by power-on
System image file is "flash:/me360x-universalk9-mz.153/me360x-universalk9-mz.153.bin"
Last reload reason: Reload Command

 

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

License Level: AdvancedMetroIPAccess
License Type: Permanent
Next reload license Level: AdvancedMetroIPAccess

cisco ME-3600X-24TS-M (PowerPC8572) processor (revision B0) with 983040K/65528K bytes of memory.
Processor board ID FOC1719V2YS
Last reset from power-on
36 Virtual Ethernet interfaces
25 Gigabit Ethernet interfaces
2 Ten Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

1536K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address : 0C:27:24:2A:B0:00
Motherboard assembly number : 73-12694-06
Motherboard serial number : FOC17190YFS
Model revision number : B0
Motherboard revision number : B0
Model number : ME-3600X-24TS-M
System serial number : FOC1719V2YS
Top Assembly Part Number : 800-32955-01
Top Assembly Revision Number : C0
Version ID : V01
CLEI Code Number : IPMSV00DRA

Configuration register is 0xF

 

ha-cs1#sh post
Stored system POST messages:

Waiting for I2C Bus Check...Complete

Checking for pSoC Firmware upgrade..
not needed

Checking Control FPGA Firmware upgrade.. not needed

POST: Timing Tests : Begin
POST: Timing Tests : End, Status Passed

POST: PortASIC Memory Tests : Begin
POST: PortASIC Memory Tests : End, Status Passed

POST: PortASIC CAM Subsystem Tests : Begin
POST: PortASIC CAM Subsystem Tests : End, Status Passed

POST: Port ASIC Loopback Tests : Begin
POST: Port ASIC Loopback Tests : End, Status Passed

POST: PortASIC Port Loopback Tests : Begin
POST: PortASIC Port Loopback Tests : End, Status Passed

POST: EMAC Loopback Tests : Begin
POST: EMAC Loopback Tests : End, Status Passed

POST: Thermal, Fan Tests : Begin
POST: Thermal, Fan Tests : End, Status Passed

 

For the Loggin Parts. I send the switch log to a Syslog Server  .... At the time the problem happens , nothing shows up on the Log server at the time isue happen cos all etherchannel interface in the switch itself is going to suspended mode

Please post the complete output to the command "sh etherchann summary".

Hi Leo

This is it right now

 

ha-cs1#sh etherchannel summary
Flags: D - down P - bundled in port-channel
I - stand-alone s - suspended
H - Hot-standby (LACP only)
R - Layer3 S - Layer2
U - in use f - failed to allocate aggregator

M - not in use, minimum links not met
u - unsuitable for bundling
w - waiting to be aggregated
d - default port


Number of channel-groups in use: 5
Number of aggregators: 5

Group Port-channel Protocol Ports
------+-------------+-----------+-----------------------------------------------
5 Po5(SU) LACP Gi0/22(P) Gi0/23(P)
10 Po10(SU) LACP Gi0/11(P) Gi0/12(P)
13 Po13(SU) LACP Gi0/7(P) Gi0/20(P)
15 Po15(SU) LACP Gi0/8(P) Gi0/9(P)
20 Po20(SU) LACP Gi0/5(P) Gi0/6(P)

Hi again Leo @Leo Laohoo 

 

This was it back then when the problem happen the last time

 

------------------ show etherchannel summary ------------------


Flags: D - down P - bundled in port-channel
I - stand-alone s - suspended
H - Hot-standby (LACP only)
R - Layer3 S - Layer2
U - in use f - failed to allocate aggregator

M - not in use, minimum links not met
u - unsuitable for bundling
w - waiting to be aggregated
d - default port


Number of channel-groups in use: 5
Number of aggregators: 5

Group Port-channel Protocol Ports
------+-------------+-----------+-----------------------------------------------
5 Po5(SD) LACP Gi0/22(s) Gi0/23(s)
10 Po10(SD) LACP Gi0/11(s) Gi0/12(s)
13 Po13(SD) LACP Gi0/7(s) Gi0/20(s)
15 Po15(SD) LACP Gi0/8(s) Gi0/9(s)
20 Po20(SD) LACP Gi0/5(s) Gi0/6(s)

 

Please note i have the full sh tech-support with me when this problem happens last week . If you want me to attach the full file pelase let me know. 

Can you try and upgrade the firmware to something more recent?
I want to eliminate this issue to be an IOS bug before concluding that it could be a hardware faillure.

Hi Leo

Yeah we are in the process of doing that but i believe it will take time for that to happen.

I thought so regarding your suggestion but i wasn't sure that's why i ask in this forum ...

 

 

Well, the thing is the firmware is a "version 0" and anything-and-everything can go "boom" when running a "version 0" firmware.

Hi Leo

Thanks for the enlightenment if you have any particular minimum version or the correct one please let me know

Anything more recent will do.
Review Cisco Networking products for a $25 gift card