07-24-2012 04:50 AM - edited 03-07-2019 07:56 AM
Hi, We have problem with one of our 3750 stack switch, stack connection between switch 2 & 3 is now down and not comming up even after replacing stack cable with new one. Please let me know if you have got any ideas. below output for your reference:
------------------ show switch detail ------------------
Current
Switch# Role Mac Address Priority State
--------------------------------------------------------
*1 Master 000f.f7f4.ce00 10 Ready
2 Member 000f.2425.cf00 1 Ready
3 Member 000f.f7f4.fe00 5 Ready
Stack Port Status Neighbors
Switch# Port 1 Port 2 Port 1 Port 2
--------------------------------------------------------
1 Ok Ok 2 3
2 Down Ok None None
3 Ok Down 1 None
------------------ show process cpu ------------------
CPU utilization for five seconds: 48%/0%; one minute: 8%; five minutes: 6%
------------------ show process memory ------------------
Total: 101589748, Used: 36344516, Free: 65245232
------------------ show logging ------------------
020489: .Jul 23 10:56:55: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state DOWN
020490: .Jul 23 10:57:54: %XDR-6-XDRIPCNOTIFY: Fatal IPC error occurred for peer in slot 2. Message not sent due to timeout. Disabling linecard
-Traceback= AFC798 21B434 BB9394 BBD6B0 BBDDDC BD04B8 908064 8FE62C
020491: .Jul 23 11:11:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 1, class 21, max_msg 8, total throttled 0
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5C8 24F7C0 908064 8FE62C
020492: .Jul 23 11:14:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 1
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020493: .Jul 23 11:17:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 3
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020494: .Jul 23 11:20:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 5
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020495: .Jul 23 11:23:23: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 3, class 21, max_msg 8, total throttled 7
-Traceback= AFC798 576DA8 24EA0C 24EB50 24F5AC 24F7C0 908064 8FE62C
020496: .Jul 23 11:24:13: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state UP
Jul 23 11:05:23: TODO: Haven't heard from th RP. Disable (Data_Center_1-2)
020497: .Jul 23 11:24:13: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state DOWN
020498: .Jul 23 11:24:13: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state UP
Jul 23 14:19:47: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 5, class 20, max_msg 4, total throttled 0 (Data_Center_1-2)
-Traceback= AFC798 576DA8 4F8AA4 4FC004 908064 8FE62C (Data_Center_1-2)
Jul 23 15:00:09: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 5, class 20, max_msg 4, total throttled 3 (Data_Center_1-2)
-Traceback= AFC798 576DA8 4F8AA4 4FC004 908064 8FE62C (Data_Center_1-2)
020499: .Jul 23 15:05:11: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/11 by vty1 (10.52.30.50)
020500: .Jul 23 15:05:14: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/12 by vty1 (10.52.30.50)
020501: .Jul 23 15:05:19: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/13 by vty1 (10.52.30.50)
020502: .Jul 23 15:05:25: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/15 by vty1 (10.52.30.50)
020503: .Jul 23 15:05:28: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/16 by vty1 (10.52.30.50)
020504: .Jul 23 15:09:56: %CLEAR-5-COUNTERS: Clear counter on interface GigabitEthernet2/0/24 by vty1 (10.52.30.50)
020505: .Jul 24 05:52:08: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state DOWN
020506: .Jul 24 05:52:09: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 1 Switch 1 has changed to state UP
020507: .Jul 24 05:52:10: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state DOWN
020508: .Jul 24 05:52:10: %STACKMGR-4-STACK_LINK_CHANGE: Stack Port 2 Switch 2 has changed to state UP
All switches are running 12.2(25)SEE2 version. and switch is live from 1 year, 36 weeks. I cannot able to reboot the switch as production servers are online. Please let suggest if you got any ways to resolve this problem without reboot.
Regards
Chandu
07-24-2012 04:56 AM
Hi Chandra,
try to invert the ends of the cable
Alessio
07-24-2012 04:59 AM
Hi Alessio, Appriciate your response. But we have tried that one and that didn't resolve this issue.
07-24-2012 05:05 AM
Chandu,
Can you replace or check the cable between
SWITCH 1 PORT 1 and SWITCH 2 PORT 2
Regards,
Alex.
Please rate useful posts.
07-24-2012 05:07 AM
Alex, thank you for your response:
SWITCH 1 PORT 1 and SWITCH 2 PORT 2 is good.
SWITCH 2 PORT 1 and SWITCH 3 PORT 2 is having poblem. we tried with new cable as well its not comming up.
07-24-2012 05:14 AM
07-24-2012 05:29 AM
Alessio, Reboot and upgrade is my last option left. that bugs doesnt seems best match to this condition. any other ideas are really appriciated.
07-24-2012 05:43 AM
Did you try to better tighten the screws?
In this doc, half way you find some case quite similar to yours
Alessio
07-24-2012 04:07 PM
Hmmmm ...
Don't want to be the bearer of bad news here ...
I believe you have TWO (2) issues here.
Firstly, there's a strong possibility that you are running a buggy IOS. I mean, 12.2(25)SEE??? I wouldn't touch that version with a ten-mile-pole.
Secondly, there's a strong possibility that your switches have a hardware defect that affects the stacking module. Please see attachment.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide