cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
11846
Views
30
Helpful
6
Replies

POE problem on 3650 switch

k.khussainov
Level 1
Level 1

Good day.I have a WS-C3650-24PD switch, SW Version 16.12.4. I noticed this problem with POE. If you issue sh and then no sh, the POE cannot be provided. The only solution that fixes the problem is to disconnect power from the switch. I have over 300 switches and this is the only one with this problem so far. Is there any permanent solution to this problem?

Command outputs.

S-C35-ASW-003#sh log

Sep 30 13:59:16.213: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/7, changed state to up
Sep 30 13:59:17.213: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/7, changed state to up
Sep 30 13:59:31.591: %PARSER-5-CFGLOG_LOGGEDCMD: User:kkhussainov logged command:interface GigabitEthernet1/0/7
Sep 30 13:59:33.157: %ILPOWER-5-PD_ENTRY_REMOVAL: Interface GigabitEthernet1/0/7: power device entry removed. admin_state: 2, oper_state: 3
Sep 30 13:59:33.160: %PARSER-5-CFGLOG_LOGGEDCMD: User:kkhussainov logged command:shutdown
Sep 30 13:59:34.149: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/7, changed state to down
Sep 30 13:59:34.644: %PARSER-5-CFGLOG_LOGGEDCMD: User:kkhussainov logged command:no shutdown
Sep 30 13:59:35.153: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/7, changed state to down
Sep 30 13:59:35.475: %SYS-5-CONFIG_I: Configured from console by kkhussainov on vty0 (10.2.30.1)
Sep 30 13:59:35.941: %ILPOWER-5-DETECT: Interface Gi1/0/7: Power Device detected: IEEE PD
Sep 30 13:59:36.137: %ILPOWER-5-PD_ENTRY_REMOVAL: Interface GigabitEthernet1/0/7: power device entry removed. admin_state: 2, oper_state: 2
Sep 30 13:59:36.142: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/7: PD removed
Sep 30 13:59:36.145: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/7: PD removed
Sep 30 13:59:36.495: %ILPOWER-5-DETECT: Interface Gi1/0/7: Power Device detected: IEEE PD
Sep 30 13:59:36.687: %ILPOWER-5-PD_ENTRY_REMOVAL: Interface GigabitEthernet1/0/7: power device entry removed. admin_state: 2, oper_state: 2
Sep 30 13:59:36.693: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/7: PD removed
Sep 30 13:59:36.695: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/7: PD removed

 

14:00:48.474§S-C35-ASW-003#sh power inline
14:00:48.686§
14:00:48.686§Module Available Used Remaining
14:00:48.686§ (Watts) (Watts) (Watts)
14:00:48.687§------ --------- -------- ---------
14:00:48.687§1 780.0 105.0 675.0
14:00:48.687§Interface Admin Oper Power Device Class Max
14:00:48.687§ (Watts)
14:00:48.687§--------- ------ ---------- ------- ------------------- ----- ----
14:00:48.687§Gi1/0/1 auto on 7.0 Ieee PD 2 30.0
14:00:48.687§Gi1/0/2 auto on 7.0 Ieee PD 2 30.0
14:00:48.687§Gi1/0/3 auto on 7.0 Ieee PD 2 30.0
14:00:48.687§Gi1/0/4 auto on 7.0 Ieee PD 2 30.0
14:00:48.687§Gi1/0/5 auto on 7.0 Ieee PD 2 30.0
14:00:48.687§Gi1/0/6 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/7 auto off 0.0 n/a n/a 30.0
14:00:48.688§Gi1/0/8 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/9 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/10 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/11 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/12 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/13 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/14 auto on 7.0 Ieee PD 2 30.0
14:00:48.688§Gi1/0/15 auto on 7.0 Ieee PD 2 30.0
14:00:48.689§Gi1/0/16 auto on 7.0 Ieee PD 2 30.0
14:00:48.689§Gi1/0/17 auto off 0.0 n/a n/a 30.0
14:00:48.689§Gi1/0/18 auto off 0.0 n/a n/a 30.0
14:00:48.689§Gi1/0/19 auto off 0.0 n/a n/a 30.0
14:00:48.689§Gi1/0/20 auto off 0.0 n/a n/a 30.0
14:00:48.689§Gi1/0/21 auto off 0.0 n/a n/a 30.0
14:00:48.689§Gi1/0/22 auto off 0.0 n/a n/a 30.0
14:00:48.689§Gi1/0/23 auto off 0.0 n/a n/a 30.0
14:00:48.692§Gi1/0/24 auto off 0.0 n/a n/a 30.0

 

14:00:49.825§S-C35-ASW-003#sh power inline
14:00:51.941§
14:00:51.941§Module Available Used Remaining
14:00:51.941§ (Watts) (Watts) (Watts)
14:00:51.941§------ --------- -------- ---------
14:00:51.941§1 780.0 112.0 668.0
14:00:51.941§Interface Admin Oper Power Device Class Max
14:00:51.941§ (Watts)
14:00:51.941§--------- ------ ---------- ------- ------------------- ----- ----
14:00:51.941§Gi1/0/1 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/2 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/3 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/4 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/5 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/6 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/7 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/8 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/9 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/10 auto on 7.0 Ieee PD 2 30.0
14:00:51.942§Gi1/0/11 auto on 7.0 Ieee PD 2 30.0
14:00:51.943§Gi1/0/12 auto on 7.0 Ieee PD 2 30.0
14:00:51.943§Gi1/0/13 auto on 7.0 Ieee PD 2 30.0
14:00:51.943§Gi1/0/14 auto on 7.0 Ieee PD 2 30.0
14:00:51.943§Gi1/0/15 auto on 7.0 Ieee PD 2 30.0
14:00:51.943§Gi1/0/16 auto on 7.0 Ieee PD 2 30.0
14:00:51.943§Gi1/0/17 auto off 0.0 n/a n/a 30.0
14:00:51.943§Gi1/0/18 auto off 0.0 n/a n/a 30.0
14:00:51.943§Gi1/0/19 auto off 0.0 n/a n/a 30.0
14:00:51.943§Gi1/0/20 auto off 0.0 n/a n/a 30.0
14:00:51.943§Gi1/0/21 auto off 0.0 n/a n/a 30.0
14:00:51.943§Gi1/0/22 auto off 0.0 n/a n/a 30.0
14:00:51.944§Gi1/0/23 auto off 0.0 n/a n/a 30.0
14:00:51.945§Gi1/0/24 auto off 0.0 n/a n/a 30.0

 

S-C35-ASW-003#sh log

14:06:35.031§Sep 30 14:06:31.593: (Gi1/0/7) data power pool 1
14:06:35.031§Sep 30 14:06:31.593: Ilpower PD device 3 class 5 from interface (Gi1/0/7)
14:06:35.031§Sep 30 14:06:31.594: Requested power :7000 Class :5 ConnChk 0 IEEE Rev:0 Signal_pd_present:1 Spare_pd_present:0
14:06:35.031§Sep 30 14:06:31.594: (Gi1/0/7) state auto
14:06:35.031§Sep 30 14:06:31.594: (Gi1/0/7) data power pool: 1, pool 1
14:06:35.031§Sep 30 14:06:31.595: (Gi1/0/7) curr pwr usage 112000
14:06:35.031§Sep 30 14:06:31.595: (Gi1/0/7) req pwr 7000
14:06:35.031§Sep 30 14:06:31.595: (Gi1/0/7) total pwr 780000
14:06:35.031§Sep 30 14:06:31.595: (Gi1/0/7) power_status OK
14:06:35.031§Sep 30 14:06:31.595: ilpower new power from pd discovery Gi1/0/7, power_status ok
14:06:35.031§Sep 30 14:06:31.596: Ilpower interface (Gi1/0/7) power status change, allocated power 7000
14:06:35.031§Sep 30 14:06:31.596: (Gi1/0/7)ILP notify LLDP-TLV: lldp power class tlv:
14:06:35.031§Sep 30 14:06:31.597: (Gi1/0/7)(curr/prev) pwr value 7000/0
14:06:35.031§Sep 30 14:06:31.598: ilpower_notify_lldp_power_via_mdi_tlv Gi1/0/7 pwr alloc 7000
14:06:35.031§Sep 30 14:06:31.599: Gi1/0/7 AUTO PORT PWR Alloc 65 Request 65
14:06:35.031§Sep 30 14:06:31.599: Gi1/0/7: LLDP NOTIFY 802.3at TLV:
14:06:35.031§ Gi1/0/7:(curr/prev) PSE Allocation(mW): 6500/0
14:06:35.031§ Gi1/0/7:(curr/prev) PD Request(mW) : 6500/0
14:06:35.031§ Gi1/0/7:(curr/prev) PD Class : Class 2/
14:06:35.031§ Gi1/0/7:(curr/prev) PD Priority : low/unknown
14:06:35.031§ Gi1/0/7:(curr/prev) Power Type : Type 2 PSE/Type 2 PSE
14:06:35.031§ Gi1/0/7:(curr/prev) mdi_pwr_support: 7/0
14:06:35.031§ Gi1/0/7:(curr/prev Power Pair) : Signal/
14:06:35.031§ Gi1/0/7:(curr/prev) PSE Pwr Source : Primary/Unknown
14:06:35.031§Sep 30 14:06:31.795: %ILPOWER-5-PD_ENTRY_REMOVAL: Interface GigabitEthernet1/0/7: power device entry removed. admin_state: 2, oper_state: 2
14:06:35.031§Sep 30 14:06:31.796: ilpower delete power from pd linkdown Gi1/0/7
14:06:35.031§Sep 30 14:06:31.797: Ilpower interface (Gi1/0/7), delete allocated power 7000
14:06:35.031§Sep 30 14:06:31.797: Ilpower interface (Gi1/0/7) setting ICUT_OFF threshold to 0.
14:06:35.031§Sep 30 14:06:31.798: ilpower_notify_lldp_power_via_mdi_tlv Gi1/0/7 pwr alloc 0
14:06:35.031§Sep 30 14:06:31.798: Gi1/0/7 AUTO PORT PWR Alloc 130 Request 130
14:06:35.031§Sep 30 14:06:31.799: Gi1/0/7: LLDP NOTIFY 802.3at TLV:
14:06:36.850§ Gi1/0/7:(curr/prev) PSE Allocation(mW): 13000/0
14:06:36.850§ Gi1/0/7:(curr/prev) PD Request(mW) : 13000/0
14:06:36.850§ Gi1/0/7:(curr/prev) PD Class : Class 2/
14:06:36.850§ Gi1/0/7:(curr/prev) PD Priority : low/unknown
14:06:36.850§ Gi1/0/7:(curr/prev) Power Type : Type 2 PSE/Type 2 PSE
14:06:36.850§ Gi1/0/7:(curr/prev) mdi_pwr_support: 7/0
14:06:36.850§ Gi1/0/7:(curr/prev Power Pair) : Signal/
14:06:36.850§ Gi1/0/7:(curr/prev) PSE Pwr Source : Primary/Unknown
14:06:36.850§Sep 30 14:06:31.799: (Gi1/0/7)ILP notify LLDP-TLV: lldp power class tlv:
14:06:36.850§Sep 30 14:06:31.799: (Gi1/0/7)(curr/prev) pwr value 15400/0
14:06:36.850§Sep 30 14:06:31.803: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/7: PD removed
14:06:36.850§Sep 30 14:06:31.804: ilpower delete power from pd linkdown Gi1/0/7
14:06:36.850§Sep 30 14:06:31.804: Ilpower interface (Gi1/0/7), delete allocated power 0
14:06:36.850§Sep 30 14:06:31.804: ilpower_notify_lldp_power_via_mdi_tlv Gi1/0/7 pwr alloc 0
14:06:36.850§Sep 30 14:06:31.805: Gi1/0/7 AUTO PORT PWR Alloc 130 Request 130
14:06:36.850§Sep 30 14:06:31.805: Gi1/0/7: LLDP NOTIFY 802.3at TLV:
14:06:36.850§ Gi1/0/7:(curr/prev) PSE Allocation(mW): 13000/0
14:06:36.850§ Gi1/0/7:(curr/prev) PD Request(mW) : 13000/0
14:06:36.850§ Gi1/0/7:(curr/prev) PD Class : Class 0/
14:06:36.850§ Gi1/0/7:(curr/prev) PD Priority : low/unknown
14:06:36.850§ Gi1/0/7:(curr/prev) Power Type : Type 2 PSE/Type 2 PSE
14:06:36.850§ Gi1/0/7:(curr/prev) mdi_pwr_support: 7/0
14:06:36.850§ Gi1/0/7:(curr/prev Power Pair) : Signal/
14:06:36.850§ Gi1/0/7:(curr/prev) PSE Pwr Source : Primary/Unknown
14:06:36.850§Sep 30 14:06:31.806: (Gi1/0/7)ILP notify LLDP-TLV: lldp power class tlv:
14:06:36.850§Sep 30 14:06:31.806: (Gi1/0/7)(curr/prev) pwr value 15400/0
14:06:36.850§Sep 30 14:06:31.808: %ILPOWER-5-IEEE_DISCONNECT: Interface Gi1/0/7: PD removed
14:06:36.850§Sep 30 14:06:33.034: %ILPOWER-5-DETECT: Interface Gi1/0/7: Power Device detected: IEEE PD
14:06:36.850§Sep 30 14:06:33.034: (Gi1/0/7) data power pool 1
14:06:36.850§Sep 30 14:06:33.034: Ilpower PD device 3 class 5 from interface (Gi1/0/7)
14:06:36.850§Sep 30 14:06:33.035: Requested power :7000 Class :5 ConnChk 0 IEEE Rev:0 Signal_pd_present:1 Spare_pd_present:0

 

1 Accepted Solution

Accepted Solutions

Leo Laohoo
Hall of Fame
Hall of Fame

@k.khussainov wrote:

The only solution that fixes the problem is to disconnect power from the switch.

I know exactly what this is.  

CSCvd46008 & CSCvj76259 are the same bugs.  They're called MOSFET because it is a transistor.  This bug is exclusive to the 3650 and 3850 only.  No other switch were designed with these faulty components in them. 

Cold reboot, where you pull the power to the switch, is only a workaround.  The only reliable "fix" is to RMA the appliance because cold reboot is not a guarantee this issue will come back again.  And also it is because the MOSFET component is slowly degrading/decaying.  

EDIT (08 October 2020):  Cisco has included 9300 to the MOSFET bugs.  

View solution in original post

6 Replies 6

Leo Laohoo
Hall of Fame
Hall of Fame

@k.khussainov wrote:

The only solution that fixes the problem is to disconnect power from the switch.

I know exactly what this is.  

CSCvd46008 & CSCvj76259 are the same bugs.  They're called MOSFET because it is a transistor.  This bug is exclusive to the 3650 and 3850 only.  No other switch were designed with these faulty components in them. 

Cold reboot, where you pull the power to the switch, is only a workaround.  The only reliable "fix" is to RMA the appliance because cold reboot is not a guarantee this issue will come back again.  And also it is because the MOSFET component is slowly degrading/decaying.  

EDIT (08 October 2020):  Cisco has included 9300 to the MOSFET bugs.  

k.khussainov
Level 1
Level 1

Thanks Leo!

Leo Laohoo
Hall of Fame
Hall of Fame

As of 07 October 2020, Cisco has added 9300 to the MOSFET bugs.  

Mosasa
Level 1
Level 1

Can confirm a cold restart seems to get rid of those sys logs. Not sure about how soon it'll come back but for now I'm happy with the results lol.

Does anyone know if there are plans for an ACTUAL fix? I manage a switches at remote locations, so a cold restart is not an option for me. 

MOSFET (CSCvd46008 & CSCvj76259) is not a software bug but a hardware design issue.  

Cold reboot is a workaround.  Permanent fix is to RMA the switch.

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Review Cisco Networking products for a $25 gift card