ILP:: Inline power process coredump for switch

Thijn van der Schoot · ‎11-14-2014

Hi all,

I am investigating POE issues on a 3850 stack, and i notice some things while troubleshooting

Switch Ports Model              SW Version        SW Image              Mode
------ ----- -----              ----------        ----------            ----
     1 56    WS-C3850-48P       03.03.03SE        cat3k_caa-universalk9 INSTALL
*    2 56    WS-C3850-48P       03.03.03SE        cat3k_caa-universalk9 INSTALL

I have some debugging active.

ILPOWER:
ILPOWER event debugging is on
ILPOWER controller debugging is on

I see in the logs the following message

021030: Nov 14 2014 11:05:01.185 CET: ILP:: Inline power process coredump for switch 2
021034: Nov 14 2014 11:05:06.841 CET: ILP:: Inline power process coredump for switch 1
021041: Nov 14 2014 11:05:11.188 CET: ILP:: Inline power process coredump for switch 2
021048: Nov 14 2014 11:05:16.872 CET: ILP:: Inline power process coredump for switch 1
021049: Nov 14 2014 11:05:21.198 CET: ILP:: Inline power process coredump for switch 2
021065: Nov 14 2014 11:05:27.002 CET: ILP:: Inline power process coredump for switch 1
021079: Nov 14 2014 11:05:31.209 CET: ILP:: Inline power process coredump for switch 2
021080: Nov 14 2014 11:05:36.873 CET: ILP:: Inline power process coredump for switch 1
021093: Nov 14 2014 11:05:41.219 CET: ILP:: Inline power process coredump for switch 2

It seems its a proces as each of the stackmember logs this message every 10seconds.
I have search-engined this message, but to no avail,
i dont think this is a software crash as i dont have any crashfiles on the system.
What process generates these messages and why, how to troubleshoot this.

thank you in advance.
With kind regards,
Thijn van der Schoot.

chris.kruslicky · ‎05-16-2019

I'm seeing the same thing with a brand new cat9300 in a stack. No PoE devices work on switch 3 but moved to switch 2 they work.

429897: May 16 08:17:02.862 EDT: ILP:: Rx Response ILP msg: response_code 14, sw_num 2
429898: May 16 08:17:02.862 EDT: ILP:: ILP msg: received E_ILP_GET_DEBUG_CORE_DUMP
429899: May 16 08:17:02.862 EDT: ILP:: Inline power process coredump for switch 2
429900: May 16 08:17:04.318 EDT: ILP:: Rx Response ILP msg: response_code 16, sw_num 1
429901: May 16 08:17:04.318 EDT: ILP:: ILP msg: received E_ILP_POST
429902: May 16 08:17:04.319 EDT: ILP:: Rx Response ILP msg: response_code 12, sw_num 1
429903: May 16 08:17:04.319 EDT: ILP:: ILP msg: received E_ILP_GET_POWER_SENSE
429904: May 16 08:17:04.319 EDT: ILP:: ILP:pwr_sense: num_ports: 48, switch_num: 1
429905: May 16 08:17:04.319 EDT: ILP:: ILP:Gi1/0/3:power real 4414, min 3855, max 4638, police 0, overdraw: 0
429906: May 16 08:17:04.319 EDT: ILP:: ILP:Gi1/0/5:power real 3855, min 1899, max 4414, police 0, overdraw: 0
429907: May 16 08:17:04.319 EDT: ILP:: ILP:Gi1/0/11:power real 4292, min 2402, max 4622, police 0, overdraw: 0
429908: May 16 08:17:04.319 EDT: ILP:: ILP:Gi1/0/12:power real 4125, min 3735, max 4237, police 0, overdraw: 0
429909: May 16 08:17:04.319 EDT: ILP:: ILP:Gi1/0/13:power real 4181, min 2341, max 4292, police 0, overdraw: 0
429910: May 16 08:17:04.320 EDT: ILP:: ILP:Gi1/0/18:power real 3516, min 3237, max 3962, police 0, overdraw: 0
429911: May 16 08:17:04.320 EDT: ILP:: ILP:Gi1/0/23:power real 3628, min 2288, max 4074, police 0, overdraw: 0
429912: May 16 08:17:04.320 EDT: ILP:: ILP:Gi1/0/25:power real 3907, min 1841, max 4521, police 0, overdraw: 0
429913: May 16 08:17:04.773 EDT: ILP:: Rx Response ILP msg: response_code 14, sw_num 1
429914: May 16 08:17:04.773 EDT: ILP:: ILP msg: received E_ILP_GET_DEBUG_CORE_DUMP
429915: May 16 08:17:04.773 EDT: ILP:: Inline power process coredump for switch 1
429916: May 16 08:17:05.065 EDT: ILP:: Rx Response ILP msg: response_code 16, sw_num 3
429917: May 16 08:17:05.065 EDT: ILP:: ILP msg: received E_ILP_POST
429918: May 16 08:17:05.066 EDT: ILP:: Rx Response ILP msg: response_code 12, sw_num 3
429919: May 16 08:17:05.066 EDT: ILP:: ILP msg: received E_ILP_GET_POWER_SENSE
429920: May 16 08:17:05.066 EDT: ILP:: ILP:pwr_sense: num_ports: 48, switch_num: 3
429921: May 16 08:17:05.621 EDT: ILP:: Rx Response ILP msg: response_code 14, sw_num 3
429922: May 16 08:17:05.621 EDT: ILP:: ILP msg: received E_ILP_GET_DEBUG_CORE_DUMP
429923: May 16 08:17:05.621 EDT: ILP:: Inline power process coredump for switch 3
429924: May 16 08:17:07.097 EDT: ILP:: Sending icutoff current msg to slot:1 port:5

Power stack name: Powerstack-1
Stack mode: Power sharing
Stack topology: Ring
Switch 3:
Power budget: 1787
Power allocated: 255
Low port priority value: 21
High port priority value: 12
Switch priority value: 3
Port 1 status: Connected
Port 2 status: Connected
Neighbor on port 1: Switch 2 - c4b3.6a42.6400
Neighbor on port 2: Switch 1 - 0087.6401.1800

Switch 1:
Power budget: 1868
Power allocated: 307
Low port priority value: 20
High port priority value: 11
Switch priority value: 2
Port 1 status: Connected
Port 2 status: Connected
Neighbor on port 1: Switch 3 - 70c9.c6ba.e500
Neighbor on port 2: Switch 2 - c4b3.6a42.6400

Switch 2:
Power budget: 1815
Power allocated: 283
Low port priority value: 22
High port priority value: 13
Switch priority value: 4
Port 1 status: Connected
Port 2 status: Connected
Neighbor on port 1: Switch 1 - 0087.6401.1800
Neighbor on port 2: Switch 3 - 70c9.c6ba.e500

Giuseppe Larosa · ‎05-16-2019

Hello Chris,

I see you have core dumps messages for both switch 1 and switch 3.

>> Inline power process coredump for switch 1

Is POE working on switch 1? Because you have written that you have moved devices from switch3 to switch2 and switch2 provides POE.

In any case this should be a SW bug I would recommend opening a ticket with Cisco TAC.

another option being POE a so low level service is that of trying to reboot switch3 for example to see if after reload the message of core dump disappear.

Hope to help

Giuseppe