Solved: Cisco 3560 High CPU in Layer 3 Mode

mmendis · ‎08-20-2013

Dear All,

Recently I have configured a Cisco 3560 Switch as Layer 3 ( By enabling ipservices evaluation licene ). And it was worked fine untill I have connected few uplinks which carries 5M of traffic. Now the Switch CPU usage is very high ( 68% ).

#show proc cpu sorted

CPU utilization for five seconds: 69%/18%; one minute: 67%; five minutes: 67%

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

222 222384302 190788354 1165 36.00% 37.53% 37.58% 0 IP Input

11 2375852 27182 87405 4.32% 0.57% 0.41% 0 Licensing Auto U

85 10770348 1970370 5466 1.27% 1.54% 1.61% 0 RedEarth Tx Mana

84 5106559 2697243 1893 1.27% 0.80% 0.74% 0 RedEarth I2C dri

174 6004519 12581166 477 0.79% 0.90% 0.95% 0 Hulc LED Process

382 382375 9238 41391 0.63% 0.08% 0.05% 0 BGP Scanner

177 2663114 368240 7232 0.31% 0.40% 0.42% 0 HL3U bkgrd proce

412 191 119 1605 0.31% 0.15% 0.03% 2 Virtual Exec

13 1309028 1410026 928 0.31% 0.19% 0.20% 0 ARP Input

86 392760 1348624 291 0.31% 0.07% 0.05% 0 RedEarth Rx Mana

109 268974 14346086 18 0.15% 0.04% 0.00% 0 HLFM address ret

56 860528 506222 1699 0.15% 0.17% 0.15% 0 Per-Second Jobs

107 373092 14345964 26 0.15% 0.07% 0.05% 0 HLFM address lea

189 269440 201877 1334 0.15% 0.06% 0.05% 0 HRPC qos request

358 420345 15699794 26 0.15% 0.03% 0.04% 0 MMON MENG

188 1047234 100949 10373 0.15% 0.15% 0.15% 0 HQM Stack Proces

17 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager

18 8 7 1142 0.00% 0.00% 0.00% 0 Entity MIB API

19 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage

20 3504 100977 34 0.00% 0.00% 0.00% 0 IPC Event Notifi

21 7955 490784 16 0.00% 0.00% 0.00% 0 IPC Mcast Pendin

22 68 8436 8 0.00% 0.00% 0.00% 0 IPC Dynamic Cach

23 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Serv

24 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager

16 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT

26 7981 490784 16 0.00% 0.00% 0.00% 0 IPC Deferred Por

27 0 1 0 0.00% 0.00% 0.00% 0 IPC Process leve

28 9559 155634 61 0.00% 0.00% 0.00% 0 IPC Seat Manager

29 401 28909 13 0.00% 0.00% 0.00% 0 IPC Check Queue

30 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat RX Cont

31 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat TX Cont

32 743 50618 14 0.00% 0.00% 0.00% 0 IPC Keep Alive M

33 1556 101063 15 0.00% 0.00% 0.00% 0 IPC Loadometer

15 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API

25 8608 490779 17 0.00% 0.00% 0.00% 0 IPC Periodic Tim

34 50 4 12500 0.00% 0.00% 0.00% 0 PrstVbl

37 10831 506089 21 0.00% 0.00% 0.00% 0 GraphIt

38 2360 196 12040 0.00% 0.00% 0.00% 0 crypto sw pk pro

39 0 2 0 0.00% 0.00% 0.00% 0 SMART

40 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client

41 0 1 0 0.00% 0.00% 0.00% 0 ARP Snoop

42 15469 501603 30 0.00% 0.00% 0.00% 0 Dynamic ARP Insp

43 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd

44 72599 755144 96 0.00% 0.00% 0.00% 0 Net Background

Can some one explain this issue.

Best Regards !!!

Joseph W. Doherty · ‎08-21-2013

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

Use Universal image; your license should allow that image to provide IPService features.

Oh, and if CPU is high for L3, you might not be using the optimal SDM template.

View solution in original post

Leo Laohoo · ‎08-21-2013

You never mentioned that you are using 3560X, hence I didn't know.

As what Joseph mentioned, get the "universal" IOS.

Don't forget to rate our useful posts. Thanks.

View solution in original post

Leo Laohoo · ‎08-20-2013

Would be nice if you can post the output to the command "sh version".

mmendis · ‎08-20-2013

Please refer the below.

Cisco IOS Software, C3560E Software (C3560E-UNIVERSALK9-M), Version 15.0(2)SE2, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Compiled Tue 05-Feb-13 12:04 by prod_rel_team

ROM: Bootstrap program is C3560E boot loader

BOOTLDR: C3560E Boot Loader (C3560X-HBOOT-M) Version 12.2(53r)SE2, RELEASE SOFTWARE (fc1)

NMC-0.77-3560 uptime is 5 days, 21 hours, 36 minutes

System returned to ROM by power-on

System restarted at 13:06:09 LKR Thu Aug 15 2013

System image file is "flash:c3560e-universalk9-mz.150-2.se2.bin"

This product contains cryptographic features and is subject to United

States and local country laws governing import, export, transfer and

use. Delivery of Cisco cryptographic products does not imply

third-party authority to import, export, distribute or use encryption.

Importers, exporters, distributors and users are responsible for

compliance with U.S. and local country laws. By using this product you

agree to comply with applicable laws and regulations. If you are unable

to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:

http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to

export@cisco.com.

License Level: ipservices

License Type: Evaluation

Next reload license Level: ipservices

cisco WS-C3560X-24 (PowerPC405) processor (revision A0) with 262144K bytes of memory.

Processor board ID FDO1622R1X9

Last reset from power-on

1 Virtual Ethernet interface

1 FastEthernet interface

28 Gigabit Ethernet interfaces

2 Ten Gigabit Ethernet interfaces

The password-recovery mechanism is enabled.

512K bytes of flash-simulated non-volatile configuration memory.

Base ethernet MAC Address : D8:67:D9:CA:0D:80

Motherboard serial number : FDO16220EZK

Model revision number : A0

Motherboard revision number : C0

Model number : WS-C3560X-24T-L

Version ID : V02

CLEI Code Number : COMJU00ARB

Hardware Board Revision Number : 0x03

Switch Ports Model SW Version SW Image

------ ----- ----- ---------- ----------

* 1 30 WS-C3560X-24 15.0(2)SE2 C3560E-UNIVERSALK9-M

Configuration register is 0xF

Leo Laohoo · ‎08-20-2013

Version 15.0(2)SE2

Here's the dig ... If you are a 3560- or 3750-series switch and running 802.1X and/or PoE or just Layer 3, it's best to avoid this version. Go to 15.0(2)SE4 and observe.

mmendis · ‎08-20-2013

Thanks Leo for helping ... Is it ok if I use 122-55.SE4 ???

Leo Laohoo · ‎08-20-2013

mmendis wrote:

Thanks Leo for helping ... Is it ok if I use 122-55.SE4 ???

Use 12.2(55)SE8 instead.

mmendis · ‎08-21-2013

Hello Leo,

I have tried with c3560-ipservicesk9-mz.122-55.SE8 but it saying not compltibale with the Hardware.

My Switch model is WS-C3560X-24T-L , and I couldn't find a ipservices image for this model ( accordig to Cisco IOS locator) .

Please help

Joseph W. Doherty · ‎08-21-2013