CPU utilization high on 3560

susim · ‎01-21-2015

Hi all ,

cpu spiking up to 90-100% , Does it solve the issue if we upgrade the firmware "c3560-ipservicesk9-mz.122-55.SE9" .
Current firmware is "flash:/c3560-ipbasek9-mz.122-55.SE7/c3560-ipbasek9-mz.122-55.SE7.bin"

----------------------------------------------------------------------------------------------------------------

CPU utilization for five seconds: 46%/27%; one minute: 57%; five minutes: 59%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
128 697586238 102711558 6791 12.13% 11.10% 9.46% 0 Hulc LED Process

sh version

Cisco IOS Software, C3560 Software (C3560-IPBASEK9-M), Version 12.2(55)SE7, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2013 by Cisco Systems, Inc.
Compiled Mon 28-Jan-13 10:10 by prod_rel_team
Image text-base: 0x01000000, data-base: 0x02D00000

ROM: Bootstrap program is C3560 boot loader
BOOTLDR: C3560 Boot Loader (C3560-HBOOT-M) Version 12.2(44)SE5, RELEASE SOFTWARE (fc1)

Sw2 uptime is 8 weeks, 1 day, 22 hours, 40 minutes
System returned to ROM by power-on
System restarted at 14:45:00 UTC Mon Nov 24 2014
System image file is "flash:/c3560-ipbasek9-mz.122-55.SE7/c3560-ipbasek9-mz.122-55.SE7.bin"

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco WS-C3560-48PS (PowerPC405) processor (revision P0) with 131072K bytes of memory.
Processor board ID FDO1228X1KA
Last reset from power-on
2 Virtual Ethernet interfaces
48 FastEthernet interfaces
4 Gigabit Ethernet interfaces
The password-recovery mechanism is enabled.

512K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address : 00:22:56:C7:EF:80
Motherboard assembly number : 73-9676-18
Power supply part number : 341-0029-05
Motherboard serial number : FDO122807K5
Power supply serial number : DTN122346E8
Model revision number : P0
Motherboard revision number : C0
Model number : WS-C3560-48PS-S
System serial number : FDO1228X1KA
SFP Module assembly part number : 73-7757-03
SFP Module revision Number : A0
SFP Module serial number : FDO12280149
Top Assembly Part Number : 800-25859-08
Top Assembly Revision Number : F0
Version ID : V09
CLEI Code Number : COMU210ARA
Hardware Board Revision Number : 0x01

Switch Ports Model SW Version SW Image
------ ----- ----- ---------- ----------
* 1 52 WS-C3560-48PS 12.2(55)SE7 C3560-IPBASEK9-M

Configuration register is 0xF

Thank you

Joseph W. Doherty · ‎01-21-2015

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

I doubt moving from 55SE7 to 55SE9 would make much if any difference, as 55SE7 is fairly solid, but it wouldn't hurt to try.

The high Hulc LED Process CPU, I believe, is a low priority task, so it's CPU consumption has little actual impact on switch processing. What else is your CPU breakdown? For example, in what you've posted, the CPU is shows 59% over five minutes while the Hulc LED Process only shows about 10% over the same five minutes. I.e. what's the other 50%?

susim · ‎01-21-2015

Thanks Joesph

This time i have taken whole processes

w4# Show proc cpu | exc 0.00%

CPU utilization for five seconds: 45%/25%; one minute: 47%; five minutes: 54%

PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
33	2848499	4967325	573	0.15%	0.04%	0.02%	0	Per-Second Jobs
87	6749010	60356620	111	0.15%	0.46%	0.22%	0	hpm main process
90	21725143	4963214	4377	0.15%	0.09%	0.12%	0	hpm counter proc
128	699401298	103072096	6785	11.66%	11.01%	11.15%	0	Hulc LED Process
137	7734146	1002456	7715	0.15%	0.11%	0.11%	0	HQM Stack Proces
184	1246	469	2656	0.31%	0.04%	0.10%	1	SSH Process
204	80988808	168050475	481	1.75%	1.21%	1.37%	0	Spanning Tree
237	3711424	13184002	281	0.15%	0.13%	0.10%	0	IGMPSN

Joseph W. Doherty · ‎01-21-2015

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

Hmm, well your total process CPU seems higher than the sum of that show for the tasks, and you have a good bit of interrupt CPU (which can be somewhat difficult to identify the cause).

But that and you spikes don't always imply you have a performance problem. For example, here's some CPU history on two of my stacks (also running 55SE3 and 55SE6).

    1                     1 1         1           1           1
    0334333343933433393354040333353334033333343334033353433353033343333333
    0773556625997086699749000977736841098777718874069898067656087505786698
100 *         *      *    * *         *           *           *
90 *         *      *    * *         *           *           *
80 *         *      *    * *         *           *           *
70 *         *      *    * *         *           *           *
60 *         *      *    * *         *           *   *     * *
50 *         *      * *** *    *    *           *   *     * *
40 ******************************** *************************************
30 **********************************************************************
20 ######################################################################
10 ######################################################################
   0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
             0    5    0    5    0    5    0    5    0    5    0    5    0
                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%

         1    1               1 1    1                  1    1
    4333303433033333394334334503033450333333933433333333033730363333933433
    2666505783075657792651461908076710637457232067577556055380506677876236
100      *    *      *        * *    *                  *    *      *
90      *    *      *        * *    *      *           *    *      *
80      *    *      *        * *    *      *           *    *      *
70      *    *      *        * *    *      *           * * *      *
60      *    *      *       ** *    *      *           * * * *    *
50      * * *      *       ** * ***      *           * * * *    *
40 ********* ************ ************ * *** ************************* *
30 **********************************************************************
20 ######################################################################
10 ######################################################################
   0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
             0    5    0    5    0    5    0    5    0    5    0    5    0
                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%

susim · ‎01-22-2015

Hi joesph

How did u come to know that there is lot of cpu interrupt

Actually there is a lot of multicast listener report message flooding the network from some HP pc’s . How can I protect the switch from the flood

Thank you

Joseph W. Doherty · ‎01-22-2015

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

"How did u come to know that there is lot of cpu interrupt"

It's the 2nd percentage value of the 5 second CPU usage stat.

In your case, about 25%, which wouldn't seem too high, and that might be fine, but as forwarding should be done by ASICs, one can wonder what this 25% is.

"Actually there is a lot of multicast listener report message flooding the network from some HP pc’s . How can I protect the switch from the flood"

Often there's different flood limiters you can enable. However, you need to be very careful enabling them, as they can block needed "flood" traffic too.

I've posted some history stats from two of my, more busy, 3750 stacks, and as you can see they average about 20% and with peaks of 100%, so you might not have a CPU problem. What does your 36 hour CPU status look like?

susim · ‎01-23-2015

Hi joesph

Thanks

I have attached last 72 hours history

susim · ‎01-21-2015

Here is the whole process

PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
128	699369860	103068265	6785	10.70%	10.95%	11.32%	0	Hulc LED Process
204	80986035	168046771	481	0.79%	1.28%	1.56%	0	Spanning Tree
301	7329485	5364122	1366	0.47%	0.11%	0.07%	0	SNMP ENGINE
299	3182428	10857961	293	0.31%	0.09%	0.05%	0	IP SNMP
148	14465144	4965670	2913	0.15%	0.14%	0.15%	0	PI MATM Aging Pr
9	262533	1298714	202	0.15%	0.02%	0.00%	0	ARP Input
33	2848390	4967134	573	0.15%	0.04%	0.02%	0	Per-Second Jobs
57	10674761	232556471	45	0.15%	0.13%	0.17%	0	Fifo Error Detec
70	2318715	146599643	15	0.15%	0.02%	0.00%	0	HLFM address lea
6	0	2	0	0.00%	0.00%	0.00%	0	Timers
7	0	1	0	0.00%	0.00%	0.00%	0	HRPC asic-stats
8	0	1	0	0.00%	0.00%	0.00%	0	Crash writer
10	0	1	0	0.00%	0.00%	0.00%	0	CEF MIB API
11	0	1	0	0.00%	0.00%	0.00%	0	AAA_SERVER_DEADT
12	0	2	0	0.00%	0.00%	0.00%	0	AAA high-capacit
13	0	1	0	0.00%	0.00%	0.00%	0	Policy Manager
14	150	35	4285	0.00%	0.00%	0.00%	0	Entity MIB API
15	0	1	0	0.00%	0.00%	0.00%	0	IFS Agent Manage
16	1749	83683	20	0.00%	0.00%	0.00%	0	IPC Dynamic Cach
17	0	1	0	0.00%	0.00%	0.00%	0	IPC Zone Manager
18	252229	4966651	50	0.00%	0.00%	0.00%	0	IPC Periodic Tim
19	0	1	0	0.00%	0.00%	0.00%	0	IPC Managed Time
20	247743	4966642	49	0.00%	0.00%	0.00%	0	IPC Deferred Por
21	6912	334658	20	0.00%	0.00%	0.00%	0	IPC Seat Manager
22	0	1	0	0.00%	0.00%	0.00%	0	IPC Session Serv
23	84	4	21000	0.00%	0.00%	0.00%	0	PrstVbl
24	348649	4966665	70	0.00%	0.00%	0.00%	0	Dynamic ARP Insp
25	0	1	0	0.00%	0.00%	0.00%	0	ARP Snoop
26	249107	4966644	50	0.00%	0.00%	0.00%	0	GraphIt
27	0	2	0	0.00%	0.00%	0.00%	0	XML Proxy Client
28	0	1	0	0.00%	0.00%	0.00%	0	Critical Bkgnd
29	1436656	1662213	864	0.00%	0.01%	0.00%	0	Net Background
30	0	1	0	0.00%	0.00%	0.00%	0	IDB Work
31	4378	86789	50	0.00%	0.00%	0.00%	0	Logger
32	330637	4966667	66	0.00%	0.00%	0.00%	0	TTY Background
34	2761909	84975	32502	0.00%	0.02%	0.00%	0	Per-minute Jobs
35	0	5	0	0.00%	0.00%	0.00%	0	IF-MGR control p
36	714	22449	31	0.00%	0.00%	0.00%	0	IF-MGR event pro
37	17629	434236	40	0.00%	0.00%	0.00%	0	Net Input
38	709318	1002698	707	0.00%	0.00%	0.00%	0	Compute load avg
39	0	1	0	0.00%	0.00%	0.00%	0	AggMgr Process
40	8	705	11	0.00%	0.00%	0.00%	0	Transport Port A
41	110465	1502506	73	0.00%	0.00%	0.00%	0	HC Counter Timer
PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
42	0	1	0	0.00%	0.00%	0.00%	0	SFF8472
43	240813	99304784	2	0.00%	0.00%	0.00%	0	DownWhenLooped
44	0	1	0	0.00%	0.00%	0.00%	0	HULC PBR Tcam Me
45	0	1	0	0.00%	0.00%	0.00%	0	HULC ACL Tcam Me
46	0	1	0	0.00%	0.00%	0.00%	0	HRPC EnergyWise
47	0	1	0	0.00%	0.00%	0.00%	0	HRPC actual powe
48	0	1	0	0.00%	0.00%	0.00%	0	HRPC lpip reques
49	0	2	0	0.00%	0.00%	0.00%	0	HLPIP Sync Proce
50	0	1	0	0.00%	0.00%	0.00%	0	HULC QM Tcam Mem
51	35290	204989	172	0.00%	0.00%	0.00%	0	EEM ED ND
52	0	44	0	0.00%	0.00%	0.00%	0	EEM ED Identity
53	0	41	0	0.00%	0.00%	0.00%	0	EEM ED MAT
54	0	1	0	0.00%	0.00%	0.00%	0	HRPC hsm request
55	0	7	0	0.00%	0.00%	0.00%	0	Stack Mgr
56	244	8	30500	0.00%	0.00%	0.00%	0	Stack Mgr Notifi
58	1135	451	2516	0.00%	0.00%	0.00%	0	Adjust Regions
59	622899	4966691	125	0.00%	0.00%	0.00%	0	hrpc -> response
60	23627	1019407	23	0.00%	0.00%	0.00%	0	hrpc -> request
61	226476	1029583	219	0.00%	0.00%	0.00%	0	hrpc <- response
62	0	1	0	0.00%	0.00%	0.00%	0	HRPC hcomp reque
63	0	3	0	0.00%	0.00%	0.00%	0	HULC Device Mana
64	0	3	0	0.00%	0.00%	0.00%	0	HRPC hdm non blo
65	0	2	0	0.00%	0.00%	0.00%	0	HRPC hdm blockin
66	31629	1002589	31	0.00%	0.00%	0.00%	0	HIPC bkgrd proce
67	9550	53998	176	0.00%	0.00%	0.00%	0	Hulc Port-Securi
68	0	1	0	0.00%	0.00%	0.00%	0	HRPC hpsecure re
69	0	1	0	0.00%	0.00%	0.00%	0	HRPC hlfm reques
71	1286582	4966807	259	0.00%	0.02%	0.00%	0	HLFM aging proce
72	768824	147792794	5	0.00%	0.00%	0.00%	0	HLFM address ret
73	0	1	0	0.00%	0.00%	0.00%	0	HRPC hulc misc r
5	2564	1068	2400	0.00%	0.00%	0.00%	0	Pool Manager
75	15755	1671720	9	0.00%	0.00%	0.00%	0	HVLAN main bkgrd
4	71905896	3149112	22833	0.00%	1.08%	1.02%	0	Check heaps
77	0	2	0	0.00%	0.00%	0.00%	0	Vlan shutdown Pr
78	13571	54183	250	0.00%	0.00%	0.00%	0	HRPC vlan reques
79	0	2	0	0.00%	0.00%	0.00%	0	HULC VLAN REF Ba
80	0	1	0	0.00%	0.00%	0.00%	0	HRPC hfbm reques
81	187	27906	6	0.00%	0.00%	0.00%	0	HCMP sync proces
82	0	1	0	0.00%	0.00%	0.00%	0	HRPC ilp request
83	33	4	8250	0.00%	0.00%	0.00%	0	Inline Power Twt
84	12429	16994	731	0.00%	0.00%	0.00%	0	HULC PM Vector P
85	0	1	0	0.00%	0.00%	0.00%	0	HPM Msg Retry Pr
86	9412	334656	28	0.00%	0.00%	0.00%	0	MDFS LC Download
87	6747981	60353883	111	0.00%	0.03%	0.08%	0	hpm main process
88	2814	38558	72	0.00%	0.00%	0.00%	0	HPM Stack Sync P
PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
89	0	1	0	0.00%	0.00%	0.00%	0	HRPC pm request
90	21724907	4963023	4377	0.00%	0.13%	0.16%	0	hpm counter proc
91	0	1	0	0.00%	0.00%	0.00%	0	HRPC pm-counters
92	0	1	0	0.00%	0.00%	0.00%	0	hpm vp events ca
93	0	1	0	0.00%	0.00%	0.00%	0	HRPC hcmp reques
94	34	2394	14	0.00%	0.00%	0.00%	0	HCEF ADJ Refresh
95	0	1	0	0.00%	0.00%	0.00%	0	HRPC hl3mm reque
96	0	1	0	0.00%	0.00%	0.00%	0	hl3md_rpfq_thrl_
97	40731	3508912	11	0.00%	0.00%	0.00%	0	hl3mm
98	18894	2503180	7	0.00%	0.00%	0.00%	0	hl3mm_rp
99	0	1	0	0.00%	0.00%	0.00%	0	HACL Queue Proce
100	0	1	0	0.00%	0.00%	0.00%	0	HRPC acl request
101	9	127	70	0.00%	0.00%	0.00%	0	HACL Acl Manager
3	0	1	0	0.00%	0.00%	0.00%	0	Connection Mgr
103	26784	23557	1136	0.00%	0.00%	0.00%	0	SpanTree Helper
104	0	1	0	0.00%	0.00%	0.00%	0	HRPC cdp request
105	0	1	0	0.00%	0.00%	0.00%	0	HRPC lldp reques
106	0	1	0	0.00%	0.00%	0.00%	0	HULC CISP Proces
107	0	1	0	0.00%	0.00%	0.00%	0	HRPC dot1x reque
108	0	3	0	0.00%	0.00%	0.00%	0	HULC DOT1X Proce
109	0	1	0	0.00%	0.00%	0.00%	0	HRPC system mtu
110	0	1	0	0.00%	0.00%	0.00%	0	HRPC rep request
111	0	4	0	0.00%	0.00%	0.00%	0	REP Helper Proc
112	0	1	0	0.00%	0.00%	0.00%	0	SMI MSG Retry Pr
113	0	1	0	0.00%	0.00%	0.00%	0	HRPC Smart Insta
114	0	1	0	0.00%	0.00%	0.00%	0	HRPC sdm request
115	1134380	24795324	45	0.00%	0.00%	0.00%	0	Hulc Storm Contr
116	0	2	0	0.00%	0.00%	0.00%	0	HSTP Sync Proces
117	0	1	0	0.00%	0.00%	0.00%	0	HRPC stp_cli req
118	0	1	0	0.00%	0.00%	0.00%	0	HRPC stp_state_s
119	0	2	0	0.00%	0.00%	0.00%	0	S/W Bridge Proce
120	0	1	0	0.00%	0.00%	0.00%	0	HRPC hudld reque
121	0	1	0	0.00%	0.00%	0.00%	0	HRPC vqpc reques
122	0	1	0	0.00%	0.00%	0.00%	0	HRPC iec_load_ba
123	0	1	0	0.00%	0.00%	0.00%	0	HRPC l2pt qnq rp
124	0	1	0	0.00%	0.00%	0.00%	0	HRPC aim request
125	0	2	0	0.00%	0.00%	0.00%	0	MACsec Process
126	0	1	0	0.00%	0.00%	0.00%	0	HRPC macsec requ
127	0	1	0	0.00%	0.00%	0.00%	0	HRPC hled reques
2	2977	1003007	2	0.00%	0.00%	0.00%	0	Load Meter
129	204347	3670701	55	0.00%	0.00%	0.00%	0	HL3U bkgrd proce
130	0	1	0	0.00%	0.00%	0.00%	0	HRPC hl3u reques
131	9615	1146624	8	0.00%	0.00%	0.00%	0	HL3U PBR bkgrd p
132	553	41854	13	0.00%	0.00%	0.00%	0	HL3U PBR n-h res
133	0	1	0	0.00%	0.00%	0.00%	0	HRPC dtp request
PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
134	0	1	0	0.00%	0.00%	0.00%	0	HRPC show_forwar
135	0	1	0	0.00%	0.00%	0.00%	0	HRPC snmp reques
136	0	1	0	0.00%	0.00%	0.00%	0	HULC SNMP Proces
137	7733827	1002418	7715	0.00%	0.09%	0.11%	0	HQM Stack Proces
138	1458017	2004815	727	0.00%	0.00%	0.00%	0	HRPC qos request
139	0	1	0	0.00%	0.00%	0.00%	0	HRPC span reques
140	0	1	0	0.00%	0.00%	0.00%	0	HRPC system post
141	0	1	0	0.00%	0.00%	0.00%	0	Hulc Reload Mana
142	0	1	0	0.00%	0.00%	0.00%	0	HRPC hrcli-event
143	447	43251	10	0.00%	0.00%	0.00%	0	DHCPD Timer
144	0	2	0	0.00%	0.00%	0.00%	0	image mgr
145	11132	1671717	6	0.00%	0.00%	0.00%	0	Power RPS Proces
146	16	67	238	0.00%	0.00%	0.00%	0	HL2MCM
74	1918416	501728	3823	0.00%	0.01%	0.00%	0	HULC Tcam Memory
76	0	2	0	0.00%	0.00%	0.00%	0	HVLAN Mapped Vla
149	0	2	0	0.00%	0.00%	0.00%	0	REP Topology cha
150	0	2	0	0.00%	0.00%	0.00%	0	Switch Backup In
102	0	1	0	0.00%	0.00%	0.00%	0	HRPC backup inte
152	1518	22681	66	0.00%	0.00%	0.00%	0	Auth Manager
153	0	2	0	0.00%	0.00%	0.00%	0	Dot1x Mgr Proces
154	0	1	0	0.00%	0.00%	0.00%	0	MAB Framework
155	0	1	0	0.00%	0.00%	0.00%	0	AUTH POLICY Fram
156	0	1	0	0.00%	0.00%	0.00%	0	CMD HANDLER
157	8137	33348	244	0.00%	0.00%	0.00%	0	802.1x switch
158	1738	83684	20	0.00%	0.00%	0.00%	0	802.1x MDA Aging
159	0	1	0	0.00%	0.00%	0.00%	0	802.1x Webauth F
160	88717	507990	174	0.00%	0.00%	0.00%	0	DTP Protocol
161	0	1	0	0.00%	0.00%	0.00%	0	EAP Framework
162	0	1	0	0.00%	0.00%	0.00%	0	EAP Test
163	0	1	0	0.00%	0.00%	0.00%	0	HRPC dai request
164	0	1	0	0.00%	0.00%	0.00%	0	HULC DAI Process
165	0	1	0	0.00%	0.00%	0.00%	0	HRPC ip device t
166	0	1	0	0.00%	0.00%	0.00%	0	HRPC ip source g
167	0	1	0	0.00%	0.00%	0.00%	0	HULC IP Source g
168	23033	5023061	4	0.00%	0.00%	0.00%	0	UDLD
169	448324	180626	2482	0.00%	0.00%	0.00%	0	Port-Security
170	8	2	4000	0.00%	0.00%	0.00%	0	IP Host Track Pr
171	0	1	0	0.00%	0.00%	0.00%	0	Link State Group
172	4672	501848	9	0.00%	0.00%	0.00%	0	Ethchnl
173	22041	164713	133	0.00%	0.00%	0.00%	0	VMATM Callback
174	0	2	0	0.00%	0.00%	0.00%	0	CDP Forward Proc
175	282927	49721041	5	0.00%	0.00%	0.00%	0	MDFS MFIB Proces
176	0	2	0	0.00%	0.00%	0.00%	0	MKA
177	16	114	140	0.00%	0.00%	0.00%	0	AAA Server
178	34	359	94	0.00%	0.00%	0.00%	0	AAA ACCT Proc
PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
179	0	1	0	0.00%	0.00%	0.00%	0	ACCT Periodic Pr
180	0	1	0	0.00%	0.00%	0.00%	0	AAA System Acct
181	0	1	0	0.00%	0.00%	0.00%	0	Auth-proxy AAA B
182	86	16744	5	0.00%	0.00%	0.00%	0	IP Admin SM Proc
183	1754340	1129711	1552	0.00%	0.00%	0.00%	0	CDP Protocol
184	1001	369	2712	0.00%	0.31%	0.16%	1	SSH Process
185	0	1	0	0.00%	0.00%	0.00%	0	HRPC x_setup req
186	0	2	0	0.00%	0.00%	0.00%	0	AAA Dictionary R
187	396	41859	9	0.00%	0.00%	0.00%	0	DHCP Snooping
188	0	1	0	0.00%	0.00%	0.00%	0	DHCP Snooping db
189	0	2	0	0.00%	0.00%	0.00%	0	EAPoUDP Process
190	0	3	0	0.00%	0.00%	0.00%	0	CEF switching ba
191	1247822	10788562	115	0.00%	0.04%	0.00%	0	IP Input
192	0	1	0	0.00%	0.00%	0.00%	0	ICMP event handl
193	59671	9690192	6	0.00%	0.00%	0.00%	0	IP ARP Track
194	0	3	0	0.00%	0.00%	0.00%	0	ADJ resolve proc
195	0	2	0	0.00%	0.00%	0.00%	0	ADJ NSF process
196	0	1	0	0.00%	0.00%	0.00%	0	IPv6 ping proces
198	0	1	0	0.00%	0.00%	0.00%	0	SMI Director DB
199	0	1	0	0.00%	0.00%	0.00%	0	SMI CDP Update H
200	0	1	0	0.00%	0.00%	0.00%	0	SMI Backup Proce
201	0	2	0	0.00%	0.00%	0.00%	0	SMI IBC server p
202	0	1	0	0.00%	0.00%	0.00%	0	SMI IBC client p
203	0	2	0	0.00%	0.00%	0.00%	0	SMI IBC Download
147	17	3	5666	0.00%	0.00%	0.00%	0	HL2MCM
205	292	83713	3	0.00%	0.00%	0.00%	0	Spanning Tree St
206	0	2	0	0.00%	0.00%	0.00%	0	KRB5 AAA
207	9	52	173	0.00%	0.00%	0.00%	0	SXP CORE
208	13171	101335	129	0.00%	0.00%	0.00%	0	CEF background p
209	0	1	0	0.00%	0.00%	0.00%	0	IP IRDP
210	0	1	0	0.00%	0.00%	0.00%	0	CEF RF HULC Conv
211	0	2	0	0.00%	0.00%	0.00%	0	XDR mcast
212	5984	501846	11	0.00%	0.00%	0.00%	0	IP ACL XDR LC Ba
213	9	1	9000	0.00%	0.00%	0.00%	0	IPC LC Message H
214	0	1	0	0.00%	0.00%	0.00%	0	XDR RP Ping Back
215	351	41856	8	0.00%	0.00%	0.00%	0	XDR RP backgroun
216	0	1	0	0.00%	0.00%	0.00%	0	XDR RP Test Back
217	0	3	0	0.00%	0.00%	0.00%	0	MDFS LC Process
218	167	4569	36	0.00%	0.00%	0.00%	0	TCP Timer
219	34	148	229	0.00%	0.00%	0.00%	0	TCP Protocols
220	4804	4962966	0	0.00%	0.00%	0.00%	0	Socket Timers
221	75	16750	4	0.00%	0.00%	0.00%	0	HTTP CORE
222	183	62788	2	0.00%	0.00%	0.00%	0	Cluster L2
223	7039	501850	14	0.00%	0.00%	0.00%	0	Cluster RARP
224	23824	711133	33	0.00%	0.00%	0.00%	0	Cluster Base
PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
225	0	1	0	0.00%	0.00%	0.00%	0	RARP Input
226	1310	83688	15	0.00%	0.00%	0.00%	0	DHCPD Database
227	0	2	0	0.00%	0.00%	0.00%	0	REP LSL Proc
228	0	2	0	0.00%	0.00%	0.00%	0	REP BPA/EPA Proc
229	0	1	0	0.00%	0.00%	0.00%	0	Critical Auth
230	0	2	0	0.00%	0.00%	0.00%	0	Dot1x Supplicant
231	0	2	0	0.00%	0.00%	0.00%	0	Dot1x Supplicant
232	0	2	0	0.00%	0.00%	0.00%	0	Dot1x Supplicant
233	0	1	0	0.00%	0.00%	0.00%	0	HRPC dhcp snoopi
234	0	4	0	0.00%	0.00%	0.00%	0	HULC DHCP Snoopi
235	216356	84370	2564	0.00%	0.00%	0.00%	0	IGMPSN L2MCM
236	48090	290710	165	0.00%	0.00%	0.00%	0	IGMPSN MRD
237	3711189	13183262	281	0.00%	0.07%	0.08%	0	IGMPSN
238	1928774	757796	2545	0.00%	0.00%	0.00%	0	IGMPQR
239	0	3	0	0.00%	0.00%	0.00%	0	L2TRACE SERVER
240	664225	135815	4890	0.00%	0.00%	0.00%	0	Inline Power
241	10518855	11039439	952	0.00%	0.05%	0.09%	0	Marvell wk-a Pow
242	27951	84353	331	0.00%	0.00%	0.00%	0	MLDSN L2MCM
243	0	1	0	0.00%	0.00%	0.00%	0	MRD
244	0	1	0	0.00%	0.00%	0.00%	0	MLD_SNOOP
245	2574882	9925932	259	0.00%	0.02%	0.00%	0	DHCPD Receive
246	0	2	0	0.00%	0.00%	0.00%	0	REP Switch Helpe
247	0	1	0	0.00%	0.00%	0.00%	0	IP RIB Update
248	0	1	0	0.00%	0.00%	0.00%	0	HRPC hl2mcm igmp
249	451601	49827825	9	0.00%	0.00%	0.00%	0	MDFS RP process
250	0	1	0	0.00%	0.00%	0.00%	0	HRPC hl2mcm mlds
252	0	1	0	0.00%	0.00%	0.00%	0	EPM MAIN PROCESS
253	0	2	0	0.00%	0.00%	0.00%	0	LOCAL AAA
254	0	2	0	0.00%	0.00%	0.00%	0	ENABLE AAA
255	0	2	0	0.00%	0.00%	0.00%	0	LINE AAA
257	3577	2277	1570	0.00%	0.00%	0.00%	0	TPLUS
258	8	12	666	0.00%	0.00%	0.00%	0	crypto engine pr
259	34	4	8500	0.00%	0.00%	0.00%	0	Crypto CA
260	0	1	0	0.00%	0.00%	0.00%	0	Crypto PKI-CRL
261	0	1	0	0.00%	0.00%	0.00%	0	Crypto SSL
262	0	1	0	0.00%	0.00%	0.00%	0	encrypt proc
263	8	115	69	0.00%	0.00%	0.00%	0	VTP Trap Process
264	0	2	0	0.00%	0.00%	0.00%	0	VTPMIB EDIT BUFF
265	0	2	0	0.00%	0.00%	0.00%	0	DHCP Security He
266	0	1	0	0.00%	0.00%	0.00%	0	HCD Process
267	0	1	0	0.00%	0.00%	0.00%	0	HRPC cable diagn
268	0	2	0	0.00%	0.00%	0.00%	0	DiagCard1/-1
269	315242	28983955	10	0.00%	0.00%	0.00%	0	PM Callback
270	830641	3340347	248	0.00%	0.02%	0.00%	0	VLAN Manager
272	3221	401566	8	0.00%	0.00%	0.00%	0	dhcp snooping sw
PID	Runtime(ms)	Invoked	uSecs	5Sec	1Min	5Min	TTY	Process
273	0	2	0	0.00%	0.00%	0.00%	0	EEM ED Routing
274	4377	49413	88	0.00%	0.00%	0.00%	0	EEM ED Syslog
276	74	114	649	0.00%	0.00%	0.00%	0	AAA SEND STOP EV
277	149797	10345	14480	0.00%	0.00%	0.00%	0	Syslog Traps
278	22609	46406	487	0.00%	0.00%	0.00%	0	Syslog
279	18	90	200	0.00%	0.00%	0.00%	0	EEM Server
280	8	2	4000	0.00%	0.00%	0.00%	0	EEM Policy Direc
282	0	2	0	0.00%	0.00%	0.00%	0	EEM ED CLI
283	0	3	0	0.00%	0.00%	0.00%	0	EEM ED Counter
284	0	3	0	0.00%	0.00%	0.00%	0	EEM ED Interface
285	0	3	0	0.00%	0.00%	0.00%	0	EEM ED IOSWD
286	0	3	0	0.00%	0.00%	0.00%	0	EEM ED None
287	0	3	0	0.00%	0.00%	0.00%	0	EEM ED OIR
288	1026	2791	367	0.00%	0.00%	0.00%	0	SSH Event handle
289	0	3	0	0.00%	0.00%	0.00%	0	EEM ED SNMP
290	0	3	0	0.00%	0.00%	0.00%	0	EEM ED SNMP Obje
291	0	3	0	0.00%	0.00%	0.00%	0	EEM ED Ipsla
292	0	2	0	0.00%	0.00%	0.00%	0	EEM ED SNMP Noti
293	1987	134974	14	0.00%	0.00%	0.00%	0	EEM ED Timer
294	0	2	0	0.00%	0.00%	0.00%	0	STP FAST TRANSIT
295	0	2	0	0.00%	0.00%	0.00%	0	CSRT RAPID TRANS
296	0	3	0	0.00%	0.00%	0.00%	0	RBM CORE
297	48067	5059611	9	0.00%	0.00%	0.00%	0	NTP
298	0	21	0	0.00%	0.00%	0.00%	0	SNMP Timers
1	362	2344	154	0.00%	0.00%	0.00%	0	Chunk Manager
300	1659582	5336569	310	0.00%	0.01%	0.00%	0	PDU DISPATCHER
151	1199	83683	14	0.00%	0.00%	0.00%	0	MMN bkgrd proces
302	0	2	0	0.00%	0.00%	0.00%	0	IP SNMPV6
303	14888	507	29364	0.00%	0.00%	0.00%	0	SNMP ConfCopyPro
304	289668	34363	8429	0.00%	0.00%	0.00%	0	SNMP Traps
305	3264077	179962	18137	0.00%	0.00%	0.00%	0	crypto sw pk pro
306	0	29	0	0.00%	0.00%	0.00%	0	hulc cfg mgr mas
307	49449	250	197796	0.00%	0.00%	0.00%	0	hulc running con