Cisco MLS SUP720 issue

[vinoth.kumar]

Hi,

In our network intially we had 800mb of traffic flow between our site1 to site2 with point to point 1 gig connectivty in the cat 6500 with SUP 2 on both the site

on 1 site we upgraded the SUP2 to SUP720 last night and we din see any issues but when 600mb traffic flow started in mid day we had a issue that from site 1 to site 2 no connectvity isssues but icmp from site2 to site1 is giving issue

the interface traffic size

5 minute input rate 637419000 bits/sec, 464796 packets/sec  site2 to site1

5 minute output rate 630223000 bits/sec, 465577 packets/sec site1 to site 2

we suspecting some interface traffic ratelimit issue since we din face the issue in the morning when we have 500mb of traffic

we have the below config on our new SUP720 catalayst whether this will be rootcause

no mls acl tcam share-global

mls aging long 64

mls aging normal 32

mls netflow interface

mls rate-limit unicast cef glean 20000 60

mls rate-limit unicast ip rpf-failure 500 10

mls rate-limit unicast ip icmp redirect 0

mls rate-limit unicast ip icmp unreachable no-route 500 10

mls rate-limit unicast ip icmp unreachable acl-drop 500 10

mls rate-limit unicast ip errors 500 10

mls rate-limit all ttl-failure 10 1

mls verify ip length minimum

mls cef error action reset

thanks

Vinu

[Jan Nejman]

Hello,

could you check your switch processor utilization?

show module        # select supervisor module id

attach 2               # 2 is module id

show proc cpu     # check load on switch processor

exit

Kind regards

Jan Nejman

Caligare, Co.

http://www.caligare.com/

[vinoth.kumar]

Hi ,

we are having normal cpu

-DIST65-#sh processes cpu

CPU utilization for five seconds: 3%/1%; one minute: 3%; five minutes: 4%

Mod Ports Card Type Model Serial

No.

---

[Jan Nejman]

Hi,

your "proc cpu" is from route processor or from switch processor? I saw usually

higher utilization on swich processor. Did you run attach command?

Kind regards,

Jan

[vinoth.kumar]

kindly let me know what all commads i need to run

thanks

vinoth

On Wed, Mar 17, 2010 at 3:41 PM, nejman@caligare.com <

[Giuseppe Larosa]

Hello Vinoth,

Jan has already provided the sequence of commands

in your case sup720 should be installed in slot 5 or 6 if this is a 6506 or 6509 chassis

sh module can tell you this

with attach you get a session to switch processor

example:

attach 5
Trying Switch ...
Entering CONSOLE for Switch
Type "^C^C^C" to end this session

Switch-sp#sh proc cpu
CPU utilization for five seconds: 17%/0%; one minute: 15%; five minutes: 15%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
   1           0         1          0  0.00%  0.00%  0.00%   0 Chunk Manager   
   2         720     32227         22  0.00%  0.00%  0.00%   0 Load Meter      
   3       29368    242945        120  0.00%  0.01%  0.00%   0 CEF: IPv4 pro

Switch-sp#exit

[Connection to Switch closed by foreign host]
Switch#

you type exit to go back to standard telnet session that is on the route processor

Hope to help

Giuseppe

[vinoth.kumar]

Hi,

please find the attach command results

-DIST65-01.TC1#attach 5

Trying Switch ...

Entering CONSOLE for Switch

Type "^CC^C" to end this session

DIST65-01.TC1-sp#sh proc cpu

CPU utilization for five seconds: 11%/0%; one minute: 15%; five minutes: 15%

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

1 4 5 800 0.00% 0.00% 0.00% 0 Chunk Manager

2 2616 328219 7 0.00% 0.00% 0.00% 0 Load Meter

3 36559756 33873626 1079 1.75% 2.25% 2.21% 0 DiagCard1/-1

4 0 51 0 0.00% 0.00% 0.00% 0

Retransmission o

5 4 3 1333 0.00% 0.00% 0.00% 0 IPC ISSU

Dispatc

6 0 1 0 0.00% 0.00% 0.00% 0 PF Redun ICC

Req

7 0 19 0 0.00% 0.00% 0.00% 0 PF Redun ICC

Req

8 0 2 0 0.00% 0.00% 0.00% 0 LC Registry

Expo

9 5402320 348104 15519 0.00% 0.34% 0.31% 0 Check heaps

10 0 1 0 0.00% 0.00% 0.00% 0 Pool Manager

11 0 2 0 0.00% 0.00% 0.00% 0 Timers

12 76 28017 2 0.00% 0.00% 0.00% 0 ARP Input

13 0 1 0 0.00% 0.00% 0.00% 0

AAA_SERVER_DEADT

14 0 2 0 0.00% 0.00% 0.00% 0 AAA

high-capacit

15 0 1 0 0.00% 0.00% 0.00% 0 Policy

Manager

16 0 2 0 0.00% 0.00% 0.00% 0 DDR Timers

17 0 2 0 0.00% 0.00% 0.00% 0 Dialer event

18 168 27342 6 0.00% 0.00% 0.00% 0 IPC Dynamic

Cach

19 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone

Manager

20 2996 1630745 1 0.00% 0.00% 0.00% 0 IPC Periodic

Tim

21 2168 1630744 1 0.00% 0.00% 0.00% 0 IPC Deferred

Por

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

22 0 1 0 0.00% 0.00% 0.00% 0 IPC Process

leve

23 36 258 139 0.00% 0.00% 0.00% 0 IPC Seat

Manager

24 0 1 0 0.00% 0.00% 0.00% 0 IPC Session

Serv

25 0 1 0 0.00% 0.00% 0.00% 0 IPC Stdby

Update

26 0 2 0 0.00% 0.00% 0.00% 0 Serial

Backgroun

27 1472 9 163555 0.00% 0.00% 0.00% 0 PrstVbl

28 0 1 0 0.00% 0.00% 0.00% 0 Crash writer

29 0 7 0 0.00% 0.00% 0.00% 0 RPC

cygnus-oir

30 7916 1630657 4 0.00% 0.00% 0.00% 0 GraphIt

31 0 1 0 0.00% 0.00% 0.00% 0 SERIAL

A'detect

32 16 15 1066 0.00% 0.00% 0.00% 0

client_entity_se

33 0 2 0 0.00% 0.00% 0.00% 0 SMART

34 0 1 0 0.00% 0.00% 0.00% 0 Reset Process

35 0 4 0 0.00% 0.00% 0.00% 0 RPC

pf_media_lay

36 0 1 0 0.00% 0.00% 0.00% 0 Critical

Bkgnd

37 9728 235644 41 0.00% 0.00% 0.00% 0 Net

Background

38 0 14 0 0.00% 0.00% 0.00% 0 IDB Work

39 0 441 0 0.00% 0.00% 0.00% 0 Logger

40 4292 1630654 2 0.00% 0.00% 0.00% 0 TTY

Background

41 15020 1645655 9 0.00% 0.00% 0.00% 0 Per-Second

Jobs

42 794920 80497 9875 0.00% 0.03% 0.00% 0 Per-minute

Jobs

43 4 61 65 0.00% 0.00% 0.00% 0 Cat6k NTI ICC

pr

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

44 48 604 79 0.00% 0.00% 0.00% 0 rf proxy sp

agen

45 0 1 0 0.00% 0.00% 0.00% 0 ISSU PROCESS

IPC

46 0 1 0 0.00% 0.00% 0.00% 0 RF Messaging

Pro

47 0 1 0 0.00% 0.00% 0.00% 0 PrstVbl IPC

Msg

48 0 1 0 0.00% 0.00% 0.00% 0 VSLP ISSU

receiv

49 24 255 94 0.00% 0.00% 0.00% 0 Env action

50 0 11 0 0.00% 0.00% 0.00% 0 Module oper

stat

51 0 72 0 0.00% 0.00% 0.00% 0 SNMP Traps

52 0 72 0 0.00% 0.00% 0.00% 0 SNMP Traps

53 4 40 100 0.00% 0.00% 0.00% 0 Snmp ICC

Process

54 0 3 0 0.00% 0.00% 0.00% 0 DFC Command

Task

55 0 1 0 0.00% 0.00% 0.00% 0 VS Redirect

EOBC

56 0 1 0 0.00% 0.00% 0.00% 0 VSIBC process

57 0 1 0 0.00% 0.00% 0.00% 0 VS IBSCP ISSU

58 0 1 0 0.00% 0.00% 0.00% 0 VS IBSCP ISSU

BO

59 4 39 102 0.00% 0.00% 0.00% 0 ICC Nego

60 0 6 0 0.00% 0.00% 0.00% 0 ACE_REQUESTS

han

61 0 3 0 0.00% 0.00% 0.00% 0 ACE Process

Msg

62 20 270 74 0.00% 0.00% 0.00% 0 ACE SP Tunnel

Ta

63 0 1 0 0.00% 0.00% 0.00% 0 EOBC Monitor

Pro

64 0 9 0 0.00% 0.00% 0.00% 0 Net Input

65 0 1 0 0.00% 0.00% 0.00% 0 pclc_sp

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

66 0 36 0 0.00% 0.00% 0.00% 0 PF DB SCP ICC

pr

67 4 8 500 0.00% 0.00% 0.00% 0 PF IPC ICC

Init

68 20 298 67 0.00% 0.00% 0.00% 0 Logger SP

Proces

69 0 1 0 0.00% 0.00% 0.00% 0 PF SCP

process

70 420 39 10769 0.00% 0.00% 0.00% 0 PF Sync

process

71 0 7 0 0.00% 0.00% 0.00% 0 RPC

rf_set_debug

72 16 164 97 0.00% 0.00% 0.00% 0 RF Status

73 0 315 0 0.00% 0.00% 0.00% 0 RPC Sync

74 172 6174 27 0.00% 0.00% 0.00% 0 SCP Multicast

75 0 2 0 0.00% 0.00% 0.00% 0 SCP Generic

Unso

76 17203100 9335120 1842 0.00% 0.89% 0.97% 0 DiagCard3/-1

77 2686156 20976309 128 0.15% 0.18% 0.16% 0 SCP Download

Lis

78 0 1 0 0.00% 0.00% 0.00% 0 LCP Bootupg

proc

79 1906508 9761 195318 0.00% 0.01% 0.05% 0 TCAM Manager

pro

80 0 1 0 0.00% 0.00% 0.00% 0 VS CHASSIS

Info

81 0 3 0 0.00% 0.00% 0.00% 0 VS ICC

request p

82 0 2 0 0.00% 0.00% 0.00% 0

cpf_msg_holdq_pr

83 0 1 0 0.00% 0.00% 0.00% 0

cpf_msg_rcvq_pro

84 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test

clien

85 4523796 6767434 668 0.00% 0.28% 0.26% 0 DiagCard5/-1

86 0 1 0 0.00% 0.00% 0.00% 0 IVFS SP ICC

Proc

87 34728 1011569 34 0.07% 0.00% 0.00% 0 LACP Protocol

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

88 0 1 0 0.00% 0.00% 0.00% 0 LMP state

machin

89 0 1 0 0.00% 0.00% 0.00% 0 VSLP RRP

event g

90 29716 432846 68 0.00% 0.00% 0.00% 0 Compute load

avg

91 24848 1554986 15 0.00% 0.00% 0.00% 0 OIR Process

92 0 1 0 0.00% 0.00% 0.00% 0 Inode Table

Dest

93 744 109478 6 0.00% 0.00% 0.00% 0 Fabric

Manager

94 39512 2455359 16 0.00% 0.00% 0.00% 0 Heartbeat

Proces

95 4 260 15 0.00% 0.00% 0.00% 0 Const ICC

reques

96 0 1 0 0.00% 0.00% 0.00% 0 Const ICC

event

97 0 1 0 0.00% 0.00% 0.00% 0 Const ICC

except

98 0 1 0 0.00% 0.00% 0.00% 0 ICC Local

Reques

99 6516 413152 15 0.00% 0.00% 0.00% 0 ICC Async

mcast

100 0 1 0 0.00% 0.00% 0.00% 0 ICC_REQ Debug

Pr

101 0 1 0 0.00% 0.00% 0.00% 0 ICC FC

Process

102 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Test

Send

103 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Test

Low

104 0 1 0 0.00% 0.00% 0.00% 0 itasca_sp

105 0 1 0 0.00% 0.00% 0.00% 0

StandbyDiagDaemo

106 103745948 197860956 524 5.27% 6.34% 6.37% 0 slcp process

107 0 2 0 0.00% 0.00% 0.00% 0 VQM SP

Process

108 0 3 0 0.00% 0.00% 0.00% 0 RPC

vs_prov_lc-M

109 13364428 7258714 1841 0.00% 1.05% 1.00% 0 DiagCard2/-1

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

110 0 1 0 0.00% 0.00% 0.00% 0 Mistral Reset

Pr

111 0 1 0 0.00% 0.00% 0.00% 0 ECC

correctable

112 36 280 128 0.00% 0.00% 0.00% 0 rf task

113 0 1 0 0.00% 0.00% 0.00% 0 RF High

Priority

114 6628 1630817 4 0.00% 0.00% 0.00% 0 PF_Init

Process

115 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

116 152268 3469420 43 0.00% 0.00% 0.00% 0 SCP async:

LCP#1

117 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

118 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

119 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

120 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

121 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

122 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

123 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

124 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

125 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

126 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

127 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

128 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

129 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

130 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

131 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

132 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

133 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

134 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

135 0 1 0 0.00% 0.00% 0.00% 0 RTTYS Process

136 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

137 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

138 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

139 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

140 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

141 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

142 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

143 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

144 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

145 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

146 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

147 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

148 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

149 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

150 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

151 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

152 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

153 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

154 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

155 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

156 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

157 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

158 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

159 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

160 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

161 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

162 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

163 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

164 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

165 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

166 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

167 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

168 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

169 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

170 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

171 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

172 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

173 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

174 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

175 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

176 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

177 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

178 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

179 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

180 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

181 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

182 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

183 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

184 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

185 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

186 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

187 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

188 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

189 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

190 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

191 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

192 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

193 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

194 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

195 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

196 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

197 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

198 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

199 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

200 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

201 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

202 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

203 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

204 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

205 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

206 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

207 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

208 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

209 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU

Version

210 0 1 0 0.00% 0.00% 0.00% 0 RPC

rpc-master

211 0 23 0 0.00% 0.00% 0.00% 0

fabm_ch_sync:0

212 8 23 347 0.00% 0.00% 0.00% 0

fabm_ch_sync:9

213 12 23 521 0.00% 0.00% 0.00% 0

fabm_ch_sync:4

214 4 5 800 0.00% 0.00% 0.00% 0 Fabman

Timeout P

215 40148 10625645 3 0.00% 0.00% 0.00% 0 Heartbeat

216 0 1 0 0.00% 0.00% 0.00% 0 PS HB

listener P

217 0 1 0 0.00% 0.00% 0.00% 0 IDPROM Msg

Proce

218 0 1 0 0.00% 0.00% 0.00% 0 VSHA Handle

Leg

219 0 1 0 0.00% 0.00% 0.00% 0 Notify peer

imag

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

220 0 1 0 0.00% 0.00% 0.00% 0 IPC RTTYC

Messag

221 0 7 0 0.00% 0.00% 0.00% 0 NTI agent

handle

222 0 1 0 0.00% 0.00% 0.00% 0 NTI Example

Proc

223 0 1 0 0.00% 0.00% 0.00% 0 Cat6k NTI SP

Exa

224 4 60 66 0.00% 0.00% 0.00% 0 PF_Split Sync

Pr

225 0 16 0 0.00% 0.00% 0.00% 0 RPC

pf-split-sp

226 0 2 0 0.00% 0.00% 0.00% 0 RPC idprom-SP

227 56 1027 54 0.00% 0.00% 0.00% 0 RFS server

proce

228 0 350 0 0.00% 0.00% 0.00% 0 BACK CHECK

229 12 405 29 0.00% 0.00% 0.00% 0 AggMgr

Process

230 0 1 0 0.00% 0.00% 0.00% 0

cpf_process_tpQ

231 0 1 0 0.00% 0.00% 0.00% 0 Transport

Port A

232 12184 19378362 0 0.00% 0.00% 0.00% 0 EARL Intr

Thrtl

233 0 1 0 0.00% 0.00% 0.00% 0

const_dump_info_

234 0 2 0 0.00% 0.00% 0.00% 0 EARL FIB

Manager

235 87548 5968 14669 0.00% 0.00% 0.00% 0 EARL CC Task

236 244 441 553 0.00% 0.00% 0.00% 0 Remote

Console P

237 0 1 0 0.00% 0.00% 0.00% 0

DiagErrorLogProc

238 0 1 0 0.00% 0.00% 0.00% 0 CFRW_OIR

Process

239 8 16 500 0.00% 0.00% 0.00% 0 DiagSNMPProc

240 0 2 0 0.00% 0.00% 0.00% 0 Protocol

Filteri

241 4 8 500 0.00% 0.00% 0.00% 0 OBFL ENV

obfl0

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

242 0 2 0 0.00% 0.00% 0.00% 0 SEA_SCP_PRC

243 0 1 0 0.00% 0.00% 0.00% 0 SPAN EARL

Task

244 0 1 0 0.00% 0.00% 0.00% 0 ADJ MGR

245 0 2 0 0.00% 0.00% 0.00% 0 ADJ_MGR

246 8008 428084 18 0.00% 0.00% 0.00% 0 L2 Control

Task

247 14656 1623008 9 0.00% 0.00% 0.00% 0 L2 Throttle

Task

248 4760 657733 7 0.00% 0.00% 0.00% 0 L2 Aging Task

249 27680016 700077 39538 1.67% 1.67% 1.67% 0 Vlan

Statistics

250 20428 2487681 8 0.00% 0.00% 0.00% 0 L2 PI_E

consiste

251 2048 878238 2 0.00% 0.00% 0.00% 0 EARL7 monitor

ta

252 11304888 58030 194817 0.00% 0.71% 0.67% 0 TYFIB Table

Mana

253 948 34129 27 0.00% 0.00% 0.00% 0 CFIB-BGP Task

254 1056 1309 806 0.00% 0.00% 0.00% 0 CFIB LC QUEUE

BO

255 12228 1793059 6 0.00% 0.00% 0.00% 0 CFIB LC TIMER

Ta

256 676 164012 4 0.00% 0.00% 0.00% 0 CFIB LC STATS

Ta

257 0 2 0 0.00% 0.00% 0.00% 0 Gemini SP

proces

258 840 20191 41 0.00% 0.00% 0.00% 0 Online

Linecard

259 0 1 0 0.00% 0.00% 0.00% 0 DiagSatCtrl

Proc

260 1395444 5827031 239 0.00% 0.00% 0.02% 0 NF Exception

Tas

261 148 2519 58 0.00% 0.00% 0.00% 0 L3 Control

Task

262 64 1 64000 0.00% 0.00% 0.00% 0 Netflow NDE

Task

263 8436 795856 10 0.00% 0.00% 0.00% 0 Netflow Aging

Ta

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

264 576 166866 3 0.00% 0.00% 0.00% 0 Task for

pre-pro

265 12984 491907 26 0.00% 0.00% 0.00% 0 Netflow

Mgmt_Sta

266 0 1 0 0.00% 0.00% 0.00% 0 Netflow

Sampling

267 0 3 0 0.00% 0.00% 0.00% 0 MLS Stats

Hostor

268 0 1 0 0.00% 0.00% 0.00% 0 Async write

proc

269 0 1 0 0.00% 0.00% 0.00% 0 Async write

proc

270 0 1 0 0.00% 0.00% 0.00% 0 Async write

proc

271 0 1 0 0.00% 0.00% 0.00% 0 Async write

proc

272 1368 27339 50 0.00% 0.00% 0.00% 0 DFS flush

period

273 0 2 0 0.00% 0.00% 0.00% 0 AAA Server

274 0 1 0 0.00% 0.00% 0.00% 0 AAA ACCT Proc

275 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic

Pr

276 0 1 0 0.00% 0.00% 0.00% 0 AAA System

Acct

277 0 2 0 0.00% 0.00% 0.00% 0 AAA

Dictionary R

278 0 2 0 0.00% 0.00% 0.00% 0 CEF switching

ba

279 20 27367 0 0.00% 0.00% 0.00% 0 IP Input

280 0 1 0 0.00% 0.00% 0.00% 0 ICMP event

handl

281 1896 328024 5 0.00% 0.00% 0.00% 0 SSM

connection m

282 627328 8004112 78 0.00% 0.04% 0.05% 0 Spanning Tree

283 20 318 62 0.00% 0.00% 0.00% 0 SpanTree Msg

284 10648 1641947 6 0.00% 0.00% 0.00% 0 UDLD

285 0 2 0 0.00% 0.00% 0.00% 0 REP Topology

cha

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

286 8 17 470 0.00% 0.00% 0.00% 0 Const Rate

Limit

287 0 1 0 0.00% 0.00% 0.00% 0 SP DHCP

Snooping

288 48 244 196 0.00% 0.00% 0.00% 0 802.1x switch

289 7792 98076 79 0.00% 0.00% 0.00% 0 DTP Protocol

290 60 51 1176 0.00% 0.00% 0.00% 0 BGP INT

291 896 51315 17 0.00% 0.00% 0.00% 0 L2 MAC oob

sync

292 8 1041 7 0.00% 0.00% 0.00% 0 L3 Manager SP

Co

293 112 1024 109 0.00% 0.00% 0.00% 0 L3 Manager SP

294 7832 1252193 6 0.00% 0.00% 0.00% 0 mls-hal

Process

295 152 91291 1 0.00% 0.00% 0.00% 0 mfib-const-lc

Pr

296 160324 16386617 9 0.00% 0.00% 0.00% 0 Mcast Hw

Agent6

297 0 2 0 0.00% 0.00% 0.00% 0 mls-msc-ha

proce

298 68 291 233 0.00% 0.00% 0.00% 0 mls-msc

Process

299 0 1 0 0.00% 0.00% 0.00% 0 mls-msc-cc

Proce

300 0 2 0 0.00% 0.00% 0.00% 0 MVRP Process

301 4 84 47 0.00% 0.00% 0.00% 0 PIM Snooping

Pro

302 0 1 0 0.00% 0.00% 0.00% 0 pm-sp-mat

303 48 27367 1 0.00% 0.00% 0.00% 0 Port-Security

304 0 1 0 0.00% 0.00% 0.00% 0 Private hosts

sp

305 2572 27104 94 0.00% 0.00% 0.00% 0 QoS SP

Process

306 0 1 0 0.00% 0.00% 0.00% 0 Switch Backup

In

307 1200 164011 7 0.00% 0.00% 0.00% 0 Ethchnl

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

308 2120 35689 59 0.00% 0.00% 0.00% 0 CEF

background p

309 59308 426493 139 0.00% 0.00% 0.00% 0 Hardware API

bac

310 0 2 0 0.00% 0.00% 0.00% 0 CEF LC IPC

Backg

311 16184 2012769 8 0.00% 0.00% 0.00% 0 CEF LC Stats

312 0 1 0 0.00% 0.00% 0.00% 0 TCP Timer

313 0 1 0 0.00% 0.00% 0.00% 0 TCP Protocols

314 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers

315 0 5563 0 0.00% 0.00% 0.00% 0 HTTP CORE

316 0 1 0 0.00% 0.00% 0.00% 0 Probe Input

317 0 1 0 0.00% 0.00% 0.00% 0 XDR

background p

318 8716 434707 20 0.00% 0.00% 0.00% 0 XDR mcast

319 33204 1643792 20 0.00% 0.00% 0.00% 0 XDR LC PRIO

Back

320 2188 27372 79 0.00% 0.00% 0.00% 0 XDR LC PRIO

Crit

321 92 138 666 0.00% 0.00% 0.00% 0 XDR LC Pre

Sys_i

322 11364 26157 434 0.00% 0.00% 0.00% 0 XDR LC

Backgroun

323 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute

324 0 1 0 0.00% 0.00% 0.00% 0 RARP Input

325 0 1 0 0.00% 0.00% 0.00% 0 PPP IP Add

Route

326 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps

Mana

327 0 2 0 0.00% 0.00% 0.00% 0 REP LSL Proc

328 0 2 0 0.00% 0.00% 0.00% 0 REP BPA/EPA

Proc

329 0 4 0 0.00% 0.00% 0.00% 0 MRIB LC IPC

Proc

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

330 752 597723 1 0.00% 0.00% 0.00% 0 CFMPAL

Process

331 8104 183442 44 0.00% 0.00% 0.00% 0 IP ACL XDR LC

Ba

332 257848 9662654 26 0.00% 0.00% 0.00% 0 mls-gc

Process

333 0 1 0 0.00% 0.00% 0.00% 0 mls-pimsn

Proces

334 3924 1634709 2 0.00% 0.00% 0.00% 0 MLTL Agent

335 0 1 0 0.00% 0.00% 0.00% 0 mld-mrouter

Proc

336 0 1 0 0.00% 0.00% 0.00% 0 mls-cgmp

Process

337 2636 109471 24 0.00% 0.00% 0.00% 0 mls-igmp

Process

338 28 113 247 0.00% 0.00% 0.00% 0

mcast-igmp-filte

339 4896 182462 26 0.00% 0.00% 0.00% 0 mls-mld

Process

340 0 1 0 0.00% 0.00% 0.00% 0 EM Background

Pr

341 0 2 0 0.00% 0.00% 0.00% 0 LOCAL AAA

342 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA

343 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA

344 0 2 0 0.00% 0.00% 0.00% 0 TPLUS

345 0 1 0 0.00% 0.00% 0.00% 0 Pre-download

RP

346 0 1 0 0.00% 0.00% 0.00% 0 Pre-dnld LC

to A

347 0 1 0 0.00% 0.00% 0.00% 0 Pre-download

pee

348 0 1 0 0.00% 0.00% 0.00% 0 router-guard

Pro

349 0 2 0 0.00% 0.00% 0.00% 0 MVRP SWITCH

Proc

350 0 2 0 0.00% 0.00% 0.00% 0 AAA SEND STOP

EV

351 4 7 571 0.00% 0.00% 0.00% 0 MCM IPC

Master

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

352 0 2 0 0.00% 0.00% 0.00% 0 RPC vslp_sp

353 60 19 3157 0.00% 0.00% 0.00% 0 OBFL MSG

obfl0

354 0 2 0 0.00% 0.00% 0.00% 0 Rommon

upgrade p

355 0 1 0 0.00% 0.00% 0.00% 0 CONST SMC

356 0 2 0 0.00% 0.00% 0.00% 0 RPC

c6k_autoshut

357 5072504 1550295 3271 0.00% 0.29% 0.29% 0 Env Poll

358 0 1 0 0.00% 0.00% 0.00% 0 Cat6k NTI SP

Exa

359 2240 328019 6 0.00% 0.00% 0.00% 0 Inline Power

Por

360 2767124 26521297 104 0.31% 0.06% 0.05% 0 C6K PROCMIB

SP P

361 0 2 0 0.00% 0.00% 0.00% 0 RPC

c6k_schedule

362 0 4 0 0.00% 0.00% 0.00% 0 RPC c6k_ubl

363 0 1 0 0.00% 0.00% 0.00% 0 capture

process

364 0 2 0 0.00% 0.00% 0.00% 0 RPC

cdump_rp_req

365 0 2 0 0.00% 0.00% 0.00% 0 RPC

cfmpal_rpc_r

366 0 2 0 0.00% 0.00% 0.00% 0 Const FIB

excep

367 0 2 0 0.00% 0.00% 0.00% 0 RPC

const_ifs_rp

368 0 2 0 0.00% 0.00% 0.00% 0 RPC cts_rp

369 0 2 0 0.00% 0.00% 0.00% 0 RPC

dhcp_snoopin

370 8 4 2000 0.00% 0.00% 0.00% 0 OBFL INTR

obfl0

371 224 16575 13 0.00% 0.00% 0.00% 0 OBFL TEMP

obfl0

372 512 39 13128 0.00% 0.00% 0.00% 0 HW Capacity

ICC

373 0 2 0 0.00% 0.00% 0.00% 0 RPC intacc_rp

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

374 0 2 0 0.00% 0.00% 0.00% 0 RPC itasca_sp

375 6144 2415 2544 0.00% 0.00% 0.00% 0 L2

Application T

376 0 2 0 0.00% 0.00% 0.00% 0 RPC

l2_macmove_r

377 0 1 0 0.00% 0.00% 0.00% 0 L2 Macn Task

378 0 4 0 0.00% 0.00% 0.00% 0 RPC

c6k_ltl_rp

379 0 2 0 0.00% 0.00% 0.00% 0 RPC

mvrp_rp2sp

380 5152 1632531 3 0.00% 0.00% 0.00% 0 NV Health

Monito

381 1256 546691 2 0.00% 0.00% 0.00% 0

DiagInbandRatePr

382 0 2 0 0.00% 0.00% 0.00% 0 RPC

c6k_oversubs

383 0 2 0 0.00% 0.00% 0.00% 0 RPC

pclc_g2_fw_s

384 0 2 0 0.00% 0.00% 0.00% 0 RPC

pclc_g2_ids_

385 120 1190 100 0.00% 0.00% 0.00% 0 RPC

issu_cli_rp2

386 32 261 122 0.00% 0.00% 0.00% 0 RPC

pf_issu_rp2s

387 0 20 0 0.00% 0.00% 0.00% 0 RPC

pf_prst_vbl_

388 0 2 0 0.00% 0.00% 0.00% 0 RPC

pf_redun_rp2

389 3804 56535 67 0.00% 0.00% 0.00% 0 RPC

c6k_power_sp

390 134552 1331856 101 0.00% 0.00% 0.00% 0 RPC

c6k_sp_envir

391 0 19 0 0.00% 0.00% 0.00% 0 PM Vlan Timer

Pr

392 0 1 0 0.00% 0.00% 0.00% 0 pm icc

process

393 12256 85921 142 0.00% 0.00% 0.00% 0 pm scp

process

394 296 1012 292 0.00% 0.00% 0.00% 0 PM CP Process

395 1176 1244 945 0.00% 0.00% 0.00% 0 RPC pm-cp

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

396 7428 5560564 1 0.00% 0.00% 0.00% 0 PM Callback

397 276 132 2090 0.00% 0.00% 0.00% 0 VLAN Manager

398 0 1 0 0.00% 0.00% 0.00% 0 PM FEC LOAD

SHAR

399 3020 164010 18 0.00% 0.00% 0.00% 0 Port manager

per

400 780 328019 2 0.00% 0.00% 0.00% 0 Max CPU

utilizat

401 0 2 0 0.00% 0.00% 0.00% 0 RPC

pvt_hosts_sw

402 0 2 0 0.00% 0.00% 0.00% 0 RPC

rep_rp2sp_ap

403 8 2 4000 0.00% 0.00% 0.00% 0 SEA main

process

404 0 1 0 0.00% 0.00% 0.00% 0

SeaErrorLogProc

405 1536 164013 9 0.00% 0.00% 0.00% 0 SP Error

Detecti

406 0 2 0 0.00% 0.00% 0.00% 0 RPC

error_detect

407 0 1 0 0.00% 0.00% 0.00% 0

vs_error_detecti

408 0 10 0 0.00% 0.00% 0.00% 0 RPC lcc_rp

409 260 3938 66 0.00% 0.00% 0.00% 0 RPC fabman_rp

410 0 1 0 0.00% 0.00% 0.00% 0 vs_fabman_rp

ICC

411 0 1 0 0.00% 0.00% 0.00% 0

vs_sp_environmen

412 0 2 0 0.00% 0.00% 0.00% 0 RPC

epld_isp_rpc

413 52 604 86 0.00% 0.00% 0.00% 0 RPC

c6k_stack_mi

414 0 2 0 0.00% 0.00% 0.00% 0 RPC chapi_sp

415 0 2 0 0.00% 0.00% 0.00% 0 RPC

const_ehsa_r

416 16 76 210 0.00% 0.00% 0.00% 0 RPC

const_nv_cfg

417 0 2 0 0.00% 0.00% 0.00% 0 RPC

const_platfo

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

418 28 154 181 0.00% 0.00% 0.00% 0 RPC dot1x_sp

419 4 24 166 0.00% 0.00% 0.00% 0 RPC

gbic_seprom_

420 0 2 0 0.00% 0.00% 0.00% 0 RPC l2_bridge

421 4 20 200 0.00% 0.00% 0.00% 0 RPC

lacp_switch_

422 8 259 30 0.00% 0.00% 0.00% 0 RPC

logging_even

423 12 364 32 0.00% 0.00% 0.00% 0 RPC

mapping_sp

424 0 2 0 0.00% 0.00% 0.00% 0 RPC

online_diag_

425 1984 8429 235 0.00% 0.00% 0.00% 0 RPC

online_diag_

426 0 2 0 0.00% 0.00% 0.00% 0 RPC

online_wan_d

427 868 11689 74 0.00% 0.00% 0.00% 0 RPC

pagp_switch_

428 12 295 40 0.00% 0.00% 0.00% 0 RPC

pikachu_sp

429 0 2 0 0.00% 0.00% 0.00% 0 RPC

pm_mat_mp2sp

430 792 8415 94 0.00% 0.00% 0.00% 0 RPC

pm_switch_rp

431 0 2 0 0.00% 0.00% 0.00% 0 RPC

psecure_sp

432 0 2 0 0.00% 0.00% 0.00% 0 RPC

pt_switch_mp

433 0 2 0 0.00% 0.00% 0.00% 0 RPC

qnq_switch_m

434 328 3068 106 0.00% 0.00% 0.00% 0 RPC

rf_cli_rp2sp

435 0 10 0 0.00% 0.00% 0.00% 0 RPC

span_switch_

436 0 2 0 0.00% 0.00% 0.00% 0 RPC

storm_contro

437 40 518 77 0.00% 0.00% 0.00% 0 RPC

stp_switch_a

438 0 2 0 0.00% 0.00% 0.00% 0 RPC

sw_backup_in

439 1235444 16362525 75 0.31% 0.05% 0.05% 0 RPC

sw_vlan_sp

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

440 0 2 0 0.00% 0.00% 0.00% 0 RPC

switch_engin

441 0 2 0 0.00% 0.00% 0.00% 0 RPC

ether_oam_rp

442 0 2 0 0.00% 0.00% 0.00% 0 RPC pf_rp_rpc

443 1884 23320 80 0.00% 0.00% 0.00% 0 RPC udld_sp

444 36 522 68 0.00% 0.00% 0.00% 0 RPC

sea_rp_cli_r

445 996 2418 411 0.00% 0.00% 0.00% 0 RPC

sea_console_

446 0 2 0 0.00% 0.00% 0.00% 0 RPC

cap_rpcs_req

447 0 2 0 0.00% 0.00% 0.00% 0 RPC

dot1ad_mp2sp

448 0 1 0 0.00% 0.00% 0.00% 0 VPN_MAPPER

449 0 2 0 0.00% 0.00% 0.00% 0 RPC

vs_prov_lc_s

450 0 1 0 0.00% 0.00% 0.00% 0 vs_pikachu_sp

IC

451 0 1 0 0.00% 0.00% 0.00% 0 vs_power_sp

ICC

452 0 278 0 0.00% 0.00% 0.00% 0 Syslog

453 0 1 0 0.00% 0.00% 0.00% 0 Cap LcCtrl:

SUP

454 0 7 0 0.00% 0.00% 0.00% 0 CMFI

455 20 268 74 0.00% 0.00% 0.00% 0 CMFI Scanner

456 0 3 0 0.00% 0.00% 0.00% 0 CMFI Misc

457 980 165534 5 0.00% 0.00% 0.00% 0 CMFI

Background

458 4 14 285 0.00% 0.00% 0.00% 0 Const2 IPv6

Proc

459 0 1 0 0.00% 0.00% 0.00% 0 v6fib stat

colle

460 0 47 0 0.00% 0.00% 0.00% 0 L2 Manager

Task

461 0 2 0 0.00% 0.00% 0.00% 0 L2 Manager

Earl6

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

462 0 1 0 0.00% 0.00% 0.00% 0 FPOE DB cc

463 29252 1604602 18 0.00% 0.00% 0.00% 0 LTL MGR

464 774332 493489 1569 0.00% 0.04% 0.05% 0 LTL MGR cc

465 0 2 0 0.00% 0.00% 0.00% 0 REP SP Proc

466 4 52 76 0.00% 0.00% 0.00% 0 SPAN switch

467 0 2 0 0.00% 0.00% 0.00% 0 ERSPAN Switch

SP

468 4 21 190 0.00% 0.00% 0.00% 0 SPAN Switch

SP

469 4216 164007 25 0.00% 0.00% 0.00% 0 SPAN Switch

SP B

470 232 75766 3 0.00% 0.00% 0.00% 0 NDE - IPV4

471 0 1 0 0.00% 0.00% 0.00% 0 NDE - MPLS

472 0 1 0 0.00% 0.00% 0.00% 0 NDE - L2

473 176 61893 2 0.00% 0.00% 0.00% 0 NDE - IPV6

474 724 328019 2 0.00% 0.00% 0.00% 0 SEA write CF

pro

475 0 1 0 0.00% 0.00% 0.00% 0 SEA write

messag

476 0 1 0 0.00% 0.00% 0.00% 0 SEA receive

proc

477 18068 164012 110 0.00% 0.00% 0.00% 0 TM Stat Adj

Task

478 164 497 329 0.00% 0.00% 0.00% 0 OBFL UPTIME

obfl

479 2020 176498 11 0.00% 0.00% 0.00% 0 IP Flow XDR

LC B

480 106192 11464473 9 0.00% 0.00% 0.00% 0 SCP async:

LCP#5

481 448 5652 79 0.00% 0.00% 0.00% 0 Collection

proce

482 1024 109343 9 0.00% 0.00% 0.00% 0 OBFL I/O

Buffer

483 97028 2462619 39 0.07% 0.00% 0.00% 0 CEF: IPv4

proces

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

484 24 52 461 0.00% 0.00% 0.00% 0 ADJ

background

485 46500 3139966 14 0.00% 0.00% 0.00% 0 SCP async:

LCP#3

486 39980 2459818 16 0.00% 0.00% 0.00% 0 SCP async:

LCP#2

487 56 373 150 0.00% 0.00% 0.00% 0 SpanTree

Helper

488 324 1166 277 0.00% 0.00% 0.00% 0 SpanTree

Flush

489 84 101 831 0.47% 0.05% 0.01% 1 Virtual Exec

-DIST65-01.TC1-sp#sh proc cpu history

1111111222221111 1111122222 1111111111111111111111

6611111000008888999991111155555888888888855555666666666688

100

90

80

70

60

50

40

30 *****

20 ** ********* ***** **********************

10 **********************************************************

0....5....1....1....2....2....3....3....4....4....5....5....

0 5 0 5 0 5 0 5 0 5

CPU% per second (last 60 seconds)

2222223222222222222122222222322222222222222222222322223222

1488822275624423487988449665055553432852248556623085385821

100

90

80

70

60

50

40 *

30 *** * *** ** ** ********* ** ***** *** ***

20 ##############################################*###

10 ##########################################################

0....5....1....1....2....2....3....3....4....4....5....5....

0 5 0 5 0 5 0 5 0 5

CPU% per minute (last 60 minutes)

• = maximum CPU% # = average CPU%

3333333333335343333333333333343333333333333333333333333334345453334333

9443168692511174443553424749502421714421416525863461264254223309512555

100

90

80

70

60

50 * * * *

40 * **** * * * ** * *** * ** *** * * ** ****** ****

30 **********************************************************************

20 ######################################################################

10 ######################################################################

0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.

0 5 0 5 0 5 0 5 0 5 0 5 0

CPU% per hour (last 72 hours)

• = maximum CPU% # = average CPU%

-DIST65-01.TC1-sp#sh proc cpu | exclude 0.00

CPU utilization for five seconds: 8%/0%; one minute: 15%; five minutes: 15%

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

3 36560880 33874681 1079 2.39% 2.19% 2.20% 0 DiagCard1/-1

77 2686244 20976927 128 0.07% 0.17% 0.16% 0 SCP Download

Lis

106 103749056 197866803 524 3.91% 6.22% 6.35% 0 slcp process

109 13364996 7258998 1841 0.15% 1.18% 1.02% 0 DiagCard2/-1

249 27680796 700097 39538 1.67% 1.69% 1.68% 0 Vlan

Statistics

282 627372 8004433 78 0.07% 0.05% 0.05% 0 Spanning Tree

464 774344 493501 1569 0.07% 0.03% 0.05% 0 LTL MGR cc

489 120 160 750 0.07% 0.06% 0.02% 1 Virtual Exec

thanks

Vinu

On Wed, Mar 17, 2010 at 4:03 PM, giuslar

[Jan Nejman]

Hello kumar,

  it looks that your switch processor is OK. The problem will be probably with rate limiters.

Could you send me "show mls statistics" and "show mls rate-limit usage"?

Jan

[vinoth.kumar]

Thanks for your reply

-DIST65-01.TC1#sh fabric utilization detail

Fabric utilization: Ingress Egress

Module Chanl Speed rate peak rate peak

1 0 20G 0% 0% 0% 1% @14:00

17Mar10

1 1 20G 0% 1% @13:11 05Mar10 0% 1% @12:36

17Mar10

5 0 20G 0% 1% @12:06 17Mar10 0% 1% @15:33

28Feb10

-DIST65-01.TC1#sh mls statistics

Statistics for Earl in Module 1

L2 Forwarding Engine

Total packets Switched : 60578204

L3 Forwarding Engine

Total packets Processed : 973227 @ 0 pps

Total packets L3 Switched : 22011 @ 0 pps

Total Packets Bridged : 17087

Total Packets FIB Switched : 22010

Total Packets ACL Routed : 0

Total Packets Netflow Switched : 1

Total Mcast Packets Switched/Routed : 376995

Total ip packets with TOS changed : 2

Total ip packets with COS changed : 2

Total non ip packets COS changed : 0

Total packets dropped by ACL : 0

Total packets dropped by Policing : 0

Total packets exceeding CIR : 0

Total packets exceeding PIR : 0

Errors

MAC/IP length inconsistencies : 0

Short IP packets received : 0

IP header checksum errors : 0

TTL failures : 0

MTU failures : 0

Statistics for Earl in Module 5

L2 Forwarding Engine

Total packets Switched : 24013162954

L3 Forwarding Engine

Total packets Processed : 24003699023 @ 20538 pps

Total packets L3 Switched : 23632264616 @ 20229 pps

Total Packets Bridged : 291999460

Total Packets FIB Switched : 23632264616

Total Packets ACL Routed : 0

Total Packets Netflow Switched : 0

Total Mcast Packets Switched/Routed : 19911908

Total ip packets with TOS changed : 2

Total ip packets with COS changed : 2

Total non ip packets COS changed : 0

Total packets dropped by ACL : 154

Total packets dropped by Policing : 0

Total packets exceeding CIR : 0

Total packets exceeding PIR : 0

Errors

MAC/IP length inconsistencies : 0

Short IP packets received : 0

IP header checksum errors : 0

TTL failures : 198758

MTU failures : 0

Total packets L3 Processed by all Modules: 24004672250 @ 20538 pps

-DIST65-01.TC1#sh mls rate-limit usage

Rate Limiter Type Packets/s Burst

[Jan Nejman]

Hi,

   the box is transfering only around 20k pps. I suppose that at this time is the box OK.

I have not any idea where is the problem at this moment. Try check the statistic as soon

as the problem occurs again. Did you tried to remove "rate-limiters" when you have troubles?

Jan

[vinoth.kumar]

Hi,

currently we diverted all traffic through the existing SUP 2 catalyst and

now 1% of traffic is there in SUP 720 since we had the issue

is there any way we can trace the issue now or any specfic logging enable

when we migrating next time

thanks for the reply

vinu

On Wed, Mar 17, 2010 at 4:35 PM, nejman@caligare.com <

[vinoth.kumar]

Hi,

Since our traffic between sites are mostly 90 % pointed as unicast

for example

from site 1 - 10.109.2.3

to site 2 - 10.107.2.3

we suspecting the problem could be the configuration based on the mls

unicast

kindly find the interface details and advice me in case of any issue

Hardware is EtherSVI, address is 0014.1b44.5c0a (bia 0014.1b44.5c0a)

Description: VLAN-CONNtoWAN_S/W

Internet address is 10.207.2.1/29

MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,

reliability 255/255, txload 128/255, rxload 138/255

Encapsulation ARPA, loopback not set

Keepalive not supported

ARP type: ARPA, ARP Timeout 04:00:00

Last input 00:00:00, output 00:01:06, output hang never

Last clearing of "show interface" counters 2d20h

Input queue: 0/75/38/38 (size/max/drops/flushes); Total output drops: 0

Queueing strategy: fifo

Output queue: 0/40 (size/max)

5 minute input rate 544561000 bits/sec, 384371 packets/sec

5 minute output rate 576551000 bits/sec, 409327 packets/sec

L2 Switched: ucast: 489568 pkt, 32212571 bytes - mcast: 818 pkt, 66204

bytes

L3 in Switched: ucast: 70386284274 pkt, 12835184566001 bytes - mcast: 0

pkt, 0

bytes mcast

L3 out Switched: ucast: 72218893515 pkt, 12923218491182 bytes

70391256862 packets input, 12836057109266 bytes, 0 no buffer

Received 406 broadcasts (0 IP multicasts)

0 runts, 0 giants, 0 throttles

0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored

72220103421 packets output, 12923392656634 bytes, 0 underruns

0 output errors, 0 interface resets

0 output buffer failures, 0 output buffers swapped out

but we experienced issue in the traffic connecting one way and another path

is fine which u can see the traffic packet difference in the interface

thanks

vinoth

On Wed, Mar 17, 2010 at 5:35 PM, vinoth kumar harikrishnan <

[Jan Nejman]

Hi Vinoth,

  the interface status looks OK. There are no output drops, no corrupted packets.

I think that you can solve this problem only when the problem occurs again. I haven't

any idea how to solve the problem at this time. I recommend to check routing

information (OSPF, BGP, static?), logging, mls status as soon as the problem

occurs again. Maybe someone else can help you earlier, but your interface status

looks OK from my side.

Jan

[vinoth.kumar]

Hi Thanks for reply

we some how found this could be the cause for belwo issue

currently we had 2 port channel group on the same switch port channel 1 and

10

port channel 1 is traffic coming IN around 650mb and module 4 port 13-20

port-channel 10 is traffic OUT to the other switch shared by 2 line card so

its 325 module 4 port 11 12 and module 3 port 11 and 12

at this point we are using 6148 line card which can only support up to 1 gig

of etherchannel throughput ASCI (by cisco refernce ) if we use the multiple

port-channel group also

if this true we might seen almost 975mb to 1Gig of traffic on that peak time

in Etherchannel ACSI which might leads to packet drop at that moment

what is mean by etherchannel ASCI ?

kindly need your advice

thanks

Vinoth kumar

On Thu, Mar 18, 2010 at 3:08 PM, nejman@caligare.com <

[Giuseppe Larosa]

Hello Vinoth,

the 6148 linecard is oversubscribed 8:1 this means that 8 ports share a common 1 Gbps capable ASIC (custom chip).

This is not related to the use of port channels and can be the reason of the problems you see rather then the use of sup720.

see

http://www.cisco.com/en/US//products/hw/switches/ps700/products_tech_note09186a00801751d7.shtml#ASIC

Hope to help

Giuseppe