cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
983
Views
0
Helpful
3
Replies

Catalyst 6509 high CPU utilization and netdr packet information

jackson.ku
Level 3
Level 3

Hi, Our Catalyst 6509 have high CPU utilization issue ( up to 70-80%. normally was 10-20% )

I have used "debug netdr capture rx" to capture the packets while the CPU utilization was high. 

We have confirmed the source IP & destination IP of packets information, it is a data backup task.

Could you please help to analyze why these packets was processed by CPU and any workaround we can do?

 

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
68020800 00240400 01040005 EE000000 00060462 2E000004 00000008 0024FBB3
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40711
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900896689, ack 4059442234, win 3321 off 8 checksum 0xE064 ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
70020800 00240400 01040005 EE000000 00060462 2E000004 00000008 0024B3B3
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40712
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900898137, ack 4059442234, win 3321 off 8 checksum 0x5885 ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
78020800 00240400 01040005 EE000000 00060462 2E000004 00000008 00248BB3
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40713
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900899585, ack 4059442234, win 3321 off 8 checksum 0x23DA ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
80020800 00240400 01040005 EE000000 00060462 2E000004 00000008 0024E3BC
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40714
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900901033, ack 4059442234, win 3321 off 8 checksum 0x599E ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
88020800 00240400 01040005 EE000000 00060462 2E000004 00000008 0024DBBC
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40715
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900902481, ack 4059442234, win 3321 off 8 checksum 0x95CA ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
A8020800 00240400 01040005 EE000000 00060462 2E000004 00000008 00243BBC
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40719
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900908273, ack 4059442234, win 3321 off 8 checksum 0xF172 ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
C8020800 00240400 01040005 EE000000 00060462 2E000004 00000008 00249BB9
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40723
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900914065, ack 4059442234, win 3321 off 8 checksum 0x78FD ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
E8020800 00240400 01040005 EE000000 00060462 2E000004 00000008 00247BB9
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40727
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900919857, ack 4059442234, win 3321 off 8 checksum 0x7C71 ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
08020800 00240400 01040005 EE000000 00060462 2E000004 00000008 00245BB6
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40731
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900925649, ack 4059442234, win 3321 off 8 checksum 0xC1D7 ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
28020800 00240400 01040005 EE000000 00060462 2E000004 00000008 0024BBB6
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40735
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900931441, ack 4059442234, win 3321 off 8 checksum 0xBA97 ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
50020800 00240400 01040005 EE000000 00060462 2E000004 00000008 002453B3
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40740
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900938681, ack 4059442234, win 3321 off 8 checksum 0x9D3C ack

------- dump of incoming inband packet -------
l2idb Te5/5, l3idb Vl36, routine inband_process_rx_packet, timestamp 22:48:57.114
dbus info: src_vlan 0x24(36), src_indx 0x104(260), len 0x5EE(1518)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x24(36), CoS 0
cap1 1, cap2 0
70020800 00240400 01040005 EE000000 00060462 2E000004 00000008 0024B3B3
destmac 00.11.32.C5.4E.CB, srcmac 6C.9C.ED.BB.FC.80, ethertype 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 1500, identifier 40744
df 1, mf 0, fo 0, ttl 63, src 10.36.1.48, dst 10.36.3.67
tcp src 50130, dst 445, seq 2900944473, ack 4059442234, win 3321 off 8 checksum 0x9A90 ack

 

 

 

3 Replies 3

marce1000
VIP
VIP

 

 - Some other useful output maintained referring to the document below look for the string What Packets Are (Not) Hitting the CPU ?  (and then the subsequent commands below that question) :

                           http://bbk-design.ru/uploads/docs/BRKRST-3143.pdf

 M.



-- ' 'Good body every evening' ' this sentence was once spotted on a logo at the entrance of a Weight Watchers Club !

balaji.bandi
Hall of Fame
Hall of Fame

Can you post show out put of below information :

 

show version

show modules

show process cpu history sorted

show process cpu |  ex 0.00%

 

in related to your Issue, as mentioned by the post, when ever taking backup taking place you onbserved CPU high, what was the status when there is no backup ?

 

backup takeing from from where to where ? config backup or Databackup like DB backup so on ?

 

when you hitting the maximum load of the device, it is common to hit the CPU load high, but we need more information to confirm the same.

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

It is data backup, not config backup.

The CPU utilization down to 10-20% if we stop the backup task.
Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: