3750-X Switch CPU Utilisation

[stuwrenuk]

Hi 

We currently have one of our switches showing extremely high CPU utilisation over a prolonged period of time. I am trying to get to the bottom of this and when i run the show processes cpu sorted I get this outcome

CPU utilization for five seconds: 99%/9%; one minute: 96%; five minutes: 92%
 PID Runtime(ms)     Invoked      uSecs   5Sec   1Min   5Min TTY Process
 270  2585448200  1321771459       1956 59.47% 57.89% 54.63%   0 HULC DAI Process
 279   524143071  1300214265        403 10.36%  9.24%  8.35%   0 IP Host Track Pr
 184   100611492   483949168        207  3.50%  3.41%  3.06%   0 Hulc LED Process
 111    70571773   543147282        129  2.39%  2.64%  2.48%   0 HLFM address lea
   4   406933861    17698292      22992  1.91%  1.64%  1.49%   0 Check heaps
  89   314790399    75933140       4145  1.91%  1.76%  1.75%   0 RedEarth Tx Mana
  88    68258009   104390503        653  1.27%  1.02%  0.92%   0 RedEarth I2C dri
 133    23168145    19586156       1182  0.63%  0.40%  0.39%   0 hpm counter proc

So the process in question looks like an Dynamic ARP Inspection issue, however its not running on the switch

show ip arp inspection

Source Mac Validation      : Disabled
Destination Mac Validation : Disabled
IP Address Validation      : Disabled
No active or enabled vlans on switch.

The TCAM table appears to be fine and im not seeing anything else obvious, can anyone help shed some light on this please?

Thanks

Stuart

[Charles Hill]

What IOS is it running?

[stuwrenuk]

15.2

Thanks

[Leo Laohoo · Accepted solution]

15.2

That is a very UNHELPFUL answer.  

If this is a 3750X appliance, I'd strongly recommend you use IOS version 12.2(55)SE9 and nothing else.

Check the configuration of your switch, do you have a configuration that goes like this:  ip route 0.0.0.0 0.0.0.0 <physical port instead of an IP address>  

[stuwrenuk]

Thanks for your response, if you feel that more information is required, all you have to do is ask rather than saying im unhelpful..at the time of posting i was funnily enough trying to troubleshoot the issue, hence the short answer. Looking back I appreciate I should of took the time to give a more indepth response seeing as im asking for your help.

You say I should use 12.2(55)SE9 but you don't give any justification for this? Is there any information to back up your claim that I should only be using this version? I would have to also justify it to my boss to make a change such as this.

With regards to your second point, our default route has an IP address at the end rather than the physical port.

Thanks
Stuart

[Leo Laohoo]

You say I should use 12.2(55)SE9 but you don't give any justification for this?

I don't need justification but the facts.  

I've been testing various IOS versions for the 3750-series line of switches.  From the ancient 12.2(33)SEE all the way up to 15.2(2)E, although I haven't tried/tested 15.2(3)E yet. 

I know, from first-hand-experience, which IOS are stable, which are horrible, and which IOS you really want to give to people you hate (because I can guarantee their 3750 switches are going to go down on it's knees, quickly). 

Is there any information to back up your claim that I should only be using this version? I would have to also justify it to my boss to make a change such as this.

Search this forum for stable IOS for 3750X and see what you come up with.  :)

[InayathUlla Sharieff]

Check your config to see if you have a default route configured pointing to an interface instead the IP address as seen below:

ip route 0.0.0.0 0.0.0.0 Fastethernet0/0

If yes change the default route to point to on IP address and check the CPU utilization again.

Here is the document for more info:

http://www.cisco.com/en/US/products/hw/switches/ps5023/products_tech_note09186a00807213f5.shtml

HTH