N7K CPU average 60%

[hery hafif setiadi]

guys, below is capture from our N7K, it is normal ? attached is process sort

N7K# show processes cpu history

    667656577656766777656666566767666656676656765657665666756667

    400944840781477430371289950341043670101261668873067380071941

100                                                            

90                                                            

80                                           #                

70   ##   ###  ######    ## # # #   #   #    ## # # #  # #  # #

60 #### #######################################################

50 ############################################################

40 ############################################################

30 ############################################################

20 ############################################################

10 ############################################################

    0....5....1....1....2....2....3....3....4....4....5....5....

              0    5    0    5    0    5    0    5    0    5   

               CPU% per second (last 60 seconds)

                      # = average CPU%

                                             1                 

    998987979877997888977879978889878889977980979779798779978879

    773489762098568321976182640097782087058310288877672798460191

100 **    *     **    *     *    *     *     *  *  * *   *     

90 ** ** * *   **    *    **   ***   ***  * ** *  * *   **    *

80 ************************* **********************************

70 #####*###*####*#####*####*###########**#*####**#*#***##***##

60 ############################################################

50 ############################################################

40 ############################################################

30 ############################################################

20 ############################################################

10 ############################################################

    0....5....1....1....2....2....3....3....4....4....5....5....

              0    5    0    5    0    5    0    5    0    5   

               CPU% per minute (last 60 minutes)

              * = maximum CPU%   # = average CPU%

    11                                                                     

    009999999999999999999999999888888888899998999999998888889899988888888898

    006595284636655489898798840657996989803667151065316796760631034530426928

100 ****** * * **** *********              **  *  **                       

90 *************************************************************  *    ****

80 ************************************************************************

70 ##**************#########*********************###***********************

60 ########################################################################

50 ########################################################################

40 ########################################################################

30 ########################################################################

20 ########################################################################

10 ########################################################################

    0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.

              0    5    0    5    0    5    0    5    0    5    0    5    0

                   CPU% per hour (last 72 hours)

                  * = maximum CPU%   # = average CPU%

[ngoldwat]

Hi,

Please include to output from show system resources, show processes stack, show system internal processes cpu & show system internal kernel [cpuhogmon | memory {usage | global [detail].

Did you just notice this or is this a pre-exisiting condition?  Have any changes been made recently?

Thanks

[hery hafif setiadi]

hi ngoldwat,

thankyou for your respon

this is in existing production running with 4 vdcs; admin,core,serverfarm,edge

we just migrate from 3 6500s last month, previous it only spike 20-30% ran on 6500

Software

  BIOS:      version 3.22.0

  kickstart: version 6.0(1)

  system:    version 6.0(1)

  BIOS compile time:       02/20/10

  kickstart image file is: bootflash:///n7000-s1-kickstart.6.0.1.bin

  kickstart compile time:  12/25/2020 12:00:00 [10/19/2011 12:00:34]

  system image file is:    bootflash:///n7000-s1-dk9.6.0.1.bin

  system compile time:     9/25/2011 2:00:00 [10/19/2011 13:42:59]

Hardware

  cisco Nexus7000 C7010 (10 Slot) Chassis ("Supervisor module-1X")

  Intel(R) Xeon(R) CPU         with 8251592 kB of memory.

  Processor Board ID JAF1614AAMG

show log attached

cheers

[hery hafif setiadi]

should i open TAC for this ?

[ngoldwat]

Hi

I did a little digging and found a couple actions you can try:

1) Disable features one-by-one (If problem resolves note the feature)
2) Possible workaround is to switchover from active to standby. (Or a reload)

Otherwise

# sh sys internal processes cpu 


  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
10904 auser   20   0  4340 2352 1560 S  5.7  0.1   1730:13 first-setup.cor  <----look for this process


If you see it increase note any changes made that would coincide with the age of the hung process then run the following commands:

# show tech detail

you will want to run this from the VDC showing the hung process and save it to bootflash:

# show tech detail > bootflash:sh_tech_det

Pull the accounting log:

# show accounting log

Then open a TAC case.

Thanks