What is the process 'RPC pagp_switch_mp2sp'?

[kwansoo kim]

Dear,

Our 6500 was reboot byself with crash info and i found it was happend by CPUHOG.

The log is below for CPUHOG and you can see many times from attached crash info file.

%SYS-SP-3-CPUHOG: Task is running for (16000)msecs, more than (2000)msecs (15/12),process = RPC pagp_switch_mp2sp.

-Traceback= 4023B940 4023BBA0 405C5BDC 405C5FF4 405C6220 405C85EC 4074234C 40745BD4 4073DF64 4073E050 40D51D2C 40D4BFBC 404FEA4C 404FED58 %SYS-SP-3-CPUHOG: Task is running for (16000)msecs, more than (2000)msecs (15/12),process = RPC pagp_switch_mp2sp.
-Traceback= 4023B940 4023BBA0 405C5BDC 405C5FF4 405C6220 405C85EC 4074234C 40745BD4 4073DF64 4073E050 40D51D2C 40D4BFBC 404FEA4C 404FED58

I think this process made high cpu&memory issue and then there were internal communication fail.. isn't it?

So i need to know what PRC pagp_switch_mp2sp is to prevent next issue.

Please let me know what i should do for?

Thanks,

Eric.

[Arumugam Muthaiah]

Hi Eric,

Did you performance any changes recently? Configuration changes on an Etherchannel can cause the switch to reload after seeing the message:

%SYS-SP-3-CPUHOG: Task is running for (16000)msecs, more than (2000)msecs (15/12),process = RPC pagp_switch_mp2sp. -Traceback= 4023B940 4023BBA0 405C5BDC 405C5FF4 405C6220 405C85EC 4074234C 40745BD4 4073DF64 4073E050 40D51D2C 40D4BFBC 404FEA4C 404FED58

Please share the show version to decode these traceback.

Regards,

Aru

*** Please rate if the post is useful ***

[kwansoo kim]

Hi Aru,

thanks for your reply.

Do you need the show version only? If you need more, just tell me freely.

regards,

Eric

------------------ show version ------------------

Cisco Internetwork Operating System Software
IOS (tm) s72033_rp Software (s72033_rp-IPSERVICESK9-M), Version 12.2(18)SXF10, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2007 by cisco Systems, Inc.
Compiled Fri 13-Jul-07 08:32 by kellythw
Image text-base: 0x40101040, data-base: 0x42DB8050

ROM: System Bootstrap, Version 12.2(17r)SX5, RELEASE SOFTWARE (fc1)
BOOTLDR: s72033_rp Software (s72033_rp-IPSERVICESK9-M), Version 12.2(18)SXF10, RELEASE SOFTWARE (fc1)

BORA_11st_NAS_5F_SW#2 uptime is 5 hours, 34 minutes
Time since BORA_11st_NAS_5F_SW#2 switched to active is 5 hours, 33 minutes
System returned to ROM by software NMI at PC 0xBFC2A6D8, address 0x0 at @퐄\@펤h
^^p (SP by software NMI at PC 0xBFC10494, address 0x0)
System image file is "sup-bootdisk:s72033-ipservicesk9-mz.122-18.SXF10.bin"

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco WS-C6509-E (R7000) processor (revision 1.5) with 458720K/65536K bytes of memory.
Processor board ID SMC1346006P
SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
Last reset from s/w reset
SuperLAT software (copyright 1990 by Meridian Technology Corp).
X.25 software, Version 3.0.0.
Bridging software.
TN3270 Emulation software.
5 Virtual Ethernet/IEEE 802.3 interfaces
242 Gigabit Ethernet/IEEE 802.3 interfaces
1917K bytes of non-volatile configuration memory.
8192K bytes of packet buffer memory.

65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102

[Arumugam Muthaiah]

Hi,

I decoded those traceback and understood that this issue closely matching with known Bug CSCso47436 opened for SXF however it was unreproducible. SXF could be impacted as well

Several CPUHOG error messages before the crash meaning that there was a process that was running longer than 2 seconds without relinquishing the processor and the router basically crashed as this process (RPC pagp_switch_mp2sp) kept on running. Most of the cases are related with ether channel configuration issue. Please see the detail below about this bug.

CSCso47436 - CPUHOG in process 'pagp_switch_mp2sp', then crash

Symptom:
After making etherchannel configuration changes the device then reports CPUHOG in process 'pagp_switch_mp2sp' then crashes.

I would suggest to upgrade the CODE as SXF is already EOL/EOS

Refer:

http://www.cisco.com/en/US/prod/collateral/iosswrel/ps8802/ps6970/ps6017/end_of_life_c51-568765.html

Regards,

Aru

*** Please rate if the post is useful ***

[kwansoo kim]

Hi,

Thanks for very useful reply.

I'm gonna check whether ther was configuration change for etherchannel at that time or not.

But i'm concerning about configuration etherchannels without IOS upgrade.. so i want to know which was just a transient issue or still have possibilities to be happend with etherchannel configuration brightly.

Could you give me your opinion?

Thanks & regards,

eric,

[Arumugam Muthaiah]

Hi,

Thanks for your response. Based on the previous history of this issue, you may see this issue again some time later but this is not happening every time.

Better to upgrade higher code to avoid any production issue.

Regards,

Aru

*** Please rate if the post is useful ***

[kwansoo kim]

Hi,

Which code has been fixed for this bug?

i'm searching for patched version, but i can't find yet.

Could you recommend a code?

Thanks,

eric.

[Arumugam Muthaiah]

Hi,

The issue not seen in the latest 12.2 SXF, 12.2(33)SXH or 12.2(33)SXI, 12.2(33)SXF train of IOS

12.2(33)SXF
12.2(33)SXH2a
12.2(33)SXI5
12.2(33)SXI8

You could upgrade any latest code to fix this issue.

Regards,

Aru

*** Please rate if the post is useful ***

[kwansoo kim]

Hi,

Thank a lot!