ASR1001-x Message Log

[jds5]

Hello,

We see the following message in the logs continuously:
%IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x2162fc offset:0x2162fc000 grain:0 syndrome:0xc1 - SBE)

Can you tell me the meaning of the following message?

Version 16.06.06

Thanks,

[balaji.bandi]

Looks for me some bug, how long was the router uptime, if you maintenance window, try to reboot and check.

or upgrade to latest IOX XE stable version see if that fix the issue.

[marce1000]

 - EDAC points to the underlying Linux component of the OS and is a  kernel module steering the memory controller on the device so this smells like a  memory hardware problem. Connect to the ASR with the https://cway.cisco.com/cli/ at the top left you can then run or press 'System Diagnostics' and at the right you can run 'Crashdump Analyzer'  . Since this is an error 'deep in the device' I am in doubt as this will return anything informative but it is worth trying. you may also try the latest advisory software version on the device and check if that can help , but since it is 80%-hardware it probably won't help.  You could try cold power cycle and or press on dimms if you are an adventurer.... If it keeps coming contact TAC  , the device may need replacement (RMA)

 M.

[Leo Laohoo]

Post the complete output to the following commands:  

• sh version
• sh platform resource 
• sh platform software status control-processor brief

[jds5]

Here is the result of these commands:

*Nov 4 13:00:13.564: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a74 offset:0x219a74000 grain:0 syndrome:0xc1 - SBE)
*Nov 4 13:00:16.570: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a30 offset:0x219a30000 grain:0 syndrome:0xc1 - SBE)
*Nov 4 13:00:21.580: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a30 offset:0x219a30000 grain:0 syndrome:0xc1 - SBE)
*Nov 4 13:00:26.590: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a30 offset:0x219a30000 grain:0 syndrome:0xc1 - SBE)
*Nov 4 13:00:27.592: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x21aafc offset:0x21aafc000 grain:0 syndrome:0xc1 - SBE)
*Nov 4 13:00:31.600: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a30 offset:0x219a30000 grain:0 syndrome:0xc1 - SBE)show platform software status control-processor br
*Nov 4 13:00:33.604: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x216588 offset:0x216588000 grain:0 syndrome:0xc1 - SBE)
Load Average
Slot Status 1-Min 5-Min 15-Min
RP0 Healthy 0.01 0.04 0.07

Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
RP0 Healthy 8054292 2390528 (30%) 5663764 (70%) 5475688 (68%)

CPU Utilization
Slot CPU User System Nice Idle IRQ SIRQ IOwait
RP0 0 0.30 0.20 0.00 99.40 0.00 0.10 0.00
1 0.00 0.00 0.00 100.00 0.00 0.00 0.00
2 0.29 0.19 0.00 99.50 0.00 0.00 0.00
3 0.00 0.00 0.00 100.00 0.00 0.00 0.00
4 0.19 0.19 0.00 99.60 0.00 0.00 0.00
5 0.00 0.00 0.00 100.00 0.00 0.00 0.00
6 0.50 0.40 0.00 99.09 0.00 0.00 0.00
7 0.90 0.10 0.00 99.00 0.00 0.00 0.00

kernel-error#
*Nov 4 13:00:36.610: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a30 offset:0x219a30000 grain:0 syndrome:0xc1 - SBE)show platform software status control-processor br
*Nov 4 13:00:38.614: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x216898 offset:0x216898000 grain:0 syndrome:0xc1 - SBE)resources run
*Nov 4 13:00:41.620: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a30 offset:0x219a30000 grain:0 syndrome:0xc1 - SBE)ow platform resources
*Nov 4 13:00:42.622: %IOSXE-4-PLATFORM: R0/0: kernel: EDAC MC0: 1 CE INTERNAL ERROR on unknown memory (channel:0 csrow:0 page:0x219a74 offset:0x219a74000 grain:0 syndrome:0xc1 - SBE)
**State Acronym: H - Healthy, W - Warning, C - Critical
Resource Usage Max Warning Critical State
----------------------------------------------------------------------------------------------------
RP0 (ok, active) H
Control Processor 0.70% 100% 90% 95% H
DRAM 2334MB(29%) 7865MB 90% 95% H
ESP0(ok, active) H
QFP H
TCAM 8cells(0%) 131072cells 65% 85% H
DRAM 86410KB(2%) 3670016KB 80% 90% H
IRAM 9941KB(7%) 131072KB 80% 90% H
CPU Utilization 1.00% 100% 90% 95% H

Thx

[Leo Laohoo]

Except for the error messages, the CPU and memory utilization looks good. 

I suspect this is a memory "rot".  Contact Cisco TAC.  They may need to send replacement memory.