Error with TCAM

megalloid · ‎05-12-2016

I have any problem with Cisco ASR1001-X.

Problem comes when device start's and after up interfaces. If create 3 subinterfaces with 8094 QinQ vlan's - i have no problems.

After I create 4th subinterface - I have problems messages, IPoE doesnt works.

And what is port 1 means in log?

Logging:

*May 11 08:16:40.136: %SMART_LIC-6-AGENT_READY: Smart Agent for
Licensing is initialized
*May 11 08:16:41.154: %IOS_LICENSE_IMAGE_APPLICATION-6-LICENSE_LEVEL:
Module name = asr1001x Next reboot level = adventerprise and License =
adventerprise
*May 11 08:16:43.180: %IOSXE_THROUGHPUT-6-LEVEL: Throughput level has
been set to 20000000 kbps
*May 11 08:16:49.936: pak_debug_init: Successfully initialized pak debug
trace buffer
*May 11 08:16:54.100: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled
for type vlan
*May 11 08:16:57.313: %VOICE_HA-7-STATUS: CUBE HA-supported platform
detected.
*May 11 08:16:58.285: %LINK-3-UPDOWN: Interface Lsmpi0, changed state to up
*May 11 08:16:58.285: %LINK-3-UPDOWN: Interface EOBC0, changed state to up
*May 11 08:16:58.285: %LINEPROTO-5-UPDOWN: Line protocol on Interface
VoIP-Null0, changed state to up
*May 11 08:16:58.285: %LINEPROTO-5-UPDOWN: Line protocol on Interface
LI-Null0, changed state to up
*May 11 08:16:58.285: %LINK-3-UPDOWN: Interface GigabitEthernet0,
changed state to down
*May 11 08:16:58.288: %LINK-3-UPDOWN: Interface LIIN0, changed state to up
*May 11 08:17:00.318: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management
vrf Mgmt-intf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*May 11 08:17:00.433: %LINEPROTO-5-UPDOWN: Line protocol on Interface
Lsmpi0, changed state to up
*May 11 08:17:00.433: %LINEPROTO-5-UPDOWN: Line protocol on Interface
EOBC0, changed state to up
*May 11 08:17:00.433: %LINEPROTO-5-UPDOWN: Line protocol on Interface
GigabitEthernet0, changed state to down
*May 11 08:17:00.433: %LINEPROTO-5-UPDOWN: Line protocol on Interface
LIIN0, changed state to up
*May 11 08:16:45.563: %CMLIB-6-THROUGHPUT_VALUE: F0: cmand: Throughput
license found, throughput set to 20000000 kbps
*May 11 08:16:46.180: %CPPHA-7-START: F0: cpp_ha: CPP 0 preparing ucode
*May 11 08:16:46.357: %CPPHA-7-START: F0: cpp_ha: CPP 0 startup init
*May 11 08:16:50.003: %IOSXE-4-PLATFORM: R0/0: kernel: OCTEON[0]:
Received active indication from core
*May 11 08:16:50.003: %IOSXE-4-PLATFORM: R0/0: kernel:
octeon_core_drv_init: ctx_chunks = 14000
*May 11 08:16:50.003: %IOSXE-4-PLATFORM: R0/0: kernel:
octeon_core_drv_init: boot_log_ptr=12d580
*May 11 08:16:50.003: %IOSXE-4-PLATFORM: R0/0: kernel:
octeon_core_drv_init: Build = N2-Like IPSec Version:
2.3.0-101-03-0402-91831-ilkx-CR N2-Like SSL Version: 2.3.0-101-03-0402-9
*May 11 08:16:50.003: %IOSXE-4-PLATFORM: R0/0: kernel: OCTEON[0] is
running BASE application (core clock: 1100000000 Hz)
*May 11 08:16:50.320: %CPPHA-7-START: F0: cpp_ha: CPP 0 running init
*May 11 08:16:50.661: %CPPHA-7-READY: F0: cpp_ha: CPP 0 loading and
initialization complete
*May 11 08:16:50.774: %IOSXE-6-PLATFORM: SIP0: cpp_cp: Process
CPP_PFILTER_EA_EVENT__API_CALL__REGISTER
*May 11 08:16:51.390: %IOSXE-4-PLATFORM: R0/0: kernel: OCTEON[0] Poll
Function (Module Starter arg: 0x0) completed (status: Finished)
*May 11 08:17:00.951: %CMCC-3-PLIM_STATUS: SIP0: cmcc: A PLIM driver
informational error Ysn-Mgp1 - fifoErr6, block 26 count 1
000031: *May 11 08:17:02: %SYS-5-LOG_CONFIG_CHANGE: Buffer logging:
level debugging, xml disabled, filtering disabled, size (5000000)
000032: *May 11 08:17:02: %SYS-5-LOG_CONFIG_CHANGE: Monitor logging disabled
000033: *May 11 13:17:02: %SYS-6-CLOCKUPDATE: System clock has been
updated from 08:17:02 UTC Wed May 11 2016 to 13:17:02 YEKT Wed May 11
2016, configured from console by console.
000034: *May 11 13:17:02: %LINEPROTO-5-UPDOWN: Line protocol on
Interface Loopback0, changed state to up
000035: *May 11 13:17:03: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host
91.205.237.49 port 0 CLI Request Triggered
000036: *May 11 13:17:03: %SYS-5-CONFIG_I: Configured from memory by console
000037: *May 11 13:17:03: %IOSXE_OIR-6-REMSPA: SPA removed from subslot
0/0, interfaces disabled
000038: *May 11 13:17:03: %SPA_OIR-6-OFFLINECARD: SPA
(BUILT-IN-2T+6X1GE) offline in subslot 0/0
000039: *May 11 13:17:03: %IOSXE_OIR-6-INSCARD: Card (fp) inserted in
slot F0
000040: *May 11 13:17:03: %IOSXE_OIR-6-ONLINECARD: Card (fp) online in
slot F0
000041: *May 11 13:17:03: %IOSXE_OIR-6-INSCARD: Card (cc) inserted in slot 0
000042: *May 11 13:17:03: %IOSXE_OIR-6-ONLINECARD: Card (cc) online in
slot 0
000043: *May 11 13:17:03: %IOSXE_OIR-6-INSSPA: SPA inserted in subslot 0/0
000044: *May 11 13:17:03: %SYS-5-RESTART: System restarted --
Cisco IOS Software, ASR1000 Software (X86_64_LINUX_IOSD-UNIVERSALK9-M),
Version 15.4(3)S2, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Fri 30-Jan-15 14:23 by mcpre
000045: *May 11 13:17:03: %CRYPTO-6-ISAKMP_ON_OFF: ISAKMP is OFF
000046: *May 11 13:17:03: %CRYPTO-6-GDOI_ON_OFF: GDOI is OFF
000047: *May 11 13:17:06: %LINEPROTO-5-UPDOWN: Line protocol on
Interface Virtual-Access2, changed state to up
000048: *May 11 13:17:06: %LINK-3-UPDOWN: Interface Virtual-Access2,
changed state to up
000049: *May 11 13:17:06: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host
91.205.237.49 port 514 started - CLI initiated
000050: *May 11 13:17:08: %SNMP-5-COLDSTART: SNMP agent on host 205 is
undergoing a cold start
000051: *May 11 13:17:10: %LINK-3-UPDOWN: Interface GigabitEthernet0,
changed state to up
000052: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000053: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 785 on port 1
000054: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000055: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 786 on port 1
000056: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000057: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 787 on port 1
000058: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000059: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 788 on port 1
000060: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000061: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 789 on port 1
000062: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000063: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 790 on port 1
000064: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000065: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 791 on port 1
000066: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000067: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 792 on port 1
000068: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000069: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 793 on port 1
000070: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000071: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 794 on port 1
000072: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000073: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 795 on port 1
000074: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000075: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 796 on port 1
000076: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000077: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 797 on port 1
000078: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000079: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 798 on port 1
000080: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000081: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 799 on port 1
000082: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000083: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 800 on port 1
000084: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000085: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 801 on port 1
000086: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000087: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 802 on port 1
000088: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000089: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 803 on port 1
000090: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000091: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outerN TCAM
000092: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 891 on port 1
000093: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000094: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 892 on port 1
000095: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000096: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 893 on port 1
000097: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000098: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 894 on port 1
000099: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000100: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 895 on port 1
000101: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000102: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 512 on port 1
000103: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000104: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 513 on port 1
000105: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000106: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 514 on port 1
000107: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000108: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 515 on port 1
000109: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000110: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 516 on port 1
000111: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000112: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 517 on port 1
000113: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000114: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 518 on port 1
000115: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000116: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 519 on port 1
000117: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000118: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 520 on port 1
000119: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000120: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 521 on port 1
000121: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000122: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 522 on port 1
000123: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000124: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 523 on port 1
000125: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000126: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 524 on port 1
000127: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000128: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 525 on port 1
000129: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000130: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 526 on port 1
000131: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert int 3904 inner vlan 539 on port 1
000132: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000133: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 540 on port 1
000134: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000135: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 541 on port 1
000136: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000137: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 542 on port 1
000138: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to insert into VLAN TCAM
000139: *May 11 13:17:10: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM
Failed to set outer vlan 3904 inner vlan 543 on port 1

Mark Malone · ‎05-12-2016

That looks like a bug software defect as there is another very similar know one CSCuu50414

%IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM Failed to insert into DA TCAM

You could check the release notes for the IOS-XE image online see if it has vlan TCAM error, if its known or take a chance and upgrade to a newer image , if your on the latest image you may have to go through TAC

megalloid · ‎05-12-2016

I dont have access to this information on CSCuu50414. Can you give any information for troubleshooting of this bug?(

Mark Malone · ‎05-13-2016

The bug is locked from public view only TAC can release the details of it

Kanes Ramasamy · ‎12-14-2016

Hi,

Were you able to identify the fault/reason the errors message occurred?

I am currently on version 15.5(3) S1a and the error messages received are as following:

*Dec 11 22:06:53.033: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM Failed to set outer vlan 52 inner vlan 3990 on port 3
*Dec 11 22:06:53.250: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM Failed to insert into VLAN TCAM
*Dec 11 22:06:53.250: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM Failed to set outer vlan 52 inner vlan 3991 on port 3
*Dec 11 22:06:53.562: %IOSXE-4-PLATFORM: R0/0: kernel: ERROR: LPM Failed to insert into VLAN TCAM

Hope you can share the outcome of the error.

Thanks and Regards,

kanes.R