4321 ERSPAN will not save after config mode ends

[goliver]

Hi,

I have a 4321 and I'm trying to configure ERSPAN, but it will not save after I leave config mode:

cme-4321#sh ver
Cisco IOS XE Software, Version 16.12.03
Cisco IOS Software [Gibraltar], ISR Software (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 16.12.3, RELEASE SOFTWARE (fc5)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2020 by Cisco Systems, Inc.
Compiled Mon 09-Mar-20 21:58 by mcpre

cme-4321#conf t
Enter configuration commands, one per line.  End with CNTL/Z.
cme-4321(config)#no monitor session 100
cme-4321(config)#monitor session 100 type erspan-source
cme-4321(config-mon-erspan-src)#header-type 3
cme-4321(config-mon-erspan-src)#source vlan 1 both
cme-4321(config-mon-erspan-src)#no shutdown
cme-4321(config-mon-erspan-src)#destination
cme-4321(config-mon-erspan-src-dst)#erspan-id 101
cme-4321(config-mon-erspan-src-dst)#ip address 192.168.113.54
cme-4321(config-mon-erspan-src-dst)#mtu 1500
cme-4321(config-mon-erspan-src-dst)#origin ip address 192.168.113.54
cme-4321(config-mon-erspan-src-dst)#no shutdown
cme-4321(config-mon-erspan-src)#
cme-4321(config-mon-erspan-src)#
cme-4321(config-mon-erspan-src)#do sh mon sess all
Session 100
----------
Type                     : ERSPAN Source Session
Status                   : Admin Enabled
Source VLANs             :
    Both                 : 1
Destination IP Address   : 192.168.113.54
MTU                      : 1500
Destination ERSPAN ID    : 101
Origin IP Address        : 192.168.113.54


cme-4321(config-mon-erspan-src)#
cme-4321(config-mon-erspan-src)#
cme-4321(config-mon-erspan-src)#end
cme-4321#sh mo
*Dec  1 22:03:13.270: %SYS-5-CONFIG_I: Configured from console by vty0 (192.168.99.10)n sess all
Session 100
----------
Type                     : Local Session
Source VLANs             :
    Both                 : 1

I have never seen a router do this - anyone have any ideas?  If I leave it in config mode, it works as expected

TiA,

Greg

[balaji.bandi]

Post complete output without editing any information.

#sh ver 

[goliver]

Here ya go - thanks!

cme-4321#term len 0
cme-4321#sh ver
Cisco IOS XE Software, Version 16.12.03
Cisco IOS Software [Gibraltar], ISR Software (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 16.12.3, RELEASE SOFTWARE (fc5)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2020 by Cisco Systems, Inc.
Compiled Mon 09-Mar-20 21:58 by mcpre


Cisco IOS-XE software, Copyright (c) 2005-2020 by cisco Systems, Inc.
All rights reserved.  Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0.  The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY.  You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0.  For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.


ROM: IOS-XE ROMMON

cme-4321 uptime is 7 hours, 48 minutes
Uptime for this control processor is 7 hours, 50 minutes
System returned to ROM by PowerOn
System image file is "bootflash:isr4300-universalk9.16.12.03.SPA.bin"
Last reload reason: PowerOn



This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.



Suite License Information for Module:'esg' 

--------------------------------------------------------------------------------
Suite                 Suite Current         Type           Suite Next reboot     
--------------------------------------------------------------------------------
FoundationSuiteK9     None                  Smart License  None                  
securityk9
appxk9

AdvUCSuiteK9          None                  Smart License  None                  
uck9
cme-srst
cube


Technology Package License Information: 

-----------------------------------------------------------------
Technology    Technology-package           Technology-package
              Current       Type           Next reboot  
------------------------------------------------------------------
appxk9           None             Smart License    None
uck9             uck9             Smart License    uck9
securityk9       securityk9       Smart License    securityk9
ipbase           ipbasek9         Smart License    ipbasek9

The current throughput level is 50000 kbps 


Smart Licensing Status: UNREGISTERED/EVAL MODE

cisco ISR4321/K9 (1RU) processor with 1695070K/3071K bytes of memory.
Processor board ID FLM2133V141
1 Virtual Ethernet interface
10 Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
3223551K bytes of flash memory at bootflash:.
0K bytes of WebUI ODM Files at webui:.

Configuration register is 0x2102

cme-4321#

[marce1000]

         - Could you try to end the configuration session with exit instead of end.

 M.

[goliver]

Sure thing - same result.  Seems as soon as I leave the erspan source mode config it does not take.  I have (2) older IOS I can try today, but they both have bugs with the E&M NIM cards.  This is obviously my lab router @ home, but I do need it to be functional.  Seems the folks we request files from on our Developer Partner Program are out and are not responding quickly to get me the IOS I requested yesterday (latest).

[greg@carbon ERSPAN]$ telnet 192.168.113.20
Trying 192.168.113.20...
Connected to 192.168.113.20.
Escape character is '^]'.


User Access Verification

Password: 
cme-4321#conf t
Enter configuration commands, one per line.  End with CNTL/Z.
cme-4321(config)#no monitor session 100
cme-4321(config)#monitor session 100 type erspan-source
cme-4321(config-mon-erspan-src)#header-type 3
cme-4321(config-mon-erspan-src)#source vlan 1 both
cme-4321(config-mon-erspan-src)#no shutdown
cme-4321(config-mon-erspan-src)#destination
cme-4321(config-mon-erspan-src-dst)#erspan-id 101
cme-4321(config-mon-erspan-src-dst)#ip address 192.168.113.54
cme-4321(config-mon-erspan-src-dst)#mtu 1500
cme-4321(config-mon-erspan-src-dst)#origin ip address 192.168.113.20
cme-4321(config-mon-erspan-src-dst)#no shutdown
cme-4321(config-mon-erspan-src)#
cme-4321(config-mon-erspan-src)#
cme-4321(config-mon-erspan-src)#do sh mon sess all
Session 100
----------
Type                     : ERSPAN Source Session
Status                   : Admin Enabled
Source VLANs             :
    Both                 : 1
Destination IP Address   : 192.168.113.54
MTU                      : 1500
Destination ERSPAN ID    : 101
Origin IP Address        : 192.168.113.20


cme-4321(config-mon-erspan-src)#exit
cme-4321(config)#do sh mon sess all
Session 100
----------
Type                     : Local Session
Source VLANs             :
    Both                 : 1

[marce1000]

 - I tend to believe the problem is probably due to the intended configuration not being fully completed. I would advise to look for similar configuration examples using googling for instance, and look for similar setups from cisco documentation (e.g.) or other information-sources.

 M.

[goliver]

Unfortunately, that is a complete configuration - same config works fine on other devices.  I just switched to an earlier IOS and it is even more broken   With isr4300-universalk9.16.09.01.SPA.bin it does not even let me configure a destination

These are the only IOS I have though, and the latest let's me get closest:

./Downloads/Cisco/4300series/isr4300-universalk9.16.12.03.SPA.bin
./Downloads/Cisco/4300series/isr4300-universalk9.16.06.04.SPA.bin
./Downloads/Cisco/4300series/isr4200_4300_rommon_1612_2r_SPA.pkg
./Downloads/Cisco/4300series/isr4300-universalk9.16.03.07.SPA.bin
./Downloads/Cisco/4300series/isr4300-universalk9.16.09.01.SPA.bin

Like I said - it works when I leave it in config mode.  I guess I can hook a Pi to the console and set the timeout to 0 so I can get my work done until the Partner Program folks get me the files I need

Thanks for the help

[marce1000]

 - I see that there are  2 'no shutdown' commands in the configuration sequence, could you try with just one near the 'ending' command ?

 M.

[goliver]

Same thing unfortunately.  I think it best to just table this until I can get the latest software on it.  The progression from oldest to newest, and even more importantly, my past experiences with the NIM cards and code in this model of router, lead me to lean toward code shortcomings.  I've tried the commands in different orders, etc for the better part of a couple hours already

[marce1000]

 - Ok, one last thing to check, could be to verify the logs (show logging) , just before and then also after the end command  has been inputted in order to verify as to whether the device might report the cause of the intended configuration not staying in place.

 M.

[goliver]

Just the standard "Configured from VTY" lines before and after.  You can see, it is enabled in hardware and software, but I think the code to enable it is not completed in my version.

We have a lot of customers who use these for CUBEs and ERSPAN from them (which is why I need to get this working so we can record the calls for them), but this one just has old IOS (we can record their LMR / E&M traffic with this version though)

ERSPAN State:
  Status    : Active
  Complexes : 1
  CPPs      : 1
Capabilites:
  IP TOS       : 255
  Max sessions : 1032
  Max outputs  : 128
  IP TOS       : 0
  IP TTL       : 255
  COS          : 0
  Encaps type  : ERSPAN type-II / ERSPAN type-III
  GRE protocol : 0x88BE         / 0x22EB
  MTU          : 1464           / 1452
System Statistics:
  DROP src session replica  :                  0 /                  0
  DROP term session replica :                  0 /                  0
  DROP receive malformed    :                  0 /                  0
  DROP receive invalid ID   :                  0 /                  0
  DROP recycle queue full   :                  0 /                  0
  DROP no GPM memory        :                  0 /                  0
  DROP no channel memory    :                  0 /                  0
  DROP src session replica  :                  0 /                  0
  DROP src session replica  :                  0 /                  0
  DROP replica by ACL filter:                  0 /                  0
  DROP by NAM SPAN session  :                  0 /                  0
Client Debug Config:
  Enabled: Error, Warn
Data Path Debug Config:
  0x00000000

Thanks for your attempts to help though - much appreciated!

[marce1000]

  - One other thing to verify is when the ERSPAN configuration is in place (no end-command has been given). If you then connect to the device through another session , can you  then examine the running-config and check if it is present ?

  M.

[goliver]

Yes, it is, but you can see it is still not transmitting anything.

cme-4321# sh platform hardware qfp active feature erspan state
ERSPAN State:
  Status    : Active
  Complexes : 1
  CPPs      : 1
Capabilites:
  IP TOS       : 255
  Max sessions : 1032
  Max outputs  : 128
  IP TOS       : 0
  IP TTL       : 255
  COS          : 0
  Encaps type  : ERSPAN type-II / ERSPAN type-III
  GRE protocol : 0x88BE         / 0x22EB
  MTU          : 1464           / 1452
System Statistics:
  DROP src session replica  :                  0 /                  0
  DROP term session replica :                  0 /                  0
  DROP receive malformed    :                  0 /                  0
  DROP receive invalid ID   :                  0 /                  0
  DROP recycle queue full   :                  0 /                  0
  DROP no GPM memory        :                  0 /                  0
  DROP no channel memory    :                  0 /                  0
  DROP src session replica  :                  0 /                  0
  DROP src session replica  :                  0 /                  0
  DROP replica by ACL filter:                  0 /                  0
  DROP by NAM SPAN session  :                  0 /                  0
Client Debug Config:
  Enabled: Error, Warn
Data Path Debug Config:
  0x00000000

sh run:

cme-4321#sh run | begin monitor session                            
monitor session 100 type erspan-source
 source vlan 1
 header-type 3
 destination
  erspan-id 101
  mtu 1452
  ip address 192.168.113.54
  origin ip address 192.168.113.20

[goliver]

Oddly enough, if I write the config after showing it (while the other vty is still in config mode), it reverts it to a normal config.

I should have the latest version soon - I will test and report back.

[marce1000]

            - So it does show it then ?

 M.