ASR9001 IOS-XR 6.7.3 Netconf crashes
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-28-2021 02:03 PM
I have a new set of ASR9001's running freshly turboboost 6.7.3. I am having issues connecting via netconf ssh and noticed the netconf daemon seems to be constantly crashing. I can't find much on this and will open a TAC case soon. Just curious if anyone had any problem with this before.
The logs show:
RP/0/RSP0/CPU0:Mar 28 20:43:27.237 UTC: dumper[60]: %OS-DUMPER-6-REMOVE_OLDEST : Removing dump dumper_harddisk:/dumper/netconf_1156.abort.20210328-170656.node0_RSP0_CPU0.ppc.Z as we can have only limited number of cores in fallback path
RP/0/RSP0/CPU0:Mar 28 20:43:27.349 UTC: dumper[60]: %OS-DUMPER-6-FALLBACK_CHOICE : Fall back choice: 4(dumper_harddisk:/dumper) in use
RP/0/RSP0/CPU0:Mar 28 20:43:27.372 UTC: dumper[60]: %OS-DUMPER-5-CORE_FILE_NAME : Core for process pkg/bin/netconf at harddisk:/dumper/netconf_1156.abort.20210328-204327.node0_RSP0_CPU0.ppc.Z on local_node
RP/0/RSP0/CPU0:Mar 28 20:44:44.349 UTC: dumper[60]: %OS-DUMPER-7-XFER_CORE : Tranferring core to configured location
RP/0/RSP0/CPU0:Mar 28 20:44:44.350 UTC: dumper[60]: %OS-DUMPER-7-SIGNAL_OS : All files copied. Now signalling the OS (line 4072)
RP/0/RSP0/CPU0:Mar 28 20:44:44.350 UTC: dumper[60]: %OS-DUMPER-5-DUMP_SUCCESS : Core dump success
RP/0/RSP0/CPU0:Mar 28 20:44:44.351 UTC: syslog_dev[95]: netconf[1156]:
RP/0/RSP0/CPU0:Mar 28 20:44:44.496 UTC: sysmgr[97]: %OS-SYSMGR-3-ERROR : netconf(1) (jid 1156) exited, will be respawned with a delay (slow-restart)
RP/0/RSP0/CPU0:Mar 28 20:44:44.496 UTC: sysmgr[97]: netconf(1) (jid 1156) (pid 13750547) (fail_count 15) abnormally terminated, restart scheduled
RP/0/RSP0/CPU0:Mar 28 20:44:44.497 UTC: sysmgr[97]: %OS-SYSMGR-3-ERROR : netconf(1156) (fail count 15) will be respawned in 120 seconds
RP/0/RSP0/CPU0:Mar 28 20:44:44.498 UTC: sysmgr[97]: %OS-SYSMGR-7-DEBUG : netconf(1) (jid 1156) did not signal end of initialization
RP/0/RSP0/CPU0:Mar 28 20:44:55.087 UTC: dumper[60]: %OS-DUMPER-6-CORE_MD5 : harddisk:/dumper/netconf_1156.abort.20210328-204327.node0_RSP0_CPU0.ppc.Z has just been written
Any help would be appreciated. Thanks.
- Labels:
-
XR OS and Platforms
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-28-2021 06:41 PM
SSH/Netconf configuration is as follows:
RP/0/RSP0/CPU0:ATL-01-RT-01#show run | inc netconf
netconf-yang agent
ssh
netconf agent tty
ssh server netconf vrf default
RP/0/RSP0/CPU0:ATL-01-RT-01#sh run | inc ssh
ssh server logging
ssh timeout 120
ssh server v2
ssh server vrf default
ssh server netconf vrf default
and AAA setup below:
aaa accounting exec default start-stop group ClearPass
aaa accounting system default start-stop group ClearPass
aaa accounting commands default start-stop group ClearPass
aaa group server tacacs+ ClearPass
server-private X.X.X.X port 49
key 7 XXX
single-connection
!
!
aaa authorization commands default group ClearPass none
aaa authentication login default group ClearPass local
line console
authorization commands default
login authentication default
!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-12-2021 10:23 PM
Symptom:
Netconf keeps restarting on ASR9K-PX (PPC Architecture) Platform
Conditions:
Configuring "netconf yang agent ssh" on a ASR9K-PX (PPC Architecture) doesn't spawn the netconf process, instead it just keeps restarting.
Workaround:
Upgrade to newer architectures like intel based ASR9K (or) eXR based platforms.
Further Problem Description:
Problem:
Netconf keeps restarting on ASR9K-PX Platform
Reason:
ASR9K-PX is an older hardware based on PPC architecture which has memory constraints. The manageability infrastructure consists of code for handling open config models which are memory heavy and ever increasing. These lead to the netconf crash.
The best solution would be to upgrade to newer architectures like intel based ASR9K (or) eXR based platforms.
ASR9K RP with PowerPC processor has long been EOL:
https://www.cisco.com/c/en/us/products/collateral/routers/asr-9000-series-aggregation-services-routers/eos-eol-notice-c51-734029.html
https://www.cisco.com/c/en/us/products/collateral/routers/asr-9000-series-aggregation-services-routers/eos-eol-notice-c51-737819.pdf
According to the above info, the last supported XR version is 5.3.3.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-07-2021 04:04 PM
hi @infinitycco did you end up getting a response from TAC?
I've found disabling netconf seems to resolve the issue on 6.7.3 EMR.
I don't see the same problem on 6.5.3 EMR.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-09-2021 11:57 AM
there is a known limitation on the asr9001
https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvt20600/?rfs=iqvred
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-09-2021 03:36 PM
Thanks @tkarnani for re-linking - the extra note now in CSCvt20600 "6.6.3 is last release supporting netconf on ASR9001" is helpful vs the earlier 06-12-2021 text.
