Internal error when build huawei netconf ned

[dongwi]

Hi Team:

I want to build the huawei NE40 device 's netconf ned using pioneer (https://github.com/NSO-developer/pioneer), but  i got a problem.

firstly i use the fellow cmd to check dependency

devices device my-netconf-device pioneer yang check-dependencies

cmd return ok.

secondly build the netconf ned:

devices device my-netconf-device pioneer yang build-netconf-ned

return failed:

here is the log:

yanger -p yang:/root/nso-5.1/src/ncs/yang --no-deviation-apply -t ncs -f yang yang/huawei-aaa-action.yang --ncs-device-type netconf  --ncs-mount-id huawei-netconf-nc-1.0:huawei-netconf-nc-1.0  --ncs-skip-modules huawei-vrp-nc-1.0:huawei-netconf-metadata -o augmented/huawei-aaa-action.yang
Generating .fxs file "augmented/huawei-aaa@2018-06-11.fxs"
internal error
make: *** [ncsc-out/.done] Error 1
make: Leaving directory `/tmp/packages/huawei-netconf/src'
Build failed. Error and warning messages below. See log for complete details
yang/huawei-clocksync-gps.yang:64: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:73: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:82: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:91: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:98: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:105: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:112: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:119: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:126: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:133: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:140: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:147: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:156: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:165: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:64: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:73: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:82: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:91: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:98: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:105: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:112: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:119: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:126: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:133: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:140: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:147: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:156: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-clocksync-gps.yang:165: warning: the node is config, but refers to a non-config node 'gpsSfpOnline' defined at yang/huawei-clocksync-gps.yang:173
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-lpt.yang:308: warning: the node is config, but refers to a non-config node 'leafType' defined at yang/huawei-lpt.yang:242
yang/huawei-lpt.yang:337: warning: the node is config, but refers to a non-config node 'leafType' defined at yang/huawei-lpt.yang:242
yang/huawei-lpt.yang:308: warning: the node is config, but refers to a non-config node 'leafType' defined at yang/huawei-lpt.yang:242
yang/huawei-lpt.yang:337: warning: the node is config, but refers to a non-config node 'leafType' defined at yang/huawei-lpt.yang:242
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:5854: warning: the node is config, but refers to a non-config node 'portHardType' defined at yang/huawei-devm.yang:2927
yang/huawei-devm.yang:7100: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7106: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
yang/huawei-devm.yang:7115: warning: the node is config, but refers to a non-config node 'cmuAlmEn' defined at yang/huawei-devm.yang:7083
internal error
make: *** [ncsc-out/.done] Error 1
failure Build failed

can anybody guide me how to build the huawei netconf ned. 

Thx.

[dongwi]

[root@nso 3-real-device-juniper]# ncs --version
5.1.1
[root@nso 3-real-device-juniper]# python --version
Python 2.7.5

[rogaglia · Accepted solution]

Hi,

Could you please try with the latest NSO from the 5.2 major relesae?

I know some Huawei NE40 devices caused the following Internal errors fixed in the 5.2 release:

- toolchain: If a device model changed the type of a leaf to a leafref
with a deviation, the ncsc compiler would fail with "internal error".
This bug has been fixed.

(ENG-21598, RT:37582, PS-32659)

- toolchain: If a leafref target had a deviation "not-supported", the ncsc
compiler would fail with "internal error". This bug has been fixed.

(ENG-21497, RT:37598, PS-32675, CSCvp93772)

Regards,

Roque

[dongwi]

Hi, @rogaglia .

Thx FYI, and i try to build huawei ne40 netconf ned with nso 5.2

[root@nso current-nso]# ncs --version
5.2.0.3

and the netconf ned compiles success.

SYMLINK ../revisions/ietf-snmp/2014-12-10/ietf-snmp-tls.yang  /tmp/packages/huawei/src/ncsc-out/modules/yang/ietf-snmp-tls.yang 
COPY augmented/ietf-snmp-tsm.yang  /tmp/packages/huawei/src/ncsc-out/modules/revisions/ietf-snmp/2014-12-10/ietf-snmp-tsm.yang
COPY yang/ietf-snmp-tsm.yang  /tmp/packages/huawei/src/ncsc-out/modules/revisions/ietf-snmp/2014-12-10/ietf-snmp-tsm.yang.orig
SYMLINK ../revisions/ietf-snmp/2014-12-10/ietf-snmp-tsm.yang  /tmp/packages/huawei/src/ncsc-out/modules/yang/ietf-snmp-tsm.yang 
COPY augmented/ietf-snmp-usm.yang  /tmp/packages/huawei/src/ncsc-out/modules/revisions/ietf-snmp/2014-12-10/ietf-snmp-usm.yang
COPY yang/ietf-snmp-usm.yang  /tmp/packages/huawei/src/ncsc-out/modules/revisions/ietf-snmp/2014-12-10/ietf-snmp-usm.yang.orig
SYMLINK ../revisions/ietf-snmp/2014-12-10/ietf-snmp-usm.yang  /tmp/packages/huawei/src/ncsc-out/modules/yang/ietf-snmp-usm.yang 
COPY augmented/ietf-snmp-vacm.yang  /tmp/packages/huawei/src/ncsc-out/modules/revisions/ietf-snmp/2014-12-10/ietf-snmp-vacm.yang
COPY yang/ietf-snmp-vacm.yang  /tmp/packages/huawei/src/ncsc-out/modules/revisions/ietf-snmp/2014-12-10/ietf-snmp-vacm.yang.orig
SYMLINK ../revisions/ietf-snmp/2014-12-10/ietf-snmp-vacm.yang  /tmp/packages/huawei/src/ncsc-out/modules/yang/ietf-snmp-vacm.yang 
for f in `echo ../load-dir/*.fxs`; do \
   true; \
done
touch ncsc-out/.done
make: Leaving directory `/tmp/packages/huawei/src'
Build complete. Run install-netconf-ned, then run 'packages reload' to use the packagened-directory /tmp/packages/huawei

but when I reload the builded netconf ned, i got an another Error:

admin@ncs# packages reload 

>>> System upgrade is starting.
>>> Sessions in configure mode must exit to operational mode.
>>> No configuration changes can be performed until upgrade has completed.
>>> System upgrade has been cancelled.
Error: Duplicate prefix snmp used in '_huawei-nc-1.0:huawei-nc-1.0#http://www.huawei.com/netconf/vrp/huawei-snmp' and '_huawei-nc-1.0:huawei-nc-1.0#urn:ietf:params:xml:ns:yang:ietf-snmp'

In order to fix this problem, I disable the *snmp* and huawei-access* yang model, but this problem happens in same. here is the another Error:

admin@ncs# packages reload 

>>> System upgrade is starting.
>>> Sessions in configure mode must exit to operational mode.
>>> No configuration changes can be performed until upgrade has completed.
>>> System upgrade has been cancelled.
Error: Duplicate prefix 'system-devs-CH-NE-X3' used in '_huawei-nc-1.0:huawei-nc-1.0#http://www.huawei.com/netconf/vrp/huawei-system-deviations-CH-NE-X3' and '_huawei-nc-1.0:huawei-nc-1.0#urn:ietf:params:xml:ns:yang:ietf-system-deviations-CH-NE-X3'

please help me again.

Regards

[dongwi]

I get some more info in ncs.log

<ERR> 12-Sep-2019::09:48:31.277 nso ncs[21817]: - The dependency node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpOnline' for node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpPtpPriority1' in module 'tailf-ncs' does not exist
<ERR> 12-Sep-2019::09:48:31.277 nso ncs[21817]: - The dependency node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpOnline' for node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpPtpPriority1' in module 'tailf-ncs' does not exist
<ERR> 12-Sep-2019::09:48:31.277 nso ncs[21817]: - The dependency node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpOnline' for node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpPtpPriority1' in module 'tailf-ncs' does not exist
<ERR> 12-Sep-2019::09:48:31.278 nso ncs[21817]: - The dependency node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpOnline' for node '/ncs:devices/device/config/clocksync:clocksync/gps/gpsPortSrcs/gpsPortSrc/gpsSfpPtpPriority2' in module 'tailf-ncs' does not exist

It seems some dependency invalid error.

[rogaglia · Accepted solution]

Hi,

At least the issues are not in NSO now :-). The problem is that the compiler cannot detect these issues as they require some context.

Error: Duplicate prefix snmp used in '_huawei-nc-1.0:huawei-nc-1.0#http://www.huawei.com/netconf/vrp/huawei-snmp' and '_huawei-nc-1.0:huawei-nc-1.0#urn:ietf:params:xml:ns:yang:ietf-snmp'

This due to the fact that they use the same prefix for both modules. This of course, confusing for NSO. One way to fix it is to edit one of the modules and change the prefix statement.

Error: Duplicate prefix 'system-devs-CH-NE-X3' used in '_huawei-nc-1.0:huawei-nc-1.0#http://www.huawei.com/netconf/vrp/huawei-system-deviations-CH-NE-X3' and '_huawei-nc-1.0:huawei-nc-1.0#urn:ietf:params:xml:ns:yang:ietf-system-deviations-CH-NE-X3'

Same problem. Just open one of the two data models and change the prefix statement. Be careful if the prefix is used somewhere in the module that you need to modify it too. Then just re-compile the NED.

r.