NSO HCC - GoBGP Issue

yale.prince · ‎11-12-2021

Hi all,

I'm having an issue with hcc and GoBGP

Versions

OS ubuntu 20

nso 5.6.1

hcc ncs-5.6.1-tailf-hcc-project-5.0.2

gobgpd 2.25

when HCC is disable the package loads fine, when i enable the package and add the following configuration

root@ncs# packages reload force
reload-result {
package tailf-hcc
result true
}
root@ncs#
System message at 2021-11-12 09:35:12...
Subsystem started: tailf_hcc_server
root@ncs#

root@ncs# show packages package tailf-hcc
packages package tailf-hcc
package-version 5.0.2
description "Package for Tail-f HA Cluster Control Interface"
ncs-min-version [ 5.4 ]
directory /var/opt/ncs/state/packages-in-use/1/tailf-hcc
oper-status up

Ha config

high-availability token cisco1234
high-availability ha-node nso5a address 10.20.1.2 nominal-role master
!
high-availability ha-node nso5b address 10.30.1.2 nominal-role slave
failover-master true
!
high-availability settings enable-failover true
high-availability settings reconnect-slaves true
high-availability settings start-up assume-nominal-role true
high-availability settings start-up join-ha true

HCC Config

hcc enabled

hcc vip-address [ 10.10.1.1 ]
hcc bgp node nso5a gobgp-bin-dir /usr/bin/gobgpd as 65020 router-id 10.20.1.2 enabled
neighbor 10.20.1.1 as 65000
password cisco1234 enabled
!
hcc bgp node nso5b gobgp-bin-dir /usr/bin/gobgpd as 65030 router-id 10.30.1.2 enabled
neighbor 10.30.1.1 as 65000
password cisco1234 enabled

Result

System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem stopped: tailf_hcc_server
root@ncs(config)#
System message at 2021-11-12 09:35:55...
Subsystem started: tailf_hcc_server

nso@ncs# show hcc

Error: application communication failure

nso@ncs#

nso@ncs# show hcc

Error: application communication failure

nso@ncs# show packages

packages package tailf-hcc

package-version 5.0.2

description "Package for Tail-f HA Cluster Control Interface"

ncs-min-version [ 5.4 ]

directory /var/opt/ncs/state/packages-in-use/1/tailf-hcc

oper-status program-code-error

oper-status error-info [ "tailf_hcc: /var/opt/ncs/state/packages-in-use/1/tailf-hcc/erlang-lib/tailf_hcc/ebin/tailf_hcc.app: failed to start" ]

nso@ncs#

Systemctl output

root@nso-5a-20:~# systemctl status ncs

● ncs.service - LSB: NCS

Loaded: loaded (/etc/init.d/ncs; generated)

Active: active (running) since Thu 2021-11-11 16:08:34 UTC; 20min ago

Docs: man:systemd-sysv-generator(8)

Process: 158339 ExecStart=/etc/init.d/ncs start (code=exited, status=0/SUCCESS)

Tasks: 102 (limit: 4617)

Memory: 320.5M

CGroup: /system.slice/ncs.service

├─158346 /opt/ncs/current/lib/ncs/erts/bin/ncs.smp -K true -- -root /opt/ncs/current/lib/ncs -progname ncs -- -home / -- -cd /var/opt/ncs -pa /opt/ncs/current/lib/ncs/patches -boot ncs -ncs true -delayed-detach -noshell -noinput -yaws embedded true -kernel gethost_poolsize 2 -stacktrace_depth 24 -shutdown_time 30000 -delayed-heart -conffile /etc/ncs/ncs.conf -max_fds 1024 -- -detached-fd 4

├─158350 erl_child_setup 1024

├─158374 /opt/ncs/current/lib/ncs/lib/core/ncs/priv/snmp-config-transform -S -c -s -P 4569

├─158375 java -classpath :/opt/ncs/current/java/jar/* -Dhost=127.0.0.1 -Dport=4569 -Djvm.restart.enabled=false -Djvm.restart.errCount=3 -Djvm.restart.duration=60 -Djava.security.egd=file:/dev/./urandom -Dfile.encoding=UTF-8 -Dorg.apache.logging.log4j.simplelog.StatusLogger.level=OFF com.tailf.ncs.NcsJVMLauncher

├─158448 /opt/ncs/current/lib/ncs/lib/core/sls/priv/agentwrapper java -Xmx64M -Xms16M -Djava.security.egd=file:/dev/./urandom -jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/webapp-runner.jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/smartagent --port 0 --path /smartagent --shutdown-override

└─158449 java -Xmx64M -Xms16M -Djava.security.egd=file:/dev/./urandom -jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/webapp-runner.jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/smartagent --port 0 --path /smartagent --shutdown-override

Nov 11 16:10:55 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:10:56 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:11:01 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:11:06 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:11:07 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:11:10 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:11:12 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server died

Nov 11 16:12:04 nso-5a-20 ncs[158346]: - Daemon tailf_hcc_server timed out

root@nso-5a-20:~# systemctl status gobgpd

● gobgpd.service - GoBGP Routing Daemon

Loaded: loaded (/lib/systemd/system/gobgpd.service; enabled; vendor preset: enabled)

Active: inactive (dead)

Condition: start condition failed at Mon 2021-11-08 14:02:25 UTC; 3 days ago

Docs: file:/usr/share/doc/gobgpd/getting-started.md

root@nso-5a-20:/home/nso# ps -ef | grep ncs

root 158346 1 2 16:08 ? 00:00:23 /opt/ncs/current/lib/ncs/erts/bin/ncs.smp -K true -- -root /opt/ncs/current/lib/ncs -progname ncs -- -home / -- -cd /var/opt/ncs -pa /opt/ncs/current/lib/ncs/patches -boot ncs -ncs true -delayed-detach -noshell -noinput -yaws embedded true -kernel gethost_poolsize 2 -stacktrace_depth 24 -shutdown_time 30000 -delayed-heart -conffile /etc/ncs/ncs.conf -max_fds 1024 -- -detached-fd 4

root 158374 158350 0 16:08 ? 00:00:00 /opt/ncs/current/lib/ncs/lib/core/ncs/priv/snmp-config-transform -S -c -s -P 4569

root 158375 158350 0 16:08 ? 00:00:03 java -classpath :/opt/ncs/current/java/jar/* -Dhost=127.0.0.1 -Dport=4569 -Djvm.restart.enabled=false -Djvm.restart.errCount=3 -Djvm.restart.duration=60 -Djava.security.egd=file:/dev/./urandom -Dfile.encoding=UTF-8 -Dorg.apache.logging.log4j.simplelog.StatusLogger.level=OFF com.tailf.ncs.NcsJVMLauncher

root 158448 158350 0 16:08 ? 00:00:00 /opt/ncs/current/lib/ncs/lib/core/sls/priv/agentwrapper java -Xmx64M -Xms16M -Djava.security.egd=file:/dev/./urandom -jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/webapp-runner.jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/smartagent --port 0 --path /smartagent --shutdown-override

root 158449 158448 7 16:08 ? 00:01:06 java -Xmx64M -Xms16M -Djava.security.egd=file:/dev/./urandom -jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/webapp-runner.jar /opt/ncs/current/lib/ncs/lib/core/sls/priv/smartagent --port 0 --path /smartagent --shutdown-override

root 168163 158185 0 16:23 pts/2 00:00:00 grep --color=auto ncs

root@nso-5a-20:/home/nso#

root@nso-5a-20:/home/nso# ps -ef | grep gobgp

root 168192 158185 0 16:24 pts/2 00:00:00 grep --color=auto gobgp

root@nso-5a-20:/home/nso#

any one have any suggestions ?

Thanks

Regards

Yale

P.S I have read tailf_hcc.pdf cover to cover

yale.prince · ‎11-12-2021

I have 2 users nso and root, both are in the ncsadmin and ncsoper groups

i have tried applying hcc config with with both uses neither are able to start the HCC/gobgp correctly

i have tried editing visudo and adding the following

nso ALL = NOPASSWD: /var/opt/ncs/state/packages-in-use/1/tailf-hcc/priv/vipctl

I have also tried setuid on the gobgp gobgpd binary files

neither affects the results

caramir2 · ‎06-02-2022

Hi

You resolved this issue?