topic Python VM not starting from Darwin NCS install on M1 Macbook in NSO Developer Hub Discussions

Python VM not starting from Darwin NCS install on M1 Macbook

samuel.coome@secunetics.com — Thu, 07 Jul 2022 20:26:40 GMT

The NSO Darwin install of NSO for my M1 Macbook works fine for ncs and java, however the python vm fails to load. Looking in the ncs-python-vm.log, it states that the mach-o file is of type x86_64.

ImportError: dlopen(/Users/sam/Documents/ncs/install-5.5.2.12/src/ncs/pyapi/_ncs/_ncs_py3.abi3.so, 0x0002): tried: '/Users/sam/Documents/ncs/install-5.3.5.1/src/ncs/pyapi/_ncs/_ncs_py3.abi3.so' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e'))

I tried going into the src/ncs/pyapi/ directory to try to remake the files, however the make of the pyapi fails with the following error.

~/Documents/ncs/install-5.5.2.12/src/ncs/pyapi
❯ make confd-py3
make: *** No rule to make target `_confd/_confd.c', needed by `_confd/_confd_py3.abi3.so'.  Stop.

~/Documents/ncs/install-5.5.2.12/src/ncs/pyapi
❯ make ncs-py3
make: *** No rule to make target `../ncs/dm/tailf-ncs.yang', needed by `tmp_fxs/tailf-ncs.fxs'.  Stop.

Which I'm guessing is because I don't have a local install of the ConfD library.

Requirements
============

The build requires gcc and GNU make and the development libraries
for Python 3.5 or greater.

It's also necessary to have access to a built libconfd library.

When I go to the tailf site, ConfD basic installs are no longer available (currently).

https://developer.cisco.com/site/confD/downloads/

Re: Python VM not starting from Darwin NCS install on M1 Macbook

Alexander Stevenson — Fri, 22 Jul 2022 21:14:00 GMT

Hi samuel.coome@secunetics.com,

Yes, the download page has downloads temporarily disabled. Did you email confdbasicinfo@cisco.com and ask for help? I looked around the Cisco mailing lists and that is the best place to ask directly.

Best,

Alex S.

Re: Python VM not starting from Darwin NCS install on M1 Macbook

EugenSerban — Wed, 02 Nov 2022 13:19:38 GMT

Hello,

I'm having the same issue:

From logs/ncs-python-vm.log I can see:

<INFO> 2-Nov-2022::14:07:03.970 MAC ncs[30773]: l2vpn :: Starting python3 -u /Users/user/nso-5.8/src/ncs/pyapi/ncs_pyvm/startup.py -l info -f ./logs/ncs-python-vm -i l2vpn Traceback (most recent call last): File "/Users/user/nso-5.8/src/ncs/pyapi/ncs_pyvm/startup.py", line 6, in <module> import ncsctlsock File "/Users/user/nso-5.8/src/ncs/pyapi/ncs_pyvm/ncsctlsock.py", line 5, in <module> import _ncs File "/Users/user/nso-5.8/src/ncs/pyapi/_ncs/__init__.py", line 12, in <module> from ._ncs_py3 import cdb

I installed confd and compiled it. I then tried to compile ncs, but I get this error:

❰user❙~/n/s/n/pyapi❱✘≻ make ncs-py3 PROD=NCS /Library/Developer/CommandLineTools/usr/bin/make src/gen_add_lib_const.c # Clean all Python 3 so files, including possible leftovers. Possibly built # with a previous Python 3 version, which might make them differ in naming. Building NCS Python 3.x bindings running build_ext building '_ncs._ncs_py3' extension clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -DCONFD_PY_PRODUCT_NCS=1 -DCONFD_C_PRODUCT_NCS=1 -D_TM=\"_ncs\" -UNDEBUG -I/Users/user/confd/include -Iinclude -I/opt/homebrew/opt/python@3.10/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c _ncs/_ncs.c -o build/_ncs/_ncs_py3.abi3.so/_ncs/_ncs.o -std=c99 clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -DCONFD_PY_PRODUCT_NCS=1 -DCONFD_C_PRODUCT_NCS=1 -D_TM=\"_ncs\" -UNDEBUG -I/Users/user/confd/include -Iinclude -I/opt/homebrew/opt/python@3.10/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c src/_cdb.c -o build/_ncs/_ncs_py3.abi3.so/src/_cdb.o -std=c99 clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -DCONFD_PY_PRODUCT_NCS=1 -DCONFD_C_PRODUCT_NCS=1 -D_TM=\"_ncs\" -UNDEBUG -I/Users/user/confd/include -Iinclude -I/opt/homebrew/opt/python@3.10/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c src/_dp.c -o build/_ncs/_ncs_py3.abi3.so/src/_dp.o -std=c99 src/_dp.c:6200:26: error: use of undeclared identifier 'CONFD_ERRTYPE_NCS' if (errinfo->type == CONFD_ERRTYPE_NCS) { ^ 1 error generated. error: command '/usr/bin/clang' failed with exit code 1 make: *** [_ncs/_ncs_py3.abi3.so] Error 1 ❰user❙~/n/s/n/pyapi❱✘≻

Is this a known issue?

Re: Python VM not starting from Darwin NCS install on M1 Macbook

cohult — Thu, 19 Oct 2023 15:23:06 GMT

Update: NSO for Darwin ARM64 is supported for NSO 6.1.1 and later releases, recommended for Apple Silicon M1, M2, etc.

When using the NSO for Darwin x86_64 version, make sure you use the Python version that comes with MacOS on M1. That works. No recompiling is necessary. I.e. use the following settings:

$ arch -x86_64 bash -l $ bash --version GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin21) Copyright (C) 2007 Free Software Foundation, Inc. $ arch i386 $ which python3 /usr/bin/python3 $ python3 --version Python 3.9.6 $ java -version openjdk version "1.8.0_292" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_292-b10) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.292-b10, mixed mode)

Re: Python VM not starting from Darwin NCS install on M1 Macbook

EugenSerban — Thu, 03 Nov 2022 10:30:56 GMT

That did the trick! Thanks!

Can you maybe update the documentation to cover this? It would help other avoid the traditional google-fu.

Re: Python VM not starting from Darwin NCS install on M1 Macbook

cohult — Thu, 03 Nov 2022 13:00:40 GMT

Agree those steps could be added to the installation guide. Generic M1 Mac Rosetta 2 dependant commands however that may be different tomorrow. And the need for them will be obsoleted when NSO for Darwin ARM64 is supported (not only x86_64) in the not-so-distant future.

Re: Python VM not starting from Darwin NCS install on M1 Macbook

cohult — Thu, 19 Oct 2023 15:17:56 GMT

Update: NSO for Darwin ARM64 is supported for NSO 6.1.1 and later releases, recommended for Apple Silicon M1, M2, etc.