topic Re: Help needed debugging API compilation errors from ydk-gen in Tools

topic Re: Help needed debugging API compilation errors from ydk-gen in Tools https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486430#M2865 <HTML><HEAD></HEAD><BODY><P>Hi Steve,</P><P></P><P></P><P></P><P>The error indicates libxslt could be missing. Can you make sure you have installed all the system dependencies as documented here < https://github.com/CiscoDevNet/ydk-py#macos >?</P></BODY></HTML> Fri, 20 Oct 2017 16:37:50 GMT abhirame 2017-10-20T16:37:50Z Help needed debugging API compilation errors from ydk-gen https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486425#M2860 <HTML><HEAD></HEAD><BODY><P style="font-size: 13.3333px;">Hi all,</P><P style="font-size: 13.3333px;"></P><P style="font-size: 13.3333px;">After many trials and tribulations I finally managed to install YDK on my Mac, but I haven't yet been able to successfully generate an API with ydk-gen. Depending on the bundle file I use, and which bits I take out of it, I will get different error outputs, but the ultimate outcome is the same in each case. My latest attempt was to work with the bundle from CiscoDevNet on github (<A href="https://raw.githubusercontent.com/CiscoDevNet/ydk-gen/master/profiles/bundles/cisco-ios-xe_16_5_1.json" title="https://raw.githubusercontent.com/CiscoDevNet/ydk-gen/master/profiles/bundles/cisco-ios-xe_16_5_1.json">https://raw.githubusercontent.com/CiscoDevNet/ydk-gen/master/profiles/bundles/cisco-ios-xe_16_5_1.json</A>) using this command:</P><P></P><P style="font-size: 13.3333px;"><SPAN style="font-size: 10pt;">sudo ~/ydk-gen/generate.py --python --bundle ios-xe_16_5_1.json -v</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><BR /></SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1">Firstly, I get this error, which I think I can ignore because compilations seems to proceed OK (for info, the variable is set anyway):</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><BR /></SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1">YDKGEN_HOME not set. Assuming current directory is working directory.</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><BR /></SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN style="font-size: 10pt;">Information - this is the variable declaration: declare -x YDKGEN_HOME="/Users/stevesmith/ydk-gen/"</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><BR /></SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1">So the output from the command continues with a bunch of warnings (mainly about double quotes being unsafe), so all looks promising until it gets to this point:</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><BR /></SPAN></P><P></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1">Traceback (most recent call last):</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/generate.py", line 369, in <module></SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>options.one_class_per_module).generate(options.bundle))</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/__init__.py", line 91, in generate</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>return self._generate_bundle(description_file)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/__init__.py", line 117, in _generate_bundle</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>packages = self._get_packages(curr_bundle.resolved_models_dir)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/__init__.py", line 163, in _get_packages</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>packages = ApiModelBuilder(self.iskeyword, self.language).generate(modules)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 70, in generate</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(package)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 147, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>self._resolve_expanded_cross_references(owned_element)</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/builder/_api_model_builder.py", line 131, in _resolve_expanded_cross_references</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><SPAN class="Apple-converted-space">    </SPAN>if not hasattr(identity_ref_type.i_type_spec.base.i_identity, 'i_class'):</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1">AttributeError: 'NoneType' object has no attribute 'i_identity'</SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1"><BR /></SPAN></P><P class="p1" style="font-size: 13.3333px;"><SPAN class="s1">I have no idea where to start to debug this. As with all of the other errors that get thrown when I attempt an API build using various forms of bundle file, the error messages don't offer much in the way of helpful hints, so I presume only a developer would be able to get to the bottom of them. </SPAN></P><P class="p1" style="font-size: 13.3333px;"></P><P class="p1" style="font-size: 13.3333px;">A bit more background. The only successful compilation I've managed so far is using a simplified bundle file, with ned.yang explicitly removed from the commits list. I assume an issue with ned, but I haven't found a workaround.</P><P class="p1" style="font-size: 13.3333px;"></P><P class="p1" style="font-size: 13.3333px;">Would appreciate any clues on how to move forward!</P><P class="p1" style="font-size: 13.3333px;"></P><P class="p1" style="font-size: 13.3333px;">Steve</P></BODY></HTML> Mon, 16 Oct 2017 01:40:39 GMT https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486425#M2860 stevesmith31 2017-10-16T01:40:39Z Re: Help needed debugging API compilation errors from ydk-gen https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486426#M2861 <HTML><HEAD></HEAD><BODY><P>Hi Steve,</P><P></P><P></P><P></P><P>Sorry you are facing this issue.</P><P></P><P></P><P></P><P>If you’d like to use a pre-generated bundle for XR, you can try using the package already released on PyPi: https://pypi.python.org/pypi/ydk-models-cisco-ios-xe. ‘pip install ydk-models-cisco-ios-xe’ will install all the packages you need. This way you won’t need to use ydk-gen to generate a bundle.</P><P></P><P></P><P></P><P>To fix the issue with ydk-gen you are seeing, it appears you have pyang 1.7 installed. ‘pip list|grep pyang’ will tell you the version. However, ydk-gen requires pyang to be exactly 1.6 as specified in requirements.txt (https://github.com/CiscoDevNet/ydk-gen/blob/master/requirements.txt). So if you try the below, this issue should be fixed:</P><P></P><P></P><P></P><P>pip uninstall pyang –y</P><P></P><P>pip install pyang==1.6</P></BODY></HTML> Mon, 16 Oct 2017 23:20:25 GMT https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486426#M2861 abhirame 2017-10-16T23:20:25Z Re: Help needed debugging API compilation errors from ydk-gen https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486427#M2862 <HTML><HEAD></HEAD><BODY><P>Hi abhirame,</P><P></P><P>Thanks for taking the time to look into this. I greatly appreciate your contribution. On the use of the pre-generated bundle, I actually already have that installed, but I am just trying to work through the steps in the tutorial at networkop.co.uk/blog/2017/02/22/odl-ydk and the step I'm up to is to run ydk-gen to build an API. So I try and do as I'm told:-)</P><P></P><P>I did find that pyang 1.7 was installed as you suspected (how did you know that by the way?), so I uninstalled it and tried the install of 1.6, but I was told that requirements was already satisfied (pyang==1.6 in /Library/Python/2.7/site-packages). pip list also confirms pyang (1.6), yet when I run ydk-gen , now I am seeing "no module named yang". Google search for this error didn't reveal much that seemed relevant. Sorry to have to ask again, but can you provide any clues on how to fix this? Or maybe I can skip this step in the tutorial altogether using the pre-generated bundle, but if I try to jump to the next step (from ydk.models.cisco_ios_xe.ned import Native) I get  "import error: no module named ned", which I assume is an artefact of my inability to generate the API. But I could be on the wrong track altogether I guess...</P><P></P><P>Once again, thanks. Hope you can assist further.</P><P></P><P>Steve</P></BODY></HTML> Wed, 18 Oct 2017 01:10:06 GMT https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486427#M2862 stevesmith31 2017-10-18T01:10:06Z Re: Help needed debugging API compilation errors from ydk-gen https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486428#M2863 <HTML><HEAD></HEAD><BODY><P>Hi Steve,</P><P></P><P></P><P></P><P>No problem. I had seen the same error you are seeing previously, so I guessed you may have the pyang 1.7 installed. ☺</P><P></P><P></P><P>It would help if you could post the full command line output of these errors.</P><P></P><P></P><P>For the first error, I’m guessing the reason could be there could some issue with the paths to the yang models defined in your .json profile file.</P><P></P><P></P><P>For the second error, with the latest cisco-ios-xe bundle (16.6.1) the name of the python module has actually changed because the <A href="https://github.com/YangModels/yang/tree/master/vendor/cisco/xe/1661">corresponding yang model</A><SPAN>s have changed. The documentation for this is here: </SPAN><A class="jive-link-external-small" href="http://ydk.cisco.com/py/docs/gen_doc_2d1e68f0c4b51b62e2aa90c4760e6900f62a66af.html" rel="nofollow" target="_blank">http://ydk.cisco.com/py/docs/gen_doc_2d1e68f0c4b51b62e2aa90c4760e6900f62a66af.html</A><SPAN>.</SPAN></P><P></P><P></P><P>So, you’d need to change the import path to:</P><P></P><P></P><PRE __default_attr="python" __jive_macro_name="code" class="jive_text_macro _jivemacro_uid_15083446104062749 jive_macro_code" jivemacro_uid="_15083446104062749"> <P>from ydk.models.cisco_ios_xe.Cisco_IOS_XE_native import Native</P> </PRE></BODY></HTML> Wed, 18 Oct 2017 16:33:48 GMT https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486428#M2863 abhirame 2017-10-18T16:33:48Z Re: Help needed debugging API compilation errors from ydk-gen https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486429#M2864 <HTML><HEAD></HEAD><BODY><P class="p1"><SPAN class="s1">Hi abhirame,<BR /> </SPAN></P><P class="p2"><SPAN class="s2">Once again thanks for your tips. In the case of the pyang error, I finally figured out that "pip install pyang==1.6" had created the pyang and pyang-1.6.dist-info directories under </SPAN><SPAN class="s3">/private/var/root/Library/Python/2.7/lib/python/site-packages. So I copied these directories to /Library/Python/2.7/site-packages. This fixed the missing dependency issue and I have since been able to compile the API based on the bundle json file.</SPAN></P><P class="p3"><SPAN class="s3"></SPAN></P><P class="p2"><SPAN class="s3">FYI, the original import error output was:</SPAN></P><P class="p3"><SPAN class="s3"></SPAN></P><P class="p4"><SPAN class="s3">steves-MacBook-Air:ydk-gen stevesmith$ sudo ~/ydk-gen/generate.py --python --bundle ios-xe-16-5-bundle.json -v</SPAN></P><P class="p4"><SPAN class="s3">Traceback (most recent call last):</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/generate.py", line 33, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>from ydkgen import YdkGenerator</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/__init__.py", line 31, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>from .common import YdkGenException, iscppkeyword, ispythonkeyword</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "/Users/stevesmith/ydk-gen/ydkgen/common.py", line 21, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>from pyang import types as ptypes</SPAN></P><P class="p4"><SPAN class="s3">ImportError: No module named pyang</SPAN></P><P class="p5"><SPAN class="s3"></SPAN></P><P class="p6"><SPAN class="s1">So overcoming this problem allows me to move on to the Configuring BGP step in the tutorial, but of course just as you think you’ve cleared the final hurdle you find you’ve landed in a blackberry bush surrounded by an electric fence on the other side. So I move on to solving the next issue:<SPAN class="Apple-converted-space"> </SPAN></SPAN></P><P class="p7"><SPAN class="s1"></SPAN></P><P class="p4"><SPAN class="s3">>>> from ydk.models.cisco_ios_xe.Cisco_IOS_XE_native import Native</SPAN></P><P class="p4"><SPAN class="s3">Traceback (most recent call last):</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "<stdin>", line 1, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "/Library/Python/2.7/site-packages/ydk/models/cisco_ios_xe/Cisco_IOS_XE_native.py", line 8, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>from ydk.types import Entity, EntityPath, Identity, Enum, YType, YLeaf, YLeafList, YList, LeafDataList, Bits, Empty, Decimal64</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "/Library/Python/2.7/site-packages/ydk/types/__init__.py", line 17, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>from .py_types import Entity, YList, YLeafList</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "/Library/Python/2.7/site-packages/ydk/types/py_types.py", line 24, in <module></SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>from ydk_ import is_set</SPAN></P><P class="p4"><SPAN class="s3">ImportError: dlopen(/Library/Python/2.7/site-packages/ydk_.so, 2): Library not loaded: /usr/local/opt/libxslt/lib/libxslt.1.dylib</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>Referenced from: /Library/Python/2.7/site-packages/ydk_.so</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>Reason: image not found</SPAN></P><P class="p4"><SPAN class="s3">>>> import /usr/local/opt/libxslt/lib/libxslt.1.dylib</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">  </SPAN>File "<stdin>", line 1</SPAN></P><P class="p4"><SPAN class="s3"><SPAN class="Apple-converted-space">    </SPAN>import /usr/local/opt/libxslt/lib/libxslt.1.dylib</SPAN></P><P class="p5"><SPAN class="s3"></SPAN></P><P class="p4"><SPAN class="s3">I’ll beaver away on this one for a while, but if you have any clues, feel free to share!</SPAN></P><P class="p5"><SPAN class="s3"></SPAN></P><P class="p4"><SPAN class="s3">Steve</SPAN><SPAN class="s2"> </SPAN></P></BODY></HTML> Fri, 20 Oct 2017 00:00:16 GMT https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486429#M2864 stevesmith31 2017-10-20T00:00:16Z Re: Help needed debugging API compilation errors from ydk-gen https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486430#M2865 <HTML><HEAD></HEAD><BODY><P>Hi Steve,</P><P></P><P></P><P></P><P>The error indicates libxslt could be missing. Can you make sure you have installed all the system dependencies as documented here < https://github.com/CiscoDevNet/ydk-py#macos >?</P></BODY></HTML> Fri, 20 Oct 2017 16:37:50 GMT https://community.cisco.com/t5/tools/help-needed-debugging-api-compilation-errors-from-ydk-gen/m-p/3486430#M2865 abhirame 2017-10-20T16:37:50Z