Solved: Re: IWAN APIC-EM hub deployment fail

brian.hooper · ‎12-14-2016

While attempting to deploy the Hub site in APIC, the deployment failed while trying to create the prefix lists. I checked the audit logs, and I see that prefix list creation requested with a number of over 1700 prefixes. I assume it's picking this info up out of the routing table, and that route summarization in the network sucks. However, is there a limit to what the APIC can do? There are over 150 sites with tons of vlans, and being an old network in production for a long while, it may not be in the best shape.

Just looking for some guidance on how to get by this issue.

THanks in in a big way...

cchitnis · ‎12-19-2016

Josey,

The workaround would be to summarize DC prefixes and routes as much as possible. I replied to Brian on community thread to check if that’s possible to do on customer side. Currently, there’re about 1700 prefixes.

Thanks & regards,

Chakrapani

Chakrapani Chitnis

ENGINEER.SOFTWARE ENGINEERING

CSG PI Services AppX - US

cchitnis@cisco.com<mailto:cchitnis@cisco.com>

WebEx Social profile<http://iwe.cisco.com/web/cchitnis>

Phone: +1 408 525 2341

www.cisco.com<http://www.cisco.com/>

<https://www.facebook.com/cchitnis> <https://plus.google.com/u/0/+ChakrapaniChitnis/posts> <https://www.linkedin.com/pub/chakrapani-chitnis/4/612/3b?domainCountryName=&csrfToken=ajax%3A1899398277677078071> <https://twitter.com/c_chitnis>

Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.

Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.

View solution in original post

brian.hooper · ‎12-19-2016

This issue is ongoing - can't complete the HUB deployment, hard deadline approaching tomorrow....lol

Opened a TAC case, pending....versin 1.3.1.9 - tac case with Nick Goldwater (apparently the only TAC engineer supporting APIC-EM) 681467767

If I receive a solution, I'll put it up here...

cchitnis · ‎12-19-2016

Hi Brian, engineers cooied on this email will look at it with top priority.

Amit, Ravi, if you get a chance to look at thia before I reach office, that'd be great. We will sync up once I am in.

Sent from my iPhone

brian.hooper · ‎12-19-2016

That is fantastic! Thank you for the support.

cchitnis · ‎12-19-2016

com.cisco.xmp.model.framework.exceptions.ResourcePersistenceContextConstraintException: Size contraint Violated, Unit of Work Size :1000

at com.cisco.xmp.model.framework.utils.ResourceAccessExceptionCreator.resourcePersistenceContextConstraintException(ResourceAccessExceptionCreator.java:60) ~[resource-access-xmp-impl-4.1.1.9.jar:4.1.1.9]

at com.cisco.xmp.model.framework.impl.XMPResourceAccessProviderImpl.validateContextConstraints(XMPResourceAccessProviderImpl.java:75) ~[resource-access-xmp-impl-4.1.1.9.jar:4.1.1.9]

Brian, from your case description it appears you tried creating about 1700 prefixes and that’s resulting into oversized snapshot which we are not able to store in the database. Is there way for you to actually summarize these prefixes to get them to a sizeable number?

cchitnis · ‎12-19-2016

+Madhavan K

Ravi, Shiyao,

Thanks a lot for looking into it. Appears to be a problem with snapshot creation because we have just too many DC prefixes getting created. Madhavan, from the exception below, can you confirm that there’s a limitation on size of snapshot we are trying to create and persist in the DB?

com.cisco.xmp.model.framework.exceptions.ResourcePersistenceContextConstraintException: Size contraint Violated, Unit of Work Size :1000

at com.cisco.xmp.model.framework.utils.ResourceAccessExceptionCreator.resourcePersistenceContextConstraintException(ResourceAccessExceptionCreator.java:60) ~[resource-access-xmp-impl-4.1.1.9.jar:4.1.1.9]

at com.cisco.xmp.model.framework.impl.XMPResourceAccessProviderImpl.validateContextConstraints(XMPResourceAccessProviderImpl.java:75) ~[resource-access-xmp-impl-4.1.1.9.jar:4.1.1.9]

Brian, from your case description it appears you tried creating about 1700 prefixes and that’s resulting into oversized snapshot which we are not able to store in the database. Is there way for you to actually summarize these prefixes to get them to a sizeable number?

Thanks & regards,

Chakrapani

Chakrapani Chitnis

ENGINEER.SOFTWARE ENGINEERING

CSG PI Services AppX - US

cchitnis@cisco.com<mailto:cchitnis@cisco.com>

WebEx Social profile<http://iwe.cisco.com/web/cchitnis>

Phone: +1 408 525 2341

www.cisco.com<http://www.cisco.com/>

<https://www.facebook.com/cchitnis> <https://plus.google.com/u/0/+ChakrapaniChitnis/posts> <https://www.linkedin.com/pub/chakrapani-chitnis/4/612/3b?domainCountryName=&csrfToken=ajax%3A1899398277677078071> <https://twitter.com/c_chitnis>

Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.

Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.

cchitnis · ‎12-19-2016

Thanks for the confirmation Madhavan!

- C

Chakrapani Chitnis

ENGINEER.SOFTWARE ENGINEERING

CSG PI Services AppX - US

cchitnis@cisco.com<mailto:cchitnis@cisco.com>

WebEx Social profile<http://iwe.cisco.com/web/cchitnis>

Phone: +1 408 525 2341

www.cisco.com<http://www.cisco.com/>

<https://www.facebook.com/cchitnis> <https://plus.google.com/u/0/+ChakrapaniChitnis/posts> <https://www.linkedin.com/pub/chakrapani-chitnis/4/612/3b?domainCountryName=&csrfToken=ajax%3A1899398277677078071> <https://twitter.com/c_chitnis>

Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.

Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.

cchitnis · ‎12-19-2016

Josey,

The workaround would be to summarize DC prefixes and routes as much as possible. I replied to Brian on community thread to check if that’s possible to do on customer side. Currently, there’re about 1700 prefixes.

Thanks & regards,

Chakrapani

Chakrapani Chitnis

ENGINEER.SOFTWARE ENGINEERING

CSG PI Services AppX - US

cchitnis@cisco.com<mailto:cchitnis@cisco.com>

WebEx Social profile<http://iwe.cisco.com/web/cchitnis>

Phone: +1 408 525 2341

www.cisco.com<http://www.cisco.com/>

<https://www.facebook.com/cchitnis> <https://plus.google.com/u/0/+ChakrapaniChitnis/posts> <https://www.linkedin.com/pub/chakrapani-chitnis/4/612/3b?domainCountryName=&csrfToken=ajax%3A1899398277677078071> <https://twitter.com/c_chitnis>

Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.

Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.

brian.hooper · ‎12-19-2016

I knew it had to be something with this.

Can you please give me some direction on how to accomplish this without actively changing the way the customers EIGRP AS is currently configured in their prod network? Should I allow APIC to 'figure' out what the prefixes are during the HUB deployment portion, then remove all of the prefixes with the '-' button, and manually add them back in?

Another Question: When apic is trying to configure the datacenter prefixes, is this for PfRv3? When I think of Datacenter prefixes - I would naturally think that the DC prefixes are only those that belong to the local LAN of the DC I am provisioning.

Apologies for the questions, but I am a little foggy here. Thanks - My TAC engineer requested a Webex session later today. Hopefully we can work together to get this deployed.

brian.hooper · ‎12-19-2016

Please allow me to clarify the situation.

In the current production environment, my hub routers are learning external eigrp routes from the core. The original CE routers for MPLS are learning all routes via BGP, and those BGP routes are being redistributed via eigrp into the core. This is why the APIC-EM is seeing over 1700 prefixes, I assume. So the question is this...Should I filter external BGP routes that are redistributed via the eigrp process at the HUB?

brian.hooper · ‎12-19-2016

I was able to get past this error by filtering all the external eigrp routes the hub routers were learning from the core. This got me to the next step with deploying the hub. BUT – that failed with an error of FAILED, Hub is not recoverable, please delete this site.

I am not sure whether to delete this site or how to move forward…

cchitnis · ‎12-19-2016

Brian, please get a new RCA for this latest failure you experienced and we will take a look. Alternatively, we can debug it over the call.

brian.hooper · ‎12-19-2016

All of you are rockstars. Thank you so much for helping me resolve the issues today.