Re: Cisco ACE module missing licence file - no connectivity

guerinp · ‎11-20-2009

Hi,

We have 2 ACE modules that were delivered without any licenses.

There is no IP connectivity whatsoever to these modules and I'm guessing this is due to the fact there are no licenses installed.

Have tried asking Cisco to no avail - and am not sure if there is an actual problem with them or not.

The VLANs are assigned correctly and I can see inbound ICMP echo from the 6509 that its hosted in, but no outbound packets ever leave the ACE. I've applied a mgmt policy to enable ping/telnet/ssh etc.

switch/Admin# sh vlans

Vlans configured on SUP for this module

vlan4 vlan30-31 vlan160 vlan180-195 vlan360 vlan380-395 vlan560 vlan580-

595 vlan760 vlan780-795

switch/Admin# sh ip int bri

Interface IP-Address Status Protocol

vlan4 10.119.127.196 up up

vlan30 10.119.127.241 up up

vlan31 10.119.127.245 up up

interface vlan 4

description ACE Mgmt interface for Admin Context

ip address 10.119.127.196 255.255.255.224

service-policy input REMOTE_MGMT

no shutdown

vlan4 is up

Hardware type is VLAN

MAC address is 00:1f:ca:7b:6f:33

Mode : routed

IP address is 10.119.127.196 netmask is 255.255.255.224

FT status is non-redundant

Description:ACE Mgmt interface for Admin Context

MTU: 1500 bytes

Last cleared: never

Alias IP address not set

Peer IP address not set

Assigned from the Supervisor, up on Supervisor

Config download failures : 1

2980 unicast packets input, 16363862 bytes

240857 multicast, 3026 broadcast

0 input errors, 0 unknown, 0 ignored, 0 unicast RPF drops

0 unicast packets output, 187712 bytes

0 multicast, 2933 broadcast

0 output errors, 0 ignored

switch/Admin# sh arp

Context Admin

================================================================================

IP ADDRESS MAC-ADDRESS Interface Type Encap NextArp(s) Status

================================================================================

10.119.127.193 00.00.00.00.00.00 vlan4 GATEWAY - * 3 req dn

10.119.127.196 00.1f.ca.7b.6f.33 vlan4 INTERFACE LOCAL _ up

10.119.127.245 00.1f.ca.7b.6f.33 vlan31 INTERFACE LOCAL _ up

10.119.127.241 00.1f.ca.7b.6f.33 vlan30 INTERFACE LOCAL _ up

================================================================================

Total arp entries 4

The ARP table for the adjacent switch SVI has a valid MAC upon reboot, but soon after resets to 00.00.00.00.00.00

Problem is that once Cisco eventually send me the license file I have no way of TFTP'ing it to the ACE module.

Any suggestions/advice?

Gilles Dufour · ‎11-20-2009

You do not need a license for basic configuration.

The module seems to receive traffic but arp table being empty, there is nothing going out.

Could you get a 'show resource usage' and a 'show cde health'

Try to increase your "mgmt-connections"

Thanks.

Gilles.

guerinp · ‎11-20-2009

Thanks for the info - so I should at least be able to connect to a license-less ACE at least, but these modules seem to have a problem.

If the modules are reloaded (from the ACE) or reset (from the Supervisor) they initially have the ARP entry (however still cannot communicate to the attached Supervisor via SVI) which eventually resets.

Info as requested:

switch/Admin# sh resource usage

Allocation

Resource Current Peak Min Max Denied

-------------------------------------------------------------------------------

Context: Admin

conc-connections 9 9 0 0 0

mgmt-connections 0 0 0 0 0

proxy-connections 0 0 0 0 0

xlates 0 0 0 0 0

bandwidth 0 76 0 125000000 296849008

throughput 0 76 0 0 296849008

mgmt-traffic rate 0 0 0 125000000 0

connection rate 0 2 0 0 15

ssl-connections rate 0 0 0 0 0

mac-miss rate 0 0 0 0 0

inspect-conn rate 0 0 0 0 0

acl-memory 0 6336 0 0 11

sticky 0 0 0 0 0

regexp 0 0 0 0 0

syslog buffer 0 0 0 0 0

syslog rate 0 0 0 0 24

Context: APPLICATION

conc-connections 0 0 2000000 0 0

mgmt-connections 0 0 25000 0 0

proxy-connections 0 0 262144 0 0

xlates 0 0 262144 0 0

bandwidth 0 0 125000000 125000000 0

throughput 0 0 125000000 0 0

mgmt-traffic rate 0 0 0 125000000 0

connection rate 0 0 250000 0 0

ssl-connections rate 0 0 250 0 0

mac-miss rate 0 0 500 0 0

inspect-conn rate 0 0 1500 0 0

acl-memory 0 0 19650480 0 0

sticky 0 0 419430 0 0

regexp 0 0 262144 0 0

syslog buffer 0 0 1048576 0 0

syslog rate 0 0 25000 0 0

Context: BACK_END

conc-connections 0 0 2000000 0 0

mgmt-connections 0 0 25000 0 0

proxy-connections 0 0 262144 0 0

xlates 0 0 262144 0 0

bandwidth 0 0 125000000 125000000 0

throughput 0 0 125000000 0 0

mgmt-traffic rate 0 0 0 125000000 0

connection rate 0 0 250000 0 0

ssl-connections rate 0 0 250 0 0

mac-miss rate 0 0 500 0 0

inspect-conn rate 0 0 1500 0 0

acl-memory 0 0 19650480 0 0

sticky 0 0 419430 0 0

regexp 0 0 262144 0 0

syslog buffer 0 0 1048576 0 0

syslog rate 0 0 25000 0 0

Context: FRONT_END

conc-connections 0 0 2000000 0 0

mgmt-connections 0 0 25000 0 0

proxy-connections 0 0 262144 0 0

xlates 0 0 262144 0 0

bandwidth 0 0 125000000 125000000 0

throughput 0 0 125000000 0 0

mgmt-traffic rate 0 0 0 125000000 0

connection rate 0 0 250000 0 0

ssl-connections rate 0 0 250 0 0

mac-miss rate 0 0 500 0 0

inspect-conn rate 0 0 1500 0 0

acl-memory 0 0 19650480 0 0

sticky 0 0 419430 0 0

regexp 0 0 262144 0 0

syslog buffer 0 0 1048576 0 0

syslog rate 0 0 25000 0 0

Context: TEST_DEV

conc-connections 0 0 2000000 0 0

mgmt-connections 0 0 25000 0 0

proxy-connections 0 0 262144 0 0

xlates 0 0 262144 0 0

bandwidth 0 0 125000000 125000000 0

throughput 0 0 125000000 0 0

mgmt-traffic rate 0 0 0 125000000 0

connection rate 0 0 250000 0 0

ssl-connections rate 0 0 250 0 0

mac-miss rate 0 0 500 0 0

inspect-conn rate 0 0 1500 0 0

acl-memory 0 0 19650480 0 0

sticky 0 0 419430 0 0

regexp 0 0 262144 0 0

syslog buffer 0 0 1048576 0 0

syslog rate 0 0 25000 0 0

switch/Admin# sh cde health

CDE BRCM INTERFACE

======================

Packets received 3357

Packets transmitted 12

Broadcom interface CRC error count 0

BRCM VOQ status [empty] [not full]

BRCM pull status [pulling]

CDE HYPERION INTERFACE

======================

Packets received 7668407

Packets transmitted 967915

Short packets drop count 0

Fifo Full drop count 0

Protocol error drop count 0

FCS error drop count 0

CRC error drop count 0

Num times flow control triggered on hyp interface 0

Num self generated multicast packets filtered 967915

HYP IXP0 VOQ status [empty] [not full]

HYP IXP1 VOQ status [empty] [not full]

HYP SLOW VOQ status [empty] [not full]

HYP tx pull status [pulling]

CDE IXP0 INTERFACE

======================

Packets received 964680

Packets transmitted 6581196

Num bad pkts recvd on fast spi channel0 0

Num bad pkts recvd on slow spi channel8 0

Num bad pkts recvd on fast spi channel2 0

Num bad pkts recvd on slow spi channel4 0

IXP0 Fast VOQ status [empty] [not full]

IXP0 BRCM VOQ status [empty] [not full]

IXP0 pull status [pulling]

IXP0 spi src status [healthy]

IXP0 spi snk status [healthy]

CDE1 SWITCH1 INTERFACE

======================

Packets received (hyp, ixp0) 3241

Packets received (bcm) 6

Packets received (daughter card 0) 0

Packets received (daughter card 1) 0

Packets Errors received (hyp, ixp0) 0

Packets Errors received (bcm) 0

Packets Errors received (daughter card 0) 0

Packets Errors received (daughter card 1) 0

Packets transmitted (ixp1) 122653

Packets transmitted (nitrox) 0

Packets Errors transmitted (ixp1) 0

Packets Errors transmitted (nitrox) 0

CDE2 SWITCH2 INTERFACE

======================

Packets received (ixp1) 122653

Packets received (nitrox) 0

Packets Errors received (ixp1) 0

Packets Errors received (nitrox) 0

Packets transmitted (hyp, ixp0) 3241

Packets transmitted (broadcom) 6

Packets transmitted (daughter card 0) 0

Packets transmitted (daughter card 1) 0

Packets Errors transmitted (ixp1) 0

Packets Errors transmitted (nitrox) 0

Packets Errors transmitted (daughter card 0) 0

Packets Errors transmitted (daughter card 1) 0

CDE IXP1 INTERFACE

======================

Packets received 3247

Packets transmitted 122653

Num bad pkts recvd on fast spi channel0 0

Num bad pkts recvd on slow spi channel8 0

Num bad pkts recvd on fast spi channel2 0

Num bad pkts recvd on slow spi channel4 0

IXP1 Fast VOQ status [empty] [not full]

IXP1 BRCM VOQ status [empty] [not full]

IXP1 pull status [pulling]

IXP1 spi src status [healthy]

IXP1 spi snk status [healthy]

CDE NITROX INTERFACE

======================

Packets received 0

Packets transmitted 0

Num bad pkts recvd on fast spi channel0 0

Num bad pkts recvd on slow spi channel8 0

Num bad pkts recvd on fast spi channel2 0

Num bad pkts recvd on slow spi channel4 0

NTX Fast VOQ status [empty] [not full]

NTX BRCM VOQ status [empty] [not full]

NTX pull status [pulling]

NTX spi src status [healthy]

NTX spi snk status [healthy]

== Backplane ==

ITASCA_SYS_CNTL1 0x300 data 0x61f0000

ITASCA_SYS_CNTL2 0x304 data 0x80630000

Gilles Dufour · ‎11-21-2009

bandwidth 0 76 0 125000000 296849008

throughput 0 76 0 0 296849008

mgmt-traffic rate 0 0 0 125000000 0

Your traffic is being denier.

Apparently you have associated too much BW to the other context.

Try to create a resource class with 10% resources guaranteed for the admin context.

Also adjust the other context resources.

Gilles.

guerinp · ‎11-23-2009

Gilles,

Thanks for your help - the ACE was allocating 100% of resources to the contexts leaving none left for Admin. Reason this was not happening on the other modules was that they had 3 contexts each using 33% (leaving 1% for default context for Admin).

The 'problem' ACE modules had 4 contexts each using 25% (leaving nothing for Admin as you suggested).

I've since changed to allow 1% for Admin and all is now working(FT groups also working fine).

Is there a recommendation from Cisco as to how much resource usage to allocate for Admin context - I've only allowed 1% currently - should I use 10% as a guide instead?

Thanks again!

Gilles Dufour · ‎11-23-2009

I'm glad you got it working.

If your admin context is not being used to handle traffic, I think 1% is enough resource.

Gilles.