Port Channel uplink trunk between FI 6248 and Dell S4808 (Force 10) won't come up.

mark.werner · ‎03-15-2018

I have been attempting to bring up a port channel between a Cisco 6248 Fibre Interconnect and a Dell S4808-ON. I cannot get the channel to come up. I am not sure what I am missing. Hoping to find some help or suggestions here.

The Dell S4808 is a bit of a bird of a different feather when it comes to configuration. It runs a Dell Networking Operating System (DNOS) which is derived from Force 10 Operating System (FTOS). Nevertheless, As far as I can tell it is configured accordingly to support an LACP channel.

I ran the following commands on the switches to provide results to present for review.

First from the Cisco Fibre Interconnect:

show interface Ethernet 1/17 brief

show interface Ethernet 1/17 transceiver

show interface port-channel 17

show running-config

*********************************************************

Second from the Dell S4808-ON:

show interfaces tengigabitethernet 3/17

show interfaces tengigabitethernet 3/17 transceiver

show interfaces port-channel 17

(conf-if-te-3/17)#show config

(conf-if-po-17)#show config

show lacp

show interfaces port-channel 17

Cisco-FI-A-A(nxos)# show interface Ethernet 1/17 brief

--------------------------------------------------------------------------------

Ethernet VLAN Type Mode Status Reason Speed Port

Interface Ch #

--------------------------------------------------------------------------------

Eth1/17 1 eth trunk down Link not connected 10G(D) 17

******

Cisco-FI-A-A(nxos)# show interface Ethernet 1/17

Ethernet1/17 is down (Link not connected)

Dedicated Interface

Belongs to Po17

Hardware: 1000/10000 Ethernet, address: 00de.fb03.2098 (bia 00de.fb03.2098)

Description: U: Uplink

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped never

Last clearing of "show interface" counters never

30 seconds input rate 0 bits/sec, 0 bytes/sec, 0 packets/sec

30 seconds output rate 0 bits/sec, 0 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 0 bps, 0 pps; output rate 0 bps, 0 pps

RX

0 unicast packets 0 multicast packets 0 broadcast packets

0 input packets 0 bytes

0 jumbo packets 0 storm suppression bytes

0 runts 0 giants 0 CRC 0 no buffer

0 input error 0 short frame 0 overrun 0 underrun 0 ignored

0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 0 multicast packets 0 broadcast packets

0 output packets 0 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble 0 output discard

0 Tx pause

0 interface resets

******

Cisco-FI-A-A(nxos)# show interface Ethernet 1/17 transceiver

Ethernet1/17

transceiver is present

type is SFP-H10GB-CU3M

name is CISCO-LOROM

part number is LRHSPB54D030

revision is B2

serial number is LRM194981E7

nominal bitrate is 10300 MBit/sec

Link length supported for copper is 3 m

cisco id is --

cisco extended id number is 4

******

Cisco-FI-A-A(nxos)# show interface port-channel 17

port-channel17 is down (No operational members)

Hardware: Port-Channel, address: 0000.0000.0000 (bia 0000.0000.0000)

Description: U: Uplink

MTU 1500 bytes, BW 100000 Kbit, DLY 10 usec

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, auto-speed

Input flow-control is off, output flow-control is off

Switchport monitor is off

EtherType is 0x8100

Members in this channel: Eth1/17

Last clearing of "show interface" counters never

30 seconds input rate 0 bits/sec, 0 bytes/sec, 0 packets/sec

30 seconds output rate 0 bits/sec, 0 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 0 bps, 0 pps; output rate 0 bps, 0 pps

RX

0 unicast packets 0 multicast packets 0 broadcast packets

0 input packets 0 bytes

0 jumbo packets 0 storm suppression bytes

0 runts 0 giants 0 CRC 0 no buffer

0 input error 0 short frame 0 overrun 0 underrun 0 ignored

0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 0 multicast packets 0 broadcast packets

0 output packets 0 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble 0 output discard

0 Tx pause

0 interface resets

******

Cisco-FI-A-A(nxos)# show running-config

interface port-channel17

description U: Uplink

switchport mode trunk

pinning border

switchport trunk allowed vlan 1,10

speed 10000

feature npv

feature npiv

interface Ethernet1/17

description U: Uplink

pinning border

switchport mode trunk

switchport trunk allowed vlan 1,10

channel-group 17 mode active

no shutdown

*******************************************************************************************************************************************************************

leaf2#show interfaces tengigabitethernet 3/17

TenGigabitEthernet 3/17 is up, line protocol is down

Hardware is DellEth, address is 64:00:6a:f2:56:34

Current address is 64:00:6a:f2:56:34

Pluggable media present, SFP type is 1000BASE-T

Interface index is 4196356

Internet address is not set

Mode of IPv4 Address Assignment : NONE

DHCP Client-ID :64006af25634

MTU 1554 bytes, IP MTU 1500 bytes

LineSpeed auto

Flowcontrol rx off tx off

ARP type: ARPA, ARP Timeout 04:00:00

Last clearing of "show interface" counters 13:50:23

Queueing strategy: fifo

Input Statistics:

0 packets, 0 bytes

0 64-byte pkts, 0 over 64-byte pkts, 0 over 127-byte pkts

0 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts

0 Multicasts, 0 Broadcasts, 0 Unicasts

0 runts, 0 giants, 0 throttles

0 CRC, 0 overrun, 0 discarded

Output Statistics:

0 packets, 0 bytes, 0 underruns

0 64-byte pkts, 0 over 64-byte pkts, 0 over 127-byte pkts

0 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts

0 Multicasts, 0 Broadcasts, 0 Unicasts

0 throttles, 0 discarded, 0 collisions, 0 wreddrops

Rate info (interval 299 seconds):

Input 00.00 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Output 00.00 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Time since last interface status change: 7w6d17h

******

leaf2#show INTerfaces tengigabitethernet 3/17 transceiver

Interface Name : TenGigabitEthernet 3/17

SFP is present

SFP 1114112 Serial Base ID fields

SFP 1114112 Id = 0x03

SFP 1114112 Ext Id = 0x04

SFP 1114112 Connector = 0x22

SFP 1114112 Transceiver Code = 0x00 0x00 0x00 0x08 0x00 0x00 0x00 0x00

SFP 1114112 Encoding = 0x01

SFP 1114112 BR Nominal = 0x0c

SFP 1114112 Length(SFM) Km = 0x00

SFP 1114112 Length(OM3) 2m = 0x00

SFP 1114112 Length(OM2) 1m = 0x00

SFP 1114112 Length(OM1) 1m = 0x00

SFP 1114112 Length(Copper) 1m = 0x64

SFP 1114112 Vendor Rev = A

SFP 1114112 Laser Wavelength = 25.85 nm

SFP 1114112 CheckCodeBase = 0x33

SFP 1114112 Serial Extended ID fields

SFP 1114112 Options = 0x00 0x12

SFP 1114112 BR max = 0

SFP 1114112 BR min = 0

SFP 1114112 Vendor SN = PX804CD

SFP 1114112 Datecode = 170221

SFP 1114112 CheckCodeExt = 0x6a

SFP 1114112 DOM is not supported

******

leaf2#show interfaces port-channel 17

Port-channel 17 is up, line protocol is down(minimum links not up)

Created by LACP protocol

Hardware address is 64:00:6a:f2:56:34, Current address is 64:00:6a:f2:56:34

Interface index is 1258299904

Minimum number of links to bring Port-channel up is 1

Internet address is not set

Mode of IPv4 Address Assignment : NONE

DHCP Client-ID :64006af25634

MTU 1554 bytes, IP MTU 1500 bytes

LineSpeed auto

Members in this channel:

ARP type: ARPA, ARP Timeout 04:00:00

Queueing strategy: fifo

Input Statistics:

0 packets, 0 bytes

0 64-byte pkts, 0 over 64-byte pkts, 0 over 127-byte pkts

0 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts

0 Multicasts, 0 Broadcasts, 0 Unicasts

0 runts, 0 giants, 0 throttles

0 CRC, 0 overrun, 0 discarded

Output Statistics:

0 packets, 0 bytes, 0 underruns

0 64-byte pkts, 0 over 64-byte pkts, 0 over 127-byte pkts

0 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts

0 Multicasts, 0 Broadcasts, 0 Unicasts

0 throttles, 0 discarded, 0 collisions, 0 wreddrops

Rate info (interval 299 seconds):

Input 00.00 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Output 00.00 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Time since last interface status change: 5d22h29m

******

leaf2(conf-if-te-3/17)#show config

!

interface TenGigabitEthernet 3/17

no ip address

!

port-channel-protocol LACP

port-channel 17 mode active

lacp port-priority 1

no shutdown

******

leaf2(conf-if-po-17)#show config

!

interface Port-channel 17

no ip address

portmode hybrid

switchport

lacp fast-switchover

lacp long-timeout

no shutdown

******

leaf2(conf-if-vl-10)#show config

!

interface Vlan 10

description VLAN on x.x.x.x /24 lab network

name Lab VLAN 10

ip address x.x.x.x/24

tagged TenGigabitEthernet 3/3,3/6-3/8,3/11-3/16,3/19-3/24

tagged Port-channel 2,17

untagged TenGigabitEthernet 3/1

no shutdown

******

leaf2#show lacp

% Error: Incomplete command.

cswp-leaf2#show lacp 17

Port-channel 17 admin up, oper down, mode lacp

LACP Fast Switch-Over Enabled

Actor System ID: Priority 32768, Address 6400.6af2.5632

Partner System ID: Priority 0, Address 0000.0000.0000

Actor Admin Key 17, Oper Key 17, Partner Oper Key 0, VLT Peer Oper Key 17

LACP LAG 17 is an individual link

LACP LAG 17 is a normal LAG

A - Active LACP, B - Passive LACP, C - Short Timeout, D - Long Timeout

E - Aggregatable Link, F - Individual Link, G - IN_SYNC, H - OUT_OF_SYNC

I - Collection enabled, J - Collection disabled, K - Distribution enabled

L - Distribution disabled, M - Partner Defaulted, N - Partner Non-defaulted,

O - Receiver is in expired state, P - Receiver is not in expired state

Port Te 3/17 is disabled, LACP is disabled and mode is lacp

Port State: Not in Bundle

Actor Admin: State ADEHJLMP Key 17 Priority 1

Oper: State ADEHJLMP Key 17 Priority 1

Partner is not present

******

leaf2#show interfaces port-channel 17

Port-channel 17 is up, line protocol is down(minimum links not up)

Created by LACP protocol

Hardware address is 64:00:6a:f2:56:34, Current address is 64:00:6a:f2:56:34

Interface index is 1258299904

Minimum number of links to bring Port-channel up is 1

Internet address is not set

Mode of IPv4 Address Assignment : NONE

DHCP Client-ID :64006af25634

MTU 1554 bytes, IP MTU 1500 bytes

LineSpeed auto

Members in this channel:

ARP type: ARPA, ARP Timeout 04:00:00

Queueing strategy: fifo

Input Statistics:

0 packets, 0 bytes

0 64-byte pkts, 0 over 64-byte pkts, 0 over 127-byte pkts

0 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts

0 Multicasts, 0 Broadcasts, 0 Unicasts

0 runts, 0 giants, 0 throttles

0 CRC, 0 overrun, 0 discarded

Output Statistics:

0 packets, 0 bytes, 0 underruns

0 64-byte pkts, 0 over 64-byte pkts, 0 over 127-byte pkts

0 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts

0 Multicasts, 0 Broadcasts, 0 Unicasts

0 throttles, 0 discarded, 0 collisions, 0 wreddrops

Rate info (interval 299 seconds):

Input 00.00 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Output 00.00 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Time since last interface status change: 5d22h43m

Kirk J · ‎03-15-2018

Greetings.

Not sure if this is mentioned in your output, but have you confirmed the individual ports come up outside of the port-channel?

Looks like at least one or both of the dell output lists a 1000Mb SFP, but your FIs show 10Gb SFPs.

Please confirm you can individually bring up the trunk links to make sure we have any media/sfp/issues ironed out first.

Thanks,

kirk...