1000Base-T GLC-T connected to an SFP+ interface in a 4500X running 03.07.02.E not working

d3m.system · ‎03-18-2016

We have a 100Base-T GLC-T gbic connected to a TenGig interface of a 4500x switch, but when we try to connect a device to that port i.e: either a server or another switch like a 3850, the port does not come up at 1Gb on the 4500X:

Te1/1/8 notconnect routed full auto 1000BaseT

CASE1:

Switch 4500X, interface TenGiga 1/1/8 using GLC-T Gbic connected to a Catalyst 3850 switch on GigaEthernet 1/0/1, both interfaces set to auto negotiate
On 4500X
Port      Name               Status       Vlan       Duplex Speed Type
Te1/1/8                      notconnect   routed       full   auto 1000BaseT
On 3850
Port      Name               Status       Vlan       Duplex Speed Type
Gi1/0/1                      connected    routed     a-full a-1000 10/100/1000BaseTX

CASE2:

Switch 4500X, interface TenGiga 1/1/8 using GLC-T Gbic connected to a Catalyst 3850 switch on GigaEthernet 1/0/1, but both interfaces set manually to 100Mb full duplex:

On 4500X
Port      Name               Status       Vlan       Duplex Speed Type
Te1/1/8                      connected    routed       full    100 1000BaseT
On 3850
Port      Name               Status       Vlan       Duplex Speed Type
Gi1/0/1                      connected    routed       full    100 10/100/1000BaseTX

SW-CORE-M1#show version
Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500e-UNIVERSALK9-M), Version 03.07.02.E RELEASE SOFTWARE (fc1)

ROM: 15.0(1r)SG11
SW-CORE-M1 uptime is 4 hours, 30 minutes
Uptime for this control processor is 4 hours, 32 minutes
System returned to ROM by reload
Running default software
Jawa Revision 2, Winter Revision 0x0.0x41

Last reload reason: Reload Shelf CLI

License Information for 'WS-C4500X-16'
License Level: entservices Type: Permanent Right-To-Use
Next reboot license Level: entservices

the inventory shows:

NAME: "TenGigabitEthernet1/1/8", DESCR: "1000BaseT"
PID: Unspecified , VID: , SN: 00000MTC16460019

Unfortunatelly in this version of IOS is not possible to set the speed manually to 1000 I know that since XE 3.7.1E it is possible to set the speed to 10 or 100 manually but I can't see an option to force speed to 1000

Any ideas?

Thanks in advance.

d3m.system · ‎03-18-2016

We also tried the service unsupported-transceiver command without luck

Paul Chapman · ‎03-18-2016

The Cat4500X only supports 1000/10000 on the port, so auto-negotiation probably won't work. Your GLC-T will be locked at 1000/Full.

On the 3850, how about:

speed 1000
duplex full

If that doesn't work, disable auto crossover on the 3850 and use a crossover cable.

no mdix auto

(I just installed about sixty 4500Xs and didn't have a single problem with 1Gbps connections. Difference here is that I was using all fiber, no GLC-T modules.)

Good Luck!

PSC

d3m.system · ‎03-19-2016

Hi Paul,

Thanks for your reply.

Since version XE 3.7.1E it is possible to force a SFP+ that has a GLC-T attached to 100Mbps or 10Mbps in a Catalyst 4500X:

NAME: "TenGigabitEthernet1/1/8", DESCR: "1000BaseT"
PID: Unspecified       , VID:      , SN: 00000MTC16460019

SW-CORE-M1(config-if)#speed ?
  10   Force 10 Mbps operation
  100  Force 100 Mbps operation

I was able to stablish a link with a 100Mps device by forcing the speed and the duplex in both ends.

The problem I'm having is that the GLC-T is not working at 1000Mbps, even if I force the other end to be 1000Mpbs full-duplex.

The strange this in that after reseting interfaces to defaults in both ends the 3850 interface appears as connected and the 4500x interface appears as not connect, this is also reflected in the state of the front panel status LEDs

SW-CORE-M1#show run inter tenGigabitEthernet 1/1/8
Building configuration...
Current configuration : 41 bytes
!
interface TenGigabitEthernet1/1/8
end

SW-CORE-M1#show inter tenGigabitEthernet 1/1/8
TenGigabitEthernet1/1/8 is down, line protocol is down (notconnect)
  Hardware is Ten Gigabit Ethernet Port, address is 0462.7399.5287 (bia 0462.7399.5287)
  MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, Auto-speed, link type is force-up, media type is 1000BaseT
  input flow-control is off, output flow-control is off
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:10:48, output never, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     6842 packets input, 836051 bytes, 0 no buffer
     Received 1915 broadcasts (980 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 input packets with dribble condition detected
     1306 packets output, 570024 bytes, 0 underruns
     0 output errors, 0 collisions, 9 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out

SW-SERVER-M1#show run interface gigabitEthernet 1/0/2
Building configuration...

Current configuration : 38 bytes
!
interface GigabitEthernet1/0/2
end

SW-SERVER-M1#show interfaces gigabitEthernet 1/0/2
GigabitEthernet1/0/2 is up, line protocol is up (connected)
  Hardware is Gigabit Ethernet, address is 0c11.67d3.0c02 (bia 0c11.67d3.0c02)
  MTU 1500 bytes, BW 100000 Kbit/sec, DLY 100 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Half-duplex, 100Mb/s, media type is 10/100/1000BaseTX
  input flow-control is off, output flow-control is unsupported
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:12:19, output never, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     1031 packets input, 435643 bytes, 0 no buffer
     Received 1024 broadcasts (1021 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 1021 multicast, 0 pause input
     0 input packets with dribble condition detected
     12702 packets output, 1255459 bytes, 0 underruns
     0 output errors, 0 collisions, 3 interface resets
     11 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

And btw, we tried the setting about auto crossover but it didn't help

no mdix auto

I hope that makes sense,

Thanks again.

PD: We also tried GLC-LH-SM and GLC-SX-MM and we didn't have any problem with those, they work correctly at 1000Mpbs without any further configuration. Unfortunately we have a couple of devices which need to be connected with RJ45 copper interfaces at 1G, i.e: ASA 5510

Paul Chapman · ‎03-19-2016

Hi -

A couple of thoughts here...

Do a "show interface teX/Y capabilities" and post. I just did it on one of my deployed 4500X switches and see port speeds of 10/100/1000/10000
Do you get any log messages on the 4500X when the module is plugged in / unplugged / network is connected?
Have you swapped the GLC-T with another one? (I'm guessing you have, but just making sure)
Have you installed a GLC-T in your 3850 and cross connected it to itself? (STP should protect the network; this validates whether the GLC-T works at all.)

PSC

d3m.system · ‎03-19-2016

Hi Paul,

Thanks for your reply.

1. Capabilities

SW-CORE-M1#show interfaces tenGigabitEthernet 1/1/8 capabilities
TenGigabitEthernet1/1/8
 Model: WS-C4500X-16-Gbic
 Type: 1000BaseT
 Speed: 10,100,1000,10000
 Duplex: full
 Auto-MDIX: no
 EEE: no
 Trunk encap. type: 802.1Q
 Trunk mode: on,off,desirable,nonegotiate
 Channel: yes
 Broadcast suppression: percentage(0-100), hw
 Multicast suppression: percentage(0-100), hw
 Flowcontrol: rx-(off,on,desired),tx-(off,on,desired)
 VLAN Membership: static, dynamic
 Fast Start: yes
 CoS rewrite: yes
 ToS rewrite: yes
 Inline power: no
 SPAN: source/destination
 UDLD: yes
 Link Debounce: yes
 Link Debounce Time: yes
 Port Security: yes
 Dot1x: yes
 Maximum MTU: 9198 bytes (Jumbo Frames)
 Multiple Media Types: no
 Diagnostic Monitoring: N/A

2. When the module is inserted/removed I get a "transciever has been inserted" message, but when I connect a cable to it I don't see anything in the logs.

3. Yes, indeed I did that, but the results are the same with either.

4. No, I haven't done that test, but I'm certain the modules work, both of them were in production, they were previously installed in a Catalyst 3750 and were operating correctly

I have a TACs, but I'm still waiting for an answer.

Thanks for your help.

Paul Chapman · ‎03-21-2016

Hi -

I think a TAC case is appropriate. Here are some outputs from one of the switches we have deployed in the field...

4500X-Switch#sh int te1/3 status
Port Name Status Vlan Duplex Speed Type 
Te1/3 connected trunk full a-1000 1000BaseT
!
4500X-Switch#sh inv
NAME: "TenGigabitEthernet1/3", DESCR: "1000BaseT"
PID: Unspecified , VID: , SN: <removed>
!
4500X-Switch#sh int te1/3
TenGigabitEthernet1/3 is up, line protocol is up (connected) 
<truncated>
 MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec, 
 reliability 255/255, txload 1/255, rxload 1/255
<truncated>
 Full-duplex, 1000Mb/s, link type is auto, media type is 1000BaseT
<truncated>
!
4500X-Switch#sh int te1/3 capabilities 
TenGigabitEthernet1/3
 Model: WS-C4500X-16-Gbic
 Type: 1000BaseT
 Speed: 1000,10000
 Duplex: full
 Auto-MDIX: no
 EEE: no
 Trunk encap. type: 802.1Q
 Trunk mode: on,off,desirable,nonegotiate
 Channel: yes
 Broadcast suppression: percentage(0-100), hw
 Multicast suppression: percentage(0-100), hw
 Flowcontrol: rx-(off,on,desired),tx-(off,on,desired)
 VLAN Membership: static, dynamic
 Fast Start: yes
 CoS rewrite: yes
 ToS rewrite: yes
 Inline power: no
 SPAN: source/destination
 UDLD: yes
 Link Debounce: yes
 Link Debounce Time: yes
 Port Security: yes
 Dot1x: yes
 Maximum MTU: 9198 bytes (Jumbo Frames)
 Multiple Media Types: no
 Diagnostic Monitoring: N/A
!
4500X-Switch#sh ver
Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500e-UNIVERSALK9-M), Version 03.06.03.E RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Wed 26-Aug-15 06:05 by prod_rel_team
<truncated>
ROM: 15.0(1r)SG11
<truncated>
System image file is "bootflash:cat4500e-universalk9.SPA.03.06.03.E.152-2.E3.bin"
Jawa Revision 2, Winter Revision 0x0.0x41
<truncated>
License Information for 'WS-C4500X-16'
 License Level: entservices Type: Permanent
 Next reboot license Level: entservices
cisco WS-C4500X-16 (MPC8572) processor (revision 9) with 4194304K bytes of physical memory.
Processor board ID <removed>
MPC8572 CPU at 1.5GHz, Cisco Catalyst 4500X
Last reset from PowerUp
34 Virtual Ethernet interfaces
16 Ten Gigabit Ethernet interfaces
511K bytes of non-volatile configuration memory.

Configuration register is 0x2102
!

Two interesting items came out of this check. 1) You can't run the "show interface transceiver" command on interfaces with the GLC-Ts, and 2) Interfaces with GLC-Ts show a capability of 1000/10000.

Good Luck!

PSC

d3m.system · ‎03-22-2016

Thanks for your reply Paul

The only notioceable difference between your setup and ours is the version of IOS XE [that's why your tranciever does not appear to be 100Mpbs capable], unfortunately I cannot downgrade, we need the GLC-T gbics to work both at 100Mpbs and 1000Mpbs, unfortunately 3.6 does not support 100Mpbs at all, and we are giving priority to 100Mpbs interfaces as one of our ISP uses and old device only capable of 100Mbps.

Paul Chapman · ‎03-22-2016

Hi -

At this point I'm going to go back to my original answer. I don't think that the 4500X supports 10/100 connectivity at the ASIC level. Even the spec sheet (4500-X DataSheet) only shows support for 1Gb and 10Gb SFP modules. It would seem to me to be a code anomaly when it shows that the port is capable of 10/100 speeds and not just 1000/10000.

Your original query was for 1Gb connectivity from the 4500-X to a server or a Catalyst 3850. If you are having problems with 1Gb speeds, then I agree with the oddity of the issue. Since you are now mentioning ISP handoffs at sub-1Gb speeds, then I'm going to stick with the spec sheet.

PSC

d3m.system · ‎03-23-2016

Hi,

As I mentioned before it's not a code anomaly when it shows the port is capable of 10/100, it's a feature introduced in IOS XE 3.7.xE, but I guess you are right, it might be something implemented at software level and not at ASIC level.

I'm still waiting for a proper answer from my TACs case. Yesterday we had a WebEx session and the engineer could not understand why it was not working properly at 1Gps but it working fine at 100Mpbs. They said they will investigate the case. I'll post any updates on that

Thanks.

K. Brouwer · ‎06-02-2016

Hi,

got the same problem as you mentioned.

I've tried almost every firmware version available.

Did TAC solve the problem and can you share it?

Thanks!

d3m.system · ‎06-02-2016

Unfortunatelly no, we could not fix the issue completely .

At the moment we are using the Gbics at 1Gbps only using this release:

Version 03.06.04.E RELEASE SOFTWARE (fc2)

I had to get rid of the old 100Mbps connections and replace those devices with 1Gbps

Something to notice though is that I'm using an apparently very old hardware revision of the Gbics. I have to get a newer model and see if the autonegotiation works in 03.07.XX or 03.08.XX

I hope this helps

tsellie · ‎11-11-2016

Ran into the same issue today on 03.09.00.E.152-5.E.

Can also confirm that 03.06.05.E.152-2.E5 works at 1Gbps.

ryanvanklaveren · ‎11-27-2016

Hey Paul,

Thanks for the feedback/info.

I'm also using IOS-XE - 03.09.00.E.152-5.E. (out of the box)

and can confirm I'm also seeing exactly the same issue.

Strange how the link comes up on the remote device, but not on the 4500X

spscisco · ‎01-30-2019

Hey,

We are also seeing the same problem.

We are using WS-C4500X-16 with code 03.09.00.E.

Has anybody managed to resolve this? We have tried both GLC-T and GLC-TE

Thanks