On the other proper working servers, a 30MB/ps is common or greater. GigE uplink. On these 2 servers, 200Kb/s or less is common and the issue. I can rarely break 1MB/s. I did a quick intranet test, doing scp from my NAS to one of the problematic servers, slow 300-400KB/s transfer. NAS to a good server via intranet, scp method is normal 20-30+MB/s transfer. No QoS, NAT on switch. I have dual failover drops (Ethernet) from the data center upstream (blended bandwidth).These are Broadcom NICs. The servers are running with SSD, RAID 0 on H700 PERC. I have similar good servers with the same exact config with no issue.
[root@server2 ~]# lspci -v | grep Ethernet -A 1
01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
Subsystem: Dell PowerEdge R610 BCM5709 Gigabit Ethernet
Flags: bus master, fast devsel, latency 0, IRQ 36
--
01:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
Subsystem: Dell PowerEdge R610 BCM5709 Gigabit Ethernet
Flags: bus master, fast devsel, latency 0, IRQ 48
--
02:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
Subsystem: Dell PowerEdge R610 BCM5709 Gigabit Ethernet
Flags: bus master, fast devsel, latency 0, IRQ 32
--
02:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
Subsystem: Dell PowerEdge R610 BCM5709 Gigabit Ethernet
Flags: bus master, fast devsel, latency 0, IRQ 42
[root@server2 ~]# ethtool em1
Settings for em1:
Supported ports: [ TP ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: Yes
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Speed: 1000Mb/s
Duplex: Full
Port: Twisted Pair
PHYAD: 1
Transceiver: internal
Auto-negotiation: on
MDI-X: off
Supports Wake-on: g
Wake-on: d
Link detected: yes
[root@localhost ~]# ethtool -i em1
driver: bnx2
version: 2.2.6
firmware-version: 7.12.19 bc 7.10.0 NCSI 2.0.13
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: no
Output from switch on the 2 ports...
Cisco3750#show interface Gi1/0/13
GigabitEthernet1/0/13 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 001f.6c8a.938d (bia 001f.6c8a.938d)
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 1000 bits/sec, 1 packets/sec
23470 packets input, 5854358 bytes, 0 no buffer
Received 12 broadcasts (5 multicasts)
Cisco3750#show interface Gi1/0/12
GigabitEthernet1/0/12 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 001f.6c8a.938c (bia 001f.6c8a.938c)
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, media type is 10/100/1000BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:01, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 3000 bits/sec, 5 packets/sec
5 minute output rate 182000 bits/sec, 6 packets/sec
286214 packets input, 35687041 bytes, 0 no buffer
Received 29 broadcasts (23 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 23 multicast, 0 pause input
0 input packets with dribble condition detected
479017 packets output, 484189224 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out
Cisco VLAN Output
VLAN Name Status Ports
---- -------------------------------- --------- -------------------------------
2 VLAN2 active Gi1/0/13
93 VLAN93 active Gi1/0/12
Cisco3750#show run interface g1/0/12
Building configuration...
Current configuration : 115 bytes
!
interface GigabitEthernet1/0/12
switchport access vlan 93
switchport mode access
speed 1000
duplex full
end
Cisco3750#show run interface g1/0/13
Building configuration...
Current configuration : 114 bytes
!
interface GigabitEthernet1/0/13
switchport access vlan 2
switchport mode access
speed 1000
duplex full
end
