cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1148
Views
10
Helpful
2
Replies

QOS Syslog Errors

Joe_E
Level 1
Level 1

I am attempting to troubleshoot what I believe to be a QOS misconfiguration on a 3750G. I am getting the errors displayed in the Syslog below:
I would also like validation that the logging informational configuration logs all syslog messages from informational up to emergency please.
This is in a production environment, so downtime can't happen. I am not getting customer complaints, so this is not critical.

 

Syslog logging: enabled (904 messages dropped, 1 messages rate-limited, 0 flushes, 0 overruns, xml disabled, filtering disabled)
Console logging: disabled
Monitor logging: level debugging, 0 messages logged, xml disabled,
filtering disabled
Buffer logging: level informational, 2084223 messages logged, xml disabled,
filtering disabled
Exception Logging: size (4096 bytes)
Count and timestamp logging messages: disabled
File logging: disabled
Trap logging: level informational, 6533711 message lines logged
Logging to 10.8.88.5, 181022 message lines logged, xml disabled,
filtering disabled

Log Buffer (4096 bytes):
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/19
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/19
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/19
46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC
46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/36
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/36
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/36
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/19
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/19
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/19
46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC
46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/36
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/36
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/36
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/43
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/19
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of master:HQM_IDBTRUST_CMD command failed on GigabitEthernet1/0/19
46w3d: %QOSMGR-4-COMMAND_FAILURE: Execution of Set trust type from Trust Boundary command failed on Gi1/0/19
46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC

below is the QOS portion of my running config as well as the two affected switchports:

mls qos map cos-dscp 0 8 16 26 32 46 48 56
mls qos srr-queue input bandwidth 90 10
mls qos srr-queue input threshold 1 8 16
mls qos srr-queue input threshold 2 34 66
mls qos srr-queue input buffers 67 33
mls qos srr-queue input cos-map queue 1 threshold 2 1
mls qos srr-queue input cos-map queue 1 threshold 3 0
mls qos srr-queue input cos-map queue 2 threshold 1 2
mls qos srr-queue input cos-map queue 2 threshold 2 4 6 7
mls qos srr-queue input cos-map queue 2 threshold 3 3 5
mls qos srr-queue input dscp-map queue 1 threshold 2 9 10 11 12 13 14 15
mls qos srr-queue input dscp-map queue 1 threshold 3 0 1 2 3 4 5 6 7
mls qos srr-queue input dscp-map queue 1 threshold 3 32
mls qos srr-queue input dscp-map queue 2 threshold 1 16 17 18 19 20 21 22 23
mls qos srr-queue input dscp-map queue 2 threshold 2 33 34 35 36 37 38 39 48
mls qos srr-queue input dscp-map queue 2 threshold 2 49 50 51 52 53 54 55 56
mls qos srr-queue input dscp-map queue 2 threshold 2 57 58 59 60 61 62 63
mls qos srr-queue input dscp-map queue 2 threshold 3 24 25 26 27 28 29 30 31
mls qos srr-queue input dscp-map queue 2 threshold 3 40 41 42 43 44 45 46 47
mls qos srr-queue output cos-map queue 1 threshold 3 5
mls qos srr-queue output cos-map queue 2 threshold 3 3 6 7
mls qos srr-queue output cos-map queue 3 threshold 3 2 4
mls qos srr-queue output cos-map queue 4 threshold 2 1
mls qos srr-queue output cos-map queue 4 threshold 3 0
mls qos srr-queue output dscp-map queue 1 threshold 3 40 41 42 43 44 45 46 47
mls qos srr-queue output dscp-map queue 2 threshold 3 24 25 26 27 28 29 30 31
mls qos srr-queue output dscp-map queue 2 threshold 3 48 49 50 51 52 53 54 55
mls qos srr-queue output dscp-map queue 2 threshold 3 56 57 58 59 60 61 62 63
mls qos srr-queue output dscp-map queue 3 threshold 3 16 17 18 19 20 21 22 23
mls qos srr-queue output dscp-map queue 3 threshold 3 32 33 34 35 36 37 38 39
mls qos srr-queue output dscp-map queue 4 threshold 1 8
mls qos srr-queue output dscp-map queue 4 threshold 2 9 10 11 12 13 14 15
mls qos srr-queue output dscp-map queue 4 threshold 3 0 1 2 3 4 5 6 7
mls qos queue-set output 1 threshold 1 138 138 92 138
mls qos queue-set output 1 threshold 2 138 138 92 400
mls qos queue-set output 1 threshold 3 36 77 100 318
mls qos queue-set output 1 threshold 4 20 50 67 400
mls qos queue-set output 2 threshold 1 149 149 100 149
mls qos queue-set output 2 threshold 2 118 118 100 235
mls qos queue-set output 2 threshold 3 41 68 100 272
mls qos queue-set output 2 threshold 4 42 72 100 242
mls qos queue-set output 1 buffers 10 10 26 54
mls qos queue-set output 2 buffers 16 6 17 61
mls qos
!

****Omitted Portion****

!
interface GigabitEthernet1/0/19
switchport access vlan 64
switchport voice vlan 875
srr-queue bandwidth share 10 10 60 20
srr-queue bandwidth shape 10 0 0 0
queue-set 2
mls qos trust device cisco-phone
mls qos trust cos
auto qos voip cisco-phone
spanning-tree portfast
end

!
interface GigabitEthernet1/0/43
switchport access vlan 64
switchport voice vlan 875
srr-queue bandwidth share 10 10 60 20
srr-queue bandwidth shape 10 0 0 0
queue-set 2
mls qos trust device cisco-phone
mls qos trust cos
auto qos voip cisco-phone
spanning-tree portfast

 


Thank you all for your input and feedback.

Joe

1 Accepted Solution

Accepted Solutions

Mark Malone
VIP Alumni
VIP Alumni
Hi
you have a memory alloc fail in your logs , software could be leaking memory with a specific bug , I would move off that software version first to mitigate that issue, you could run the full show tech through teh cli analyzer and it may give you the exact bug id , but malloc failures are usually leaks in software

46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC

View solution in original post

2 Replies 2

Mark Malone
VIP Alumni
VIP Alumni
Hi
you have a memory alloc fail in your logs , software could be leaking memory with a specific bug , I would move off that software version first to mitigate that issue, you could run the full show tech through teh cli analyzer and it may give you the exact bug id , but malloc failures are usually leaks in software

46w3d: %SYS-2-MALLOCFAIL: Memory allocation of 1696 bytes failed from 0x26C050, alignment 8
Pool: I/O Free: 6512 Cause: Memory fragmentation
Alternate Pool: None Free: 0 Cause: No Alternate pool

-Process= "Pool Manager", ipl= 0, pid= 5
-Traceback= 8A4200 BE9EFC BEDBA8 26C054 2708E8 270A3C 7599A8 753BEC

Mark makes an excellent point about the common reason for tracebacks and the IOS version you're using.

For a 3750G, unless you need newer IOS features, perhaps the most solid version to use would be 12.2(55)SE12.