Re: Port 49 Failing Scheduled Diagnostic

weylin.piegorsch · ‎09-02-2015

I have several Catalyst 3850 24- and 48-P-L switches deployed on 3.7(0). On all of them, I have:

diagnostic schedule switch 1 test non-disruptive daily 0:00 cardindex 4 jobindex 1
diagnostic bootup level complete
diagnostic monitor syslog

On a number of them (not all), I'm getting the message:

Sep 2 00:00:00.511 EDT: %DIAG-3-TEST_FAIL: switch 1: DiagGoldPktTest{ID=1} has failed. Error code = 0x1 (DIAG_FAILURE)

Looking at it further, I'm either getting port 49 failing on a 48-port switch, or port 25 on a 24-port switch. Any ideas what could be the problem?

weylin

InayathUlla Sharieff · ‎09-02-2015

Weylin,

DiagGoldPktTest :
The GOLD packet Loopback test verifies the MAC level loopback
functionality. In this test, a GOLD packet, for which doppler
provides the support in hardware, is sent. The packet loops back
at MAC level and is matched against the stored packet. It is a non
-disruptive test.

source:
http://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst3850/software/release/3se/system
_management/configuration_guide/b_sm_3se_3850_cg/b_sm_3se_3850_cg_chapter_01101.html

you might be hitting the following bug;0

https://tools.cisco.com/bugsearch/bug/CSCud11268/?reffering_site=dumpcr

Could you please try to upgrade it to 03.03.03SE and update me the result.

HTH

Regards

Inayath

********please do not forget to rate this post if usefull*********

weylin.piegorsch · ‎09-03-2015

Thanks Inayath. I did find that, but that's the extent of what I was able to find on my own. I'm not sure if I have a configuration error, a hardware fault, or something else.

I tried looking at that URL, and my CCO account doesn't have permission to view that bug.

I'm already on 3.7(0)E, and this doesn't appear to be spurious:

comm1010-393es02#sh ver | i ^Switch|^\*
Switch Ports Model SW Version SW Image Mode
* 1 56 WS-C3850-48P 03.07.00E cat3k_caa-universalk9 INSTALL

comm1010-393es02#sh diagnostic events switch 1 | e Passed|^08
Diagnostic events (storage for 500 events, 70 events recorded)
Number of events matching above criteria = 70
Event Type (ET): I - Info, W - Warning, E - Error

Time Stamp         ET [Card] Event Message
------------------ -- ------ --------------------------------------------------
09/01 02:00:00.854 E [1]    DiagGoldPktTest Failed
09/01 02:00:01.057 E [1]    Minor Error Detected
09/02 02:00:00.256 E [1]    DiagGoldPktTest Failed
09/02 02:00:00.474 E [1]    Minor Error Detected
09/03 02:00:00.677 E [1]    DiagGoldPktTest Failed
09/03 02:00:00.914 E [1]    Minor Error Detected

comm1010-393es02#sh diagnostic result switch 1 failure detail

Current bootup diagnostic level: complete

switch 1: SerialNo : FOC1912X0KY

Overall Diagnostic Result for switch 1 : MINOR ERROR
Diagnostic level at card bootup: minimal

Test results: (. = Pass, F = Fail, U = Untested)

___________________________________________________________________________

1) DiagGoldPktTest:

   Port 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
   ----------------------------------------------------------------------------
         . . . . . . . . . . . . . . . . . . . . . . . .

   Port 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
   ----------------------------------------------------------------------------
         . . . . . . . . . . . . . . . . . . . . . . . .

   Port 49 50 51 52 53 54 55 56
   ----------------------------
         F . . . . . . .

          Error code ------------------> 1 (DIAG_FAILURE)
          Total run count -------------> 14
          Last test testing type ------> OnDemand
          Last test execution time ----> Sep 03 2015 02:00:00
          First test failure time -----> Aug 21 2015 02:00:00
          Last test failure time ------> Sep 03 2015 02:00:00
          Last test pass time ---------> n/a
          Total failure count ---------> 14
          Consecutive failure count ---> 14
___________________________________________________________________________

comm1010-393es02#

weylin.piegorsch · ‎06-18-2019

To "close the loop" on this thread -

I opened TAC case 680158884. It's for a different diagnostic test failure, but it's all part-and-parcel the same issue. The details are in that case, I'd share them here but I'm not sure what is / isn't covered by NDA.

Short version:

The GOLD tests listed as "non-disruptive" are only non-disruptive when ports are in their default configuration. Therefor, despite what the online documentation says, and despite with the CLI Help (aka "?") says - for any field-deployed / production switch, there's no guarantee of any test being non-disruptive, nor is there a guarantee that a perfectly good port will pass a given test unless in a default configuration.