cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
5473
Views
5
Helpful
5
Replies

C3850 after upgrade software some strange log show up

tianwen.zhao
Level 1
Level 1

Hi everyone

 

I upgraded the switches to 16.3.6 a few days ago.

 

Switch Ports Model SW Version SW Image Mode
------ ----- ----- ---------- ---------- ----
* 1 16 WS-C3850-12XS 16.3.6 CAT3K_CAA-UNIVERSALK9 INSTALL
2 32 WS-C3850-24S 16.3.6 CAT3K_CAA-UNIVERSALK9 INSTALL
3 56 WS-C3850-48T 16.3.6 CAT3K_CAA-UNIVERSALK9 INSTALL

 

some strange log in show logging

 

#show logg

Feb 17 08:47:52.017 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: limited space - copy corefiles/switch-reports out of flash:core & crashinfo:
directories. crashinfo: value 100% (245 MB) exceeds warning level 80% (196 MB)
Feb 17 09:09:42.063 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: 5-Minute Load Average value 5.05 exceeds warning level 5.00
Feb 17 09:27:52.083 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: crashinfo: usage has returned to appropriate level. value 28% (68 MB) is below
warning level 80% (196 MB)

Feb 19 08:17:58 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: limited space - copy corefiles/switch-reports out of flash:core & crashinfo:
directories. crashinfo: value 83% (204 MB) exceeds warning level 80% (196 MB)
Feb 19 08:42:57 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: crashinfo: usage has returned to appropriate level. value 26% (62 MB) is below warning
level 80% (196 MB)

 

It seemed to the directories of crashinfo   had limited space about coping corefiles

And I also think it is a bug cause

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvc14038/?rfs=iqvred&tdsourcetag=s_pcqq_aiomsg

 

Considering the operation time , I will upgrade the switches again a few days later......I think the 16.03.07 will be fine

But I want to do some mitigation 

 

Before upgrade switches:

Directory of crashinfo:/

11 -rw- 0 Jan 1 1970 08:00:08 +08:00 koops.dat
12 -rw- 32780 Oct 3 2018 15:05:24 +08:00 cilogs
13 -rw- 412 Oct 3 2018 14:42:49 +08:00 last_systemreport_log
14 -rw- 839886 Mar 10 2017 15:06:34 +08:00 system-report_1_20170310-070558-UTC.gz
15 -rw- 39 Oct 3 2018 14:42:49 +08:00 last_systemreport
16 -rw- 261325 Mar 10 2017 16:32:15 +08:00 system-report__20170310-083201-UTC.gz
17 -rw- 951805 Mar 11 2017 09:20:07 +08:00 system-report_1_20170311-011928-UTC.gz
18 -rw- 993384 Mar 11 2017 14:20:19 +08:00 system-report_1_20170311-061940-UTC.gz
19 -rw- 3733316 Oct 3 2018 13:30:52 +08:00 system-report_1_20181003-053011-UTC.gz
20 -rw- 2225810 Oct 3 2018 14:42:46 +08:00 system-report_1_20181003-064207-UTC.gz
22 -rw- 2410197 Oct 3 2018 15:06:07 +08:00 switch_report_1_20181003-070521.gz

251808768 bytes total (238198784 bytes free)

 

After upgrade switches:

Directory of crashinfo:/

11 -rw- 0 Jan 1 1970 08:00:08 +08:00 koops.dat
12 -rw- 32780 Oct 3 2018 15:05:24 +08:00 cilogs
13 -rw- 412 Oct 3 2018 14:42:49 +08:00 last_systemreport_log
14 -rw- 839886 Mar 10 2017 15:06:34 +08:00 system-report_1_20170310-070558-UTC.gz
15 -rw- 39 Oct 3 2018 14:42:49 +08:00 last_systemreport
16 -rw- 261325 Mar 10 2017 16:32:15 +08:00 system-report__20170310-083201-UTC.gz
17 -rw- 951805 Mar 11 2017 09:20:07 +08:00 system-report_1_20170311-011928-UTC.gz
18 -rw- 993384 Mar 11 2017 14:20:19 +08:00 system-report_1_20170311-061940-UTC.gz
19 -rw- 3733316 Oct 3 2018 13:30:52 +08:00 system-report_1_20181003-053011-UTC.gz
20 -rw- 2225810 Oct 3 2018 14:42:46 +08:00 system-report_1_20181003-064207-UTC.gz
21 -rw- 0 Feb 4 2019 19:57:09 +08:00 tracelogs.REF
6169 drwx 1024 Feb 4 2019 20:33:26 +08:00 ap_crash
22 -rw- 2410197 Oct 3 2018 15:06:07 +08:00 switch_report_1_20181003-070521.gz
14393 drwx 32768 Feb 19 2019 12:28:41 +08:00 tracelogs

251808768 bytes total (180280320 bytes free)

 

There are a few more files created in crashinfo:/

 the file tracelogs.REF or tracelogs in crashinfo:/ can be deleted ? So that the switches have more space

 

Thank you for any answers

 

1 Accepted Solution

Accepted Solutions

Hi,

 

CSCvc14038 "3650/3850 :: Crashinfo: filesystem high utilization with only default traces enabled"  Open a TAC Case or you can upgrade to known fix release.
 
BR
Tayyab
 
 
*** Please rate all helpful responses and mark solutions***

View solution in original post

5 Replies 5

Leo Laohoo
Hall of Fame
Hall of Fame

@tianwen.zhao wrote:

Feb 19 08:17:58 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: limited space - copy corefiles/switch-reports out of flash:core & crashinfo:
directories. crashinfo: value 83% (204 MB) exceeds warning level 80% (196 MB)
Feb 19 08:42:57 UTC: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: crashinfo: usage has returned to appropriate level. value 26% (62 MB) is below warning 

Raise a TAC Case. 

I think this is CSCvc14038.

recommended version,....nough said

Please remember to rate useful posts, by clicking on the stars below.

Hi,

 

CSCvc14038 "3650/3850 :: Crashinfo: filesystem high utilization with only default traces enabled"  Open a TAC Case or you can upgrade to known fix release.
 
BR
Tayyab
 
 
*** Please rate all helpful responses and mark solutions***

keylew
Level 1
Level 1

experiencing the same bug.  did deleting these files fix the issue?  does it have to be done individually or can it be done for the stack?  and what were the commands you used to delete these files???

No,I upgrade to another version to fix this issue.
Thanks.
Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Innovations in Cisco Full Stack Observability - A new webinar from Cisco