Notification Center in Cisco Catalyst Center 2.3.7.6

[Dominic Stalder]

Hi guys

I just upgraded to Cisco Catalyst Center 2.3.7.6 and saw this "new" notification center. I can see a lot of error / warning / information events corresponding to the upgrade time yesterday day evening:

Now I have two questions:

1. Are those errors "still" true or is this an historical event notification? I don't think, that they are active, otherwise the Catalyst Center would not running "normally" like it does.

2. How can I dismiss or clear those historical events from the notification center?

Thanks and best regards

Dominic

[marce1000]

       - Possibly related  : https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvy62165

  M.

[Dominic Stalder]

Hi M.

thanks, but I don't think it is in any way related to this bug.

[marce1000]

  - This one : https://www.cisco.com/c/en/us/td/docs/cloud-systems-management/network-automation-and-management/dna-center/tech_notes/b_cisco_dna_center_base_automation_services_troubleshooting_guide.html
    comes from https://www.cisco.com/c/en/us/support/cloud-systems-management/dna-center/products-tech-notes-list.html
   possibly something else in there could be useful

                   Or else invoke Cisco's TAC , 

 M.

[maflesch · Accepted solution]

Hi Dominic,

As you stated, we have beefed up the notification center in 2.3.7.6. Unfortunately, there are still some kinks we are working out as some of the checks are a little aggressive. For the managed services check, it should do this every 10 minutes and will report if the the state is determined unhealthy each time. It will then report if the state moves to a healthy state and stop reporting until it moves back to an unhealthy state.

Unfortunately there is not a way to acknowledge them. They will clear up after a day usually. To confirm your system health, you can go to the Menu → System → System 360 → System Health → Tools → Validation Tool then choose Add and create a report for the system health.

Also, you can turn of these notification if you feel they are wrong by clicking on the gear icon and unchecking System Managed Services,

[Dominic Stalder]

Hi maflesch

thanks a lot for the helpful information, just run the validation tool and it looks good. I will keep the notifcations enabled for the moment and will check tomorrow, if they are gone...

Thanks and best regards

Dominic

[Tomas de Leon · Accepted solution]

Dominic,

As you noticed after the upgrade, the notication center feature changed. This is phase 1 of the feature and there are already alot of improvements and enhancements that are coming in future releases. We have a list and if you would like to make any suggestions, please provide your comments using the "Make a Wish" tool in the Catalyst Center itself. Your feedback will be evaluated by the Product Management Team.

To answer you questions, the answer will be "it depends".

What I mean is that depending on the notification instance, the instance could be removed after some time or it may stay until the instance is addressed.

"Clearing or muting the notification instances" has been consistent feedback provided.

For the "Critical" notifications, I would suggest to look at the

/dna/systemSettings/system360/systemHealth

in the Catalyst Center UI. If the Critical Alert is there:

• Use the "Validation Tool" and run a task for "Appliance Infrastructure Status, Upgrade Readiness Status, or all of the categories"
• Collect a Support Bundle (from the UI) and collect "RCASupportBundle"
• Open a Cisco TAC Case and the TAC engineer can triage your issues and provide you a plan of action.

[Dominic Stalder]

Thanks also to you Tomas!

[Dominic Stalder]

Good morning guys

Just wanted to let you know; I checked the notification center today and the alarms from two days ago are still schown:

But I have advised my colleagues to "ignore" those alarms.

But if there will be a solution for that, that would be great. I will "make a wish".

Best regards

Dominic

[andrew.butterworth]

I've upgraded the DNAC in our lab to CC 2.3.7.6 last week and have hit a similar issue.  We have 20 errors all relating to Managed Services but with a 'PENDING_UPGRADE' in the message.

If you click on any of the Events, they expand out to this:

There are also 4 warnings - two regarding newer Trusted Certificate bundles being available and two relating to the CIMC adapter.

Any ideas how to resolve these

[maflesch]

Hi Andrew,

Unfortunately you cannot resolve this. It's a limitation to the notification center alerts that was added. We have raised the concerns with engineering and are looking to all the muting or resolving of alerts. However, this will not be available until a future release, with no set time yet. You could open a TAC case so that this case could be added to the list we already have, which will help push or show the importance of revamping this feature.

[andrew.butterworth]

OK, thanks for the update.  What do they actually mean - 20 errors with 'PENDING_UPGRADE', following an upgrade of the software gives the impression part of the upgrade isn't complete.

The CIMC warnings are due to the firmware on the C220 M5 chassis being updated to a later release than what 2.3.7.6 was tested with.  I'm happy to ignore this one, and I'm hoping I've solved the certificate warning by downloading the latest trusted certificate bundle.

[maflesch]

The alerts can be ignored. When you upgraded to 2.3.7.6 the system pushed out the new logic for the notification center while the upgrade was still going on. As such, the services reporting that they were "PENDING_UPGRADE" because at that time it was true. Unfortunately, there is no way to auto-resolve or ignore these alerts, so they persisted. That's part of the feature revamp we are pushing to engineering over this new logic.

[Eric R. Jones]

Hello Dominic, I see you upgraded to 2.3.7.6. We having an issue with a bug that gets addressed in that version for physical deployments. We received information from Cisco stating "

It is currently available only for Virtual ESXi deployments, but Catalyst Center  software release 2.3.7.6 is also available  for physical devices to upgrade, We believe this issue  has been addressed in newer release, but Catalyst Center release 2.3.7.6  is not Cisco suggested release based on software quality, stability and longevity." Have you experienced any issues besides the one your explaining here? We are on 2.3.7.4 and would like to clear this issue discovered in our scans. 

We have had our Catalyst Center since February and haven't upgraded so wondering what the steps and possible pain points are?

ej

[Eric R. Jones]

Hello Dominic, I didn't think I was going to be able to read the release notes but I did. There are are 48 bugs and the top 4 have 3 that negatively affect us in a big way.