Hosted Services Issues

[giacomos]

Good day everyone,

We are currently experiencing an issue with multiple hosted services and configuration fetches from Dashboard.

The impacted services would include:

- Device configuration fetch (all devices)

- Client VPN with Meraki Authentication

- Systems Manager enrollment (if gated behind Meraki Authentication)

- SSID scheduling

- Any other service using Meraki Authentication

- Site to Site VPNs in a few shards

Our teams are aware and are working to resolve this as promptly as possible.

The waiting times calling in are currently extended.

We will provide further updates here as we receive them.

Many thanks.

Giac

Cisco Meraki Support

[Ayala]

Hello, does it affect new devices communicating to the Meraki Cloud Services. I received my replacement MR33 and its not communicating to the Cloud. Thank you, much appreciated.

[inderdeepsingh1]

@Ayala : The issue on the below services as defined earlier as well

- Device configuration fetch (all devices)

- Client VPN with Meraki Authentication

- Systems Manager enrollment (if gated behind Meraki Authentication)

- SSID scheduling

- Any other service using Meraki Authentication

rest if you have other issue, it may or may not be due to Hosted services

[giacomos]

@Maurice_Fellay @Diego Romero Monfort , VPNs on some nodes have also been impacted. Tunnelled SSIDs and Non-Meraki tunnels would be subjected to the outage.

Existing tunnels should continue to operate normally. If they are not, I'd recommend opening a case so we can verify.

@Ayala , yes, most likely. The MR will not be able to receive the configuration from the Cloud and is therefore unlikely to come online on Dashboard.

[Maurice_Fellay]

Since the TTL time on site 2 site tunnels on default is 8 hours (28800 secs) will the simple fail if the outages continues over those 8 hours right, because some VPNs are dying while others still work.

Since when do we have these problems? exactly???? so I can prepare our clients.

Thanks

[Aaron Foster]

That's an excellent question. I just tried to spin up a new hub and the IP isn't being pushed to spokes because of outage. Fingers crossed the cloud isn't required for the tunnels to re-negotiate after the TTL expires or a circuit outage. If not, this is gonna get real interesting real quick.

[JulienV1]

It has been 4 hours now. This was a bad timing for NA East. Can we get an ETA at least?

[alejandro.macaya]

We have dropped the VPN for 26 hours.

[TrevorB]

Half a day of billables has been lost for EST. The fact that even a rough window can't be provided so we can inform our clients is ridiculous.

[RazzleDazzle]

Agreed. Also in NA EST. Meraki needs to have a solid ETA and needs to provide a status page moving forward. This is a very poor reflection on Meraki's reliability and service. Not the service expected for the prices Meraki charges.

[giacomos]

@Maurice_Fellay , it would very much be subject to when they rekeyed last.

The issues has surfaced around 2:00 PM BST

Many thanks.

Giac

Meraki Support

[micronet_info]

@giacomos any updates regarding the resolution or ETA for fix to be implemented?

[alejandro.macaya]

- Client VPN with Meraki Authentication, We declared the problem 26 hours ago, case 06834937. A faster solution is required. other organizations begin to be affected.

[giacomos]

@alejandro.macaya , your original case may not be related to the outage here, but it will likely be impacted throughout today.

Please continue to work with our Support team to continue investigating what the root cause would be.

Many thanks.

Giac

Meraki Support

[wrespawn]

Throwing in that my SSID is down as well. Last year I was almost sold on switching all our P2P VPN devices with Meraki ones. Decided to renew with what we had, I am so glad I dont have 27 stores offline right now. Just a little bit of WIFI outage isnt brutal for this organization. I will remember this day for years to come next time I get a sales call from Meraki. For sure impacted future business.

[BigMtnIT]

Starting to get a flood of calls from my customers for Client VPN authentication errors. Site to Site still working thankfully. We need this resolved ASAP. .