Feed aggregator

Incident began at 2024-04-24 15:00 and ended at 2024-04-24 21:17 (times are in Coordinated Universal Time (UTC)).

The issue with users creating unauthenticated support cases for account recovery help using toolbox has been resolved for all affected users as of Wednesday, 2024-04-24 14:17 US/Pacific.

From our preliminary analysis, the root cause of the issue is a recent roll out. Our engineers rolled back to last stable version hence mitigating the issue.

We thank you for your patience while we worked on resolving the issue.

Affected products: Google Workspace Support

Incident began at 2024-04-24 15:00 and ended at 2024-04-24 21:17 (times are in Coordinated Universal Time (UTC)).

Summary:

Workspace Super Admins trying to open unauthenticated support cases for account recovery help using toolbox are encountering 500 errors and unable to open support cases for account recovery.

We will provide an update by Wednesday, 2024-04--24 14:45 US/Pacific with current details.

Workaround:

Customers having issues opening the account recovery cases can use https://support.google.com/a/contact/recovery_form to contact support until the issue is resolved.

Affected products: Google Workspace Support

Incident began at 2024-04-22 11:10 and ended at 2024-04-23 16:50 (times are in Coordinated Universal Time (UTC)).

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support or to Google Workspace Support using help article https://support.google.com/a/answer/1047213.

(All Times US/Pacific)

Incident Start: 22 April 2023 04:10

Incident End: 23 April 2023 09:50

Duration: 1 day, 5 hours, 40 mins

Affected Services and Features: Classroom

Regions/Zones: us-east1

Description:

Google Classroom experienced an increased error rate in Brazil (for the State of Paraná) due to hotspotting (overloading) in the product’s database for a duration of 1 day, 5 hours, 40 mins. From preliminary analysis, the root cause of hotspotting was a software bug, which we’ve fixed.

Customer Impact:

A subset of users in the state of Paraná, Brazil had encountered intermittent errors while accessing Google Classroom. To the best of our knowledge, no other customers were impacted.

Affected products: Classroom

Incident began at 2024-04-22 12:00 and ended at 2024-04-23 18:02 (times are in Coordinated Universal Time (UTC)).

The issue with Classroom has been resolved for all affected users as of Tuesday, 2024-04-23 11:02 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

Affected products: Classroom

Incident began at 2024-04-22 12:00 (times are in Coordinated Universal Time (UTC)).

Summary:

Google Classroom is experiencing an increased error rate in Brazil (for State of Paraná)

Description:

Mitigation work is currently underway by our engineering team.

The mitigation is expected to complete by Tuesday, 2024-04-23 12:30 US/Pacific.

We will provide more information by Tuesday, 2024-04-23 12:45 US/Pacific.

Customer Symptoms:

A subset of users in the state of Parana, Brazil would encounter intermittent error while accessing Google Classroom. However, the impact is only limited to the state of Parana, no impact to customers to the rest of the world.

Workaround:

None at this time.

Affected products: Classroom

Incident began at 2024-04-22 12:00 (times are in Coordinated Universal Time (UTC)).

Summary:

Google Classroom is experiencing an increased error rate in Brazil (for State of Paraná)

Description:

We are experiencing an intermittent issue with Google Classroom.

Our engineering team continues to investigate the issue.

We will provide an update by Tuesday, 2024-04-23 09:00 US/Pacific with current details.

Customer Symptoms:

A subset of users in the state of Parana, Brazil would encounter intermittent error while accessing Google Classroom. However, the impact is only limited to the state of Parana, no impact to customers to the rest of the world.

Workaround:

None at this time.

Affected products: Classroom

Incident began at 2024-04-18 21:40 and ended at 2024-04-20 19:23 (times are in Coordinated Universal Time (UTC)).

A mini incident report has been posted at https://www.google.com/appsstatus/dashboard/incidents/XKnCyj2ED7njHXsC7a6E

Affected products: Google Calendar

Incident began at 2024-04-18 21:40 and ended at 2024-04-20 19:23 (times are in Coordinated Universal Time (UTC)).

A mini incident report has been posted at https://www.google.com/appsstatus/dashboard/incidents/XKnCyj2ED7njHXsC7a6E

Affected products: Google Chat

Incident began at 2024-04-18 21:40 and ended at 2024-04-20 19:23 (times are in Coordinated Universal Time (UTC)).

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Workspace Support using the help article https://support.google.com/a/answer/1047213.

(All Times US/Pacific)

Incident Start: 18 April 2024 14:40

Incident End: 20 April 2024 12:23

Duration: 1 day, 21 hours, 43 minutes

Affected Services and Features: Gmail, Google Calendar, Google Chat

Regions/Zones: Global

Description:

Gmail, Google Calendar and Google Chat experienced issues with “Contact Sharing” for a duration of 1 day, 21 hours, 43 minutes.

From the preliminary analysis, the root cause of the issue was a rollout that led to an unexpected change to the “Directory Settings” policy causing “Contact Sharing” to be disabled for users.

Google engineers mitigated the issue on 20 April 2024 at 12:23 US/Pacific by reverting to a previous stable release and took additional actions to re-enable "Contact Sharing" for all affected users.

Google will complete a full IR in the following days that will provide a detailed root cause.

Customer Impact:

• Affected users may not have seen a contact list in Gmail, but would still have been able to send mail.

• Affected users could not find profile information in Google Contacts and other Google services.

• Autocomplete of the individual and group addresses as users entered them was affected.

• Searching for users and intelligent meeting room suggestions in Google Calendar was affected.

• Profile information cards that opened when users pointed to or tapped on someone’s profile image were impacted as well.

Affected products: Gmail

Incident began at 2024-04-19 14:12 and ended at 2024-04-20 19:23 (times are in Coordinated Universal Time (UTC)).

The problem with Gmail, Google Calendar, Google Chat has been resolved. We apologize for the inconvenience and thank you for your patience and continued support.

Affected products: Gmail

Incident began at 2024-04-19 14:12 and ended at 2024-04-20 19:23 (times are in Coordinated Universal Time (UTC)).

The problem with Gmail, Google Calendar, Google Chat has been resolved. We apologize for the inconvenience and thank you for your patience and continued support.

Affected products: Google Chat

Incident began at 2024-04-19 14:12 and ended at 2024-04-20 19:23 (times are in Coordinated Universal Time (UTC)).

The problem with Gmail, Google Calendar, Google Chat has been resolved. We apologize for the inconvenience and thank you for your patience and continued support.

Affected products: Google Calendar

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Further communication will be provided on the below link.

https://www.google.com/appsstatus/dashboard/incidents/XKnCyj2ED7njHXsC7a6E

Affected products: Google Calendar

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Further communication will be provided on the below link.

https://www.google.com/appsstatus/dashboard/incidents/XKnCyj2ED7njHXsC7a6E

Affected products: Google Chat

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Summary:

Gmail , Chat and Calendar customers experiencing issues with Contact sharing

Description:

Our Engineering team has identified the root cause of the issue and is deploying the appropriate mitigations.

The issue is expected to be resolved by Saturday 2024-04-20 13:00 US/Pacific.

We will provide more information by Saturday 2024-04-20 13:00 US/Pacific.

Diagnosis:

Customers for Gmail, Chat, Calendar may experience "Contact Sharing" disabled. Users may not see an address list in Gmail, but will still be able to send email.

Workaround:

None at this time.

Affected products: Gmail

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Summary:

Gmail , Chat and Calendar customers experiencing issues with Contact sharing

Description:

Our Engineering team has identified the root cause of the issue and rolled back a recent change.

Our engineers have started to deploy mitigations to affected customers, but will take some time to fully propagate.

We do not have an ETA for full resolution at this point.

We will provide more information by Friday, 2024-04-19 16:30 US/Pacific.

Diagnosis:

Customers for Gmail, Chat, Calendar may experience "Contact Sharing" disabled. Users may not see an address list in Gmail, but will still be able to send email.

Workaround:

None at this time.

Affected products: Gmail

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Further communication will be provided on the below link.

https://www.google.com/appsstatus/dashboard/incidents/XKnCyj2ED7njHXsC7a6E

Affected products: Google Calendar

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Further communication will be provided on the below link.

https://www.google.com/appsstatus/dashboard/incidents/XKnCyj2ED7njHXsC7a6E

Affected products: Google Chat

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Our Engineering team has identified the root cause of the issue and rolled back a recent change.

Our engineers are taking additional repair actions for the rollback to take effect for the impacted customers.

We do not have an ETA for mitigation at this point.

We will provide more information by Friday, 2024-04-19 14:00 US/Pacific.

Affected products: Google Calendar

Incident began at 2024-04-19 14:12 (times are in Coordinated Universal Time (UTC)).

Our Engineering team has identified the root cause of the issue and rolled back a recent change.

Our engineers are taking additional repair actions for the rollback to take effect for the impacted customers.

We do not have an ETA for mitigation at this point.

We will provide more information by Friday, 2024-04-19 14:00 US/Pacific.

Affected products: Google Chat