Google Cloud Networking Incident #19016

google cloud incident

Google Cloud Networking Incident #19016

Cloud Networking issues in us-east1, Incident began at 2019-07-02 10:25 (all times are US/Pacific).

Jul 02, 201916:05The disruptions with Google Cloud Networking and Load Balancing have been root caused to physical damage to multiple concurrent fiber bundles serving network paths in us-east1, and we expect a full resolution within the next 24 hours.In the meantime, we are electively rerouting traffic to ensure that customers’ services will continue to operate reliably until the affected fiber paths are repaired. Some customers may observe elevated latency during this period.We will provide another status update either as the situation warrants or by Wednesday, 2019-07-03 12:00 US/Pacific tomorrow.
Jul 02, 201914:31The disruptions with Google Cloud Networking and Load Balancing have been root caused to physical damage to multiple concurrent fiber bundles serving network paths in us-east1. We are electively rerouting some traffic to ensure that customers’ services will continue to operate reliably until the affected fiber paths are repaired. Some customers will observe elevated latency during this period.We will provide another status update by Tuesday, 2019-07-02 16:30 US/Pacific with current details.
Jul 02, 201912:39Mitigation work is currently underway to address the issue with Google Cloud Networking and Load Balancing in us-east1. The rate of errors has decreased, however some users may still notice elevated latency, and our Engineering Team is continuing to work on it. We will provide another status update by Tuesday, 2019-07-02 14:30 US/Pacific with current details.
Jul 02, 201911:35Mitigation work is currently underway by our Engineering Team to address the issue with Google Cloud Networking and Load Balancing in us-east1. The rate of errors is decreasing, however some users may still notice elevated latency. We will provide another status update by Tuesday, 2019-07-02 12:30 US/Pacific with current details.
Jul 02, 201910:56We continue to experience an issue with Cloud Networking and Load balancing within us-east1. Issue is currently mitigated and we are working towards a resolution. Customers may still observe traffic through Global Load balancers being directed away from backends in us-east1 at this time. We will provide an update by Tuesday, 2019-07-02 11:29 US/Pacific with current details.
Jul 02, 201910:25We continue to experience an issue with Cloud Networking within us-east1. Issue is currently mitigated and we are working towards a resolution. Customers may still observe traffic through Global Load-balancers being directed away from back-ends in us-east1 at this time. We will provide an update by Tuesday, 2019-07-02 11:29 US/Pacific with current details.

Check status and Incident update here

5/5 (4 Reviews)