Feb 24, 01:37 UTC
The incident has not resurfaced for the past 90 minutes and the cloud provider has declared their incident resolved and we have stop routing around the issue.
We are resolving this issue, and we will follow up with a post-mortem once we have collected and analyzed all the data.
We apologize for the impact this may have had on your service. Please reach out to us by contacting PubNub Support (firstname.lastname@example.org
) if you wish to discuss the impact on your service.
Feb 19, 21:33 UTC
All services have been operating as expected since 18:25 UTC (10:25 PST). The underlying cloud provider hardware issue is still occurring and we are continuing to route around these known failures. We will continue to monitor this closely for at least the next 60 minutes before we determine that this incident is resolved.
Feb 19, 20:06 UTC
Currently, there are no known customer issues. The underlying cloud provider hardware issue is still occurring and we are continuing to route around these known failures. We will continue to keep an eye out for new failures and mitigate any issues they may cause.
Feb 19, 18:25 UTC
Engineering is still working to resolve the underlying issue. We will continue to provide timely updates to report any changes or progress.
Feb 19, 18:01 UTC
The engineering team has identified an underlying problem with our cloud provider's infrastructure and is taking the necessary steps to mitigate and resolve it as quickly as possible. We have routed around the failed nodes to restore service. We will remain in this posture until the underlying issue is resolved.
Feb 19, 17:09 UTC
The engineering team has identified the issue and is taking the necessary steps to mitigate and resolve it as quickly as possible. Engineering is currently routing traffic around the affected region.
Feb 19, 17:05 UTC
All services are experiencing elevated latencies in the Tokyo PoP starting at approximately 14:20 UTC (06:20 PST). PubNub Technical Staff is investigating and more information will be posted as it becomes available.
If you are experiencing issues that you believe to be related to this incident, please report the details to PubNub Support (email@example.com
Feb 19, 16:56 UTC