On December 9, 2022 at 19:12 UTC, we observed an increase in errors and latency for Access Manager API calls in our US East PoP. The errors and latency occurred shortly after initiating a deployment. We responded by stopping the deployment, and rerouted affected traffic.
The issue was resolved at 19:20 UTC. This issue occurred because of a misconfiguration in an infrastructure deployment.
Mitigation Steps and Recommended Future Preventative Measures
To prevent a similar issue from occurring in the future, we will fix the misconfiguration and update our system to better handle failures.