System outage causing service/workflow unavailability

Incident Report for Paragon

Resolved

On December 1, 2022 at 6:40 AM UTC, Paragon experienced an outage that lasted several hours. Customers on the cloud product may have experienced intermittent failures until 11:40 AM UTC.

The issue arose from a Redis cluster becoming unresponsive due to excessive CPU and memory usage. This in turn caused several microservices that relied on the Redis cache to be taken offline due to failing health checks.

Enterprise customers running on their own clouds or on managed environments were unaffected.

Posted Nov 30, 2022 - 22:40 PST