degraded performance
Incident Report for Tanda
Performance was degraded for around 2 minutes due to a large number of background jobs coinciding with a regular database cleanup job. The clash caused delays and queue growth that in turn caused timeouts for Application and API requests. The impact was that customers processing requests (App or API) could have experienced timeouts (5xx errors) instead of successful responses.

The incident was resolved quickly (within minutes). The actions from the post mortem (tune the database cleanup job to avoid potential clash with large job spikes) are been actioned.
Posted Nov 01, 2021 - 11:00 AEST