Resolved -
This incident has been resolved.
Aug 5, 01:35 UTC
Monitoring -
We've implemented some improvements to our batch job processing infrastructure, and have observed that it is keeping up with incoming batch jobs.
We're continuing to monitor for further delays or issues.
Jul 30, 16:58 UTC
Identified -
The fixes implemented earlier helped the situation temporarily, but the batch system has fallen behind again.
This is impacting the rate at which customer jobs are being completed.
We are working on a solution.
Jul 30, 12:33 UTC
Monitoring -
A fix has been implemented and we are monitoring the results.
Jul 29, 10:23 UTC
Identified -
Our batch job processing system fell behind, processing is resuming with the backlog of jobs. (There is no need to re-submit any jobs.)
We're expecting the system to be caught up by 10:00 UTC.
Jul 29, 08:51 UTC