Resolved
All processing of delayed invoices has been completed.
Monitoring
We are steadily seeing all previously delayed invoices process through our system. We will post a final status when we have confirmed all systems are back to normal.
Monitoring
A fix has been deployed and we are actively monitoring the system to confirm full recovery. All uploads that were impacted by the outage are being reprocessed and should start showing up as invoices as processes complete.
Identified
Our team has identified the root cause of the invoice processing issue where uploaded files were not being processed into invoices. We are still working on the hotfix for the issue and testing that everything works.
As a workaround, non-digital PDFs are not impacted by the issue, so uploading an invoice as a non-digital PDF will fully process.
We'll have our next update within an hour.
Identified
Our team has identified the root cause of the invoice processing issue where uploaded files were not being processed into invoices. Currently, we are deploying a hotfix to unblock upload processing. After the hotfix is fully deployed, we will reprocess all uploads that were stuck in our processing pipeline. As the processing completes, invoices will show up as expected.
We have also assessed the impact of the incident - files uploaded as non-digital PDFs (ex. screenshot of an invoice) are not impacted by the incident. Other image types, including PNG, JPEG, and digital PDF are affected. As a workaround, invoices uploaded as a non-digital PDF will be processed normally.
We'll have our next update within an hour.
Investigating
We are currently investigating reports of invoices not showing up in accounts after being uploaded.
Currently, our system is ingesting and saving files, but our process for converting the files to invoices and completing digitization is experiencing an outage.
Our engineering team has been alerted and is actively looking into the issue. We will provide an update within 60 minutes.