Resolved -
Engineering has fixed the underlying issues regarding the workflow processing delays. We will continue working on a customer-by-customer basis on any ongoing follow-up remediation actions. A root cause analysis is available upon request and can be provided by your Customer Success Manager. If you have any further questions regarding this incident please reach out to
support@iterable.com
Mar 3, 12:59 PST
Update -
Our engineering team is continuing work on reconciling workflow stuck user data to be shared with the subset of impacted customers. We will continue working with these customers directly. If you have any questions please contact
support@iterable.com or your account manager.
Feb 23, 12:16 PST
Update -
The engineering team continues to work on remediating the stuck workflow visitors for the affected customers. If you have any questions about this issue, please email
support@iterable.com
Feb 20, 13:56 PST
Update -
We continue to work with the affected customers on remediating the stuck workflow visitor issue. Next update at 2pm PST.
Feb 20, 10:00 PST
Monitoring -
Our engineering team is continuing to work with the subset of impacted customers on remediations regarding the stuck workflow visitors. Work will continue through the night with the next update tomorrow at 10 am PST
Feb 19, 19:52 PST
Update -
Engineering work on the restore process continues to make progress for the impacted customers and workflows. Next update at 6 PM PST
Feb 19, 15:34 PST
Update -
Work continues to retroactively restore and process the delayed data as well as gather impacted users for affected clients. All new/current workflows continue to operate as normal. Next update at 3 pm PST.
Feb 19, 12:22 PST
Update -
Work continues to retroactively restore and process the delayed data, all new/current workflows continue to operate as normal. Next update at 12 pm PST.
Feb 19, 09:58 PST
Update -
Our engineering team is continuing to work on restoring data from older queues. Next update at 10 AM PST.
Feb 19, 00:04 PST
Update -
Most of the workflows are processing and we have restored most of the data from older queues. Our engineering team is continuing to work on this. Next update at 12 AM PST.
Feb 18, 22:22 PST
Update -
We have started processing delayed workflow users and our engineering team is monitoring the systems. We appreciate your patience as our engineering team worked on this. If you have questions or concerns, please reach out to your account manager or support at
support@iterable.com. Next update at 10 PM PST
Feb 18, 20:23 PST
Update -
Our engineering team is continuing work on a fix for the delayed workflow users. Next update at 8 PM PST
Feb 18, 18:12 PST
Identified -
We have identified the underlying issue and have put a fix in place to allow the processing of new workflow visitors for the subset of impacted customers. We are continuing work on a fix to address the current delayed workflow users impacted by the workflow processing delays from earlier today. Next update will be at 6 PM PST
Feb 18, 16:11 PST
Update -
We are continuing to investigate and make progress on the cause of the workflow processing delays that are impacting a subset of customers. Next update at 4 pm PST
Feb 18, 14:07 PST
Investigating -
Currently a subset of customers are experiencing workflow processing delays. No data is being lost, only delayed. We are continuing to investigate the underlying cause as well as taking steps to mitigate the issue. Next update at 2 pm PST.
Feb 18, 12:48 PST
