How do I correctly to handle Architect flow timeouts when initiating bulk export jobs for digital channel interactions? We are currently using a custom flow to trigger exports for legal discovery requests. The flow receives a webhook, validates the request against our internal case management system, and then calls the bulk export API endpoint. The issue arises when the payload exceeds 500MB or contains more than 10,000 interactions. The Architect flow hangs at the HTTP request node and eventually fails with a gateway timeout. This is problematic because we need an immediate confirmation of the job ID for chain of custody documentation. The error response is generic and does not provide enough detail for debugging.
{
"status": 504,
"message": "Gateway Timeout",
"code": "http_request_timeout",
"details": "The server did not respond within the specified timeout period."
}
We have increased the timeout setting in the HTTP node to 120 seconds, but the problem persists. The environment is NICE CXone with S3 integration for storage. The API version is v2. We suspect the issue is related to the way Architect handles asynchronous responses from the bulk export service. Is there a recommended pattern for handling these long-running operations? We need to ensure that the export job is initiated successfully before the flow completes. Any guidance on best practices for this scenario would be appreciated. We are also considering using a queue-based approach, but we want to avoid adding unnecessary complexity to the flow. The current setup works for smaller exports, but it is not scalable for large legal discovery requests. We need a reliable solution that provides immediate feedback on the job status. The timezone is Europe/London, and we are operating under strict SLA requirements for data retrieval. Please share any insights or alternative approaches that you have found effective.