I've been looking at workflow orchestration tools for systems where the workflow itself is becoming a real part of the backend, rather than just scheduling a few jobs.
The distinction I'm trying to understand is where people draw the line between something like Airflow/Prefect, Temporal, Step Functions, Conductor, etc. and a more general workflow orchestration platform.
For me, the requirements are roughly:
multi-step workflows across APIs and services
retries/timeouts without rebuilding the logic around every API call
long-running workflows and scheduled execution
branching, parallel execution and dependencies
visibility into individual workflow runs and failed steps
human approval/manual intervention when required
ideally support for AI/LLM steps without making the whole workflow agentic
The last point is becoming more relevant too. A lot of the newer ""AI workflow"" tooling seems to assume that the model should make most of the decisions. I'm more interested in workflows where deterministic code handles deterministic things and AI is just one step when it actually adds value.
For teams running this in production, what are you using today?
And more importantly, what made you choose it over the other workflow orchestration tools you evaluated?