A curated list of awesome open source workflow engines
- Airflow
- Python-based platform for running directed acyclic graphs (DAGs) of tasks
- Argo Workflows
- Open source container-native workflow engine for getting work done on Kubernetes
- Azkaban
- Batch workflow job scheduler created at LinkedIn to run Hadoop jobs.
- Brigade
- Brigade is a tool for running scriptable, automated tasks in the cloud โ as part of your Kubernetes cluster.
- CabloyJS
- A Node.js full-stack framework with workflow engine, based on koa + egg + vue + framework7.
- Cadence
- An orchestration engine to execute asynchronous long-running business logic developed by Uber Engineering.
- Camunda
- BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
- CDS
- Enterprise-grade continuous delivery & DevOps automation open source platform developped by OVHcloud.
- CGraph
- A simple-used and cross-platform DAG framework based on C++17 without any 3rd-party.
- CloudSlang
- Workflow engine to automate your DevOps use cases.
- Conductor
- Netflix's Conductor is a microservices orchestration platform that enables developers to build scalable, durable application flows. Conductor workflows are language and framework agnostic. Conductor is built by Netflix, Orkes and team of open source contributors.
- Copper
- A high performance Java workflow engine.
- Couler
- Unified interface for constructing and managing workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
- Covalent
- Workflow orchestration platform for quantum and high performance computing.
- Cromwell
- Workflow engine written in Scala and designed for simplicity and scalability. Executes workflows written in WDL or CWL.
- Cylc
- Workflow engine that orchestrates complex distributed workflows with cyclic or acyclic graphs. It was originally designed to automate weather forecasting systems at NIWA.
- Dagu
- A No-code workflow executor. It executes workflows from declarative YAML definitions.
- Dagster
- Data orchestrator for machine learning, analytics, and ETL.
- DigDag
- Digdag is a simple tool that helps you to build, run, schedule, and monitor complex pipelines of tasks.
- DolphinScheduler
Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.
- elsa-workflows
- A .NET Standard 2.0 Workflows Library.
- easy-rules
- The simple, stupid rules engine for Java.
- FireWorks
- FireWorks stores, executes, and manages calculation workflows.
- Fission Workflows
- A high-perfomant workflow engine for serverless functions on Kubernetes.
- Flor
- A workflow engine written in Ruby.
- Flyte
- A container-native, type-safe workflow and pipelines platform optimized for large scale processing and machine learning written in Golang. Workflows can be written in any language, with out of the box support for Python.
- Huginn
- Create agents that monitor and act on your behalf. Your agents are standing by!
- Imixs-Workflow
- A powerful human-centric Workflow Engine based on the BPMN 2.0 standard.
- Kestra
- Open source data orchestration and scheduling platform with declarative syntax.
- Kiba
- Data processing & ETL framework for Ruby
- Kubeflow pipelines
- Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.
- Petri Flow
- Petri Net workflow engine for Ruby.
- Martian
- An elegant, powerful language and framework for building high-performance computational pipelines.
- Metaflow
- Metaflow is a human-friendly Python/R library that helps scientists and engineers build and manage real-life data science projects.
- MassTransit
- .Net Messaging system with Saga Workflow Support
- Mistral
- Workflow service, in OpenStack foundation.
- N8n-io
- Free and open node based Workflow Automation Tool. Easily automate tasks across different services.
- Nextflow
- Develop container-backed, reproducible workflows portable across computational platforms including local, HPC schedulers, AWS Batch, Google Genomics Pipelines, and Kubernetes.
- Node-RED
- Node-RED is a NodeJS based workflow tool featuring a browser based editor for wiring together hardware devices, APIs and online services in new and interesting ways.
- Oozie
- Workflow Scheduler for Hadoop.
- Pallets
- Simple and reliable workflow engine, written in Ruby
- Parsl
- Python framework for workflow orchestration and parallelization based on a dynamic graph of tasks and their data dependencies.
- Pegasus
- Automate, recover, and debug scientific computations.
- Piper
- A distributed Java workflow engine designed to be dead simple.
- Platformeco - Technology platform, allows Product & Project teams easily build micro services using drag & drop UI and operate it, within out of the box cloud and CI/CD tools with deep tracing & monitoring.
- Plynx
- Interactive platform with drag and drop interface for building and deploying portable and scalable end-to-end data driven workflows.
- Popper
- Lightweight, YAML based container-native workflow engine supporting Docker, Singularity, Vagrant VMs with Docker daemon in VM, and local host.
- Prefect
- Prefect is a new workflow management system, designed for modern infrastructure and powered by the open-source Prefect Core workflow engine
- RunDeck
- Job Scheduler and Runbook Automation.
- Snakemake
- Workflow management system to create reproducible and scalable data analyses; python-based inspired by GNU
Make
. - StackStorm
- Robust Automation Engine providing Sensors, Triggers, Rules, Workflows, and Actions. StackStorm is how you "glue" your applications together.
- Temporal
- Temporal is a microservice orchestration platform which enables developers to build scalable applications without sacrificing productivity or reliability. Temporal is a mature technology, a fork of Uber's Cadence. Temporal is being developed by Temporal Technologies, a startup by the creators of Cadence.
- Titanoboa
- Titanoboa is a platform for creating complex workflows on JVM.
- uTask
- Automation engine that models and executes business processes declared in yaml.
- Wexflow - Open Source Workflow Engine - Wexflow is an open source and cross-platform workflow engine and automation platform that aims to automate recurring tasks. With the help of Wexflow, building automation and workflow processes become easy.
- Windmill
- Turn scripts into workflows and UIs. Open-source alternative to Airplane and Retool.
- Workflow Engine - A lightweight .NET and Java workflow engine.
- YAWL
- (Yet Another Workflow Language), Java-based, handles complex data transformations, and full integration with organizational resources and external Web Services.
- Zeebe
- A horizontally scalable, cloud-native workflow engine that executes BPMN models and is best operated on Kubernetes; polyglot clients connect via gRPC or available language clients.
- Activiti
- Activiti is a leading lightweight, java-centric open-source BPMN engine supporting real-world process automation needs.
- Activiti Cloud - is now the new generation of business automation platform offering a set of cloud native building blocks designed to run on distributed infrastructures.
- Bonita
- BPMN engine that comes with an optional development environment, a designer, an optional user interface and administrative tools.
- Flowable
- The Flowable project provides a core set of open source business process engines that are compact and highly efficient. They provide a workflow and Business Process Management (BPM) platform for developers, system admins and business users.
- jBPM
- The core of jBPM is a light-weight, extensible workflow engine written in pure Java that allows you to execute business processes using the latest BPMN 2.0 specification.
- AWS Step Functions - Clear workflows for modern applications.
- Braze - Power customer-centric interactions between consumers and brands in real-time.
- Camunda Cloud - A workflow service executing BPMN, providing various language clients, based on the open source project Zeebe
.
- Corezoid - Hyperautomation engine.
- Orkes Conductor - Orkes provides Netflix Conductor as a cloud services across all the major cloud providers with enterprise features such as security, integrations and Visual workflow code editor.
- Refinery.io - Serverless IDE that allows you to visually build complex workflows (HTTP APIs, map/reduce, etc) on top of AWS Lambda. Supports writing in Python, Node.js, Golang, Ruby, and other languages.
- Zenaton - Workflow engine for data processes and background jobs available in PHP, Node.js, Python and Ruby.
- Automatiko
- a toolkit to build services and functions based on workflows (primarily BPMN2). Introduces and implements concepts: workflow as a service, workflow as a function and workflow as a function flow.
- C++ Workflow
- C++ Parallel Computing and Asynchronous Networking Engine.
- Camunda
- BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
- Captain
- Distributed, light-weight java workflow engine for a microservice architecture.
- CoreWF
- WF runtime ported to work on .NET Core
- Dagger - Dagger is a distributed, horizointally scalable, durable, and highly available orchestration engine in python based on Faust-Streaming for running millions of long running tasks with direct integration with Kafka
- Django River
- Django workflow library that supports on the fly changes for states, transitions, and authorizations
- Kogito
- Cloud-native business automation technology. Embeddable to produce JVM or GraalVM artifacts or interacted through Kafka & REST APIs
- Luigi
- Python module that helps you build complex pipelines of batch jobs.
- SciPipe
- A Go library for writing pipelines of Bash commands or Go-code using the dataflow / flow-based programming paradigm.
- SpiffWorkflow
- SpiffWorkflow - a BPMN 2.0 workflow engine implemented in pure Python.
- Symfony Workflow
- Symfony Workflow component - The Workflow component provides tools for managing a workflow or finite state machine in PHP.
- Viewflow
- Reusable workflow library that helps organize people collaboration business logic in django applications.
- Workflow Core
- Lightweight workflow engine for .NET Standard
- WorkflowEngine.NET
- WorkflowEngine.NET - component that adds workflow in your application. It can be fully integrated into your application, or be in the form of a specific service (such as a web service)