Skip to content

Latest commit

 

History

History
127 lines (114 loc) · 27.3 KB

README.md

File metadata and controls

127 lines (114 loc) · 27.3 KB
Raw

awesome-workflow-engines

A curated list of awesome open source workflow engines

Full fledged product

  • Activepieces Stars - Open source no-code business automation, alternative to Zapier
  • AiiDA Stars - Open source workflow manager for computational science with strong focus on performance, provenance, and extensibility.
  • Airflow Stars - Python-based platform for running directed acyclic graphs (DAGs) of tasks
  • Argo Workflows Stars - Open source container-native workflow engine for getting work done on Kubernetes
  • Arvados Stars - Open Source data and workflow management platform with emphasis on reproducibily, scale, and secure data sharing, deployable on cloud and HPC.
  • Azkaban Stars - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs.
  • Brigade Stars - Brigade is a tool for running scriptable, automated tasks in the cloud — as part of your Kubernetes cluster.
  • CabloyJS Stars - A Node.js full-stack framework with workflow engine, based on koa + egg + vue + framework7.
  • Cadence Stars - An orchestration engine to execute asynchronous long-running business logic developed by Uber Engineering.
  • Camunda Stars - BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
  • CDS Stars - Enterprise-grade continuous delivery & DevOps automation open source platform developped by OVHcloud.
  • CGraph Stars - A simple-used and cross-platform DAG framework based on C++17 without any 3rd-party.
  • CloudSlang Stars - Workflow engine to automate your DevOps use cases.
  • Conductor Stars - Conductor is a microservices orchestration platform that enables developers to build scalable, durable application flows. Conductor workflows are language and framework-agnostic. The Conductor is maintained by Orkes and a team of open-source contributors.
  • Copper Stars - A high performance Java workflow engine.
  • Couler Stars - Unified interface for constructing and managing workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
  • Covalent Stars - Workflow orchestration platform for quantum and high performance computing.
  • Cromwell Stars - Workflow engine written in Scala and designed for simplicity and scalability. Executes workflows written in WDL or CWL.
  • Cylc Stars - Workflow engine that orchestrates complex distributed workflows with cyclic or acyclic graphs. It was originally designed to automate weather forecasting systems at NIWA.
  • Dagu Stars - A No-code workflow executor. It executes workflows from declarative YAML definitions.
  • Dagster Stars - Data orchestrator for machine learning, analytics, and ETL.
  • Dapr Workflows Stars - Author and execute durable & long-running Workflow-as-code at scale in Python, Javascript, .NET, Java & Go. Based on the Open-source Durable Task Framework.
  • Didact Stars - The open source .NET job orchestrator.
  • DigDag Stars - Digdag is a simple tool that helps you to build, run, schedule, and monitor complex pipelines of tasks.
  • DolphinScheduler Stars Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.
  • elsa-workflows Stars - A .NET Standard 2.0 Workflows Library.
  • easy-rules Stars - The simple, stupid rules engine for Java.
  • FireWorks Stars - FireWorks stores, executes, and manages calculation workflows.
  • Fission Workflows Stars - A high-perfomant workflow engine for serverless functions on Kubernetes.
  • Flor Stars - A workflow engine written in Ruby.
  • Flyte Stars - A container-native, type-safe workflow and pipelines platform optimized for large scale processing and machine learning written in Golang. Workflows can be written in any language, with out of the box support for Python.
  • ForML Stars - A development framework and MLOps platform for the lifecycle management of data science projects.
  • Galaxy Project Stars - Galaxy is a scientific tool and workflow system that facilitates reproducibility and transparency by providing a graphical user interface (GUI), a multitude of computational dataset tools, a rich API, and a robust scientific community.
  • Goflow Stars - A simple but powerful DAG scheduler and dashboard, written in Go.
  • Huginn Stars - Create agents that monitor and act on your behalf. Your agents are standing by!
  • Imixs-Workflow Stars - A powerful human-centric Workflow Engine based on the BPMN 2.0 standard.
  • Inngest Stars - An event-driven workflow engine that combines event streams, queues, and durable execution into a single reliability layer.
  • iWF Stars - iWF is a WorkflowAsCode API orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes.
  • Kestra Stars - Open source data orchestration and scheduling platform with declarative syntax.
  • Kiba Stars - Data processing & ETL framework for Ruby
  • Kubeflow pipelines Stars - Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.
  • Laravel Workflow Stars - Laravel Workflow is a durable workflow engine that allows users to track job status, orchestrate microservices and write long running persistent distributed workflows in PHP powered by Laravel Queues.
  • Petri Flow Stars - Petri Net workflow engine for Ruby.
  • Martian Stars - An elegant, powerful language and framework for building high-performance computational pipelines.
  • Metaflow Stars - Metaflow is a human-friendly Python/R library that helps scientists and engineers build and manage real-life data science projects.
  • MassTransitStars - .Net Messaging system with Saga Workflow Support
  • Mistral Stars - Workflow service, in OpenStack foundation.
  • N8n-io Stars - Free and open node based Workflow Automation Tool. Easily automate tasks across different services.
  • Nextflow Stars - Develop container-backed, reproducible workflows portable across computational platforms including local, HPC schedulers, AWS Batch, Google Genomics Pipelines, and Kubernetes.
  • Node-RED Stars - Node-RED is a NodeJS based workflow tool featuring a browser based editor for wiring together hardware devices, APIs and online services in new and interesting ways.
  • Oozie Stars - Workflow Scheduler for Hadoop.
  • Pallets Stars - Simple and reliable workflow engine, written in Ruby
  • Parsl Stars - Python framework for workflow orchestration and parallelization based on a dynamic graph of tasks and their data dependencies.
  • Pegasus Stars - Automate, recover, and debug scientific computations.
  • Piper Stars - A distributed Java workflow engine designed to be dead simple.
  • Platformeco - Technology platform, allows Product & Project teams easily build micro services using drag & drop UI and operate it, within out of the box cloud and CI/CD tools with deep tracing & monitoring.
  • Plynx Stars - Interactive platform with drag and drop interface for building and deploying portable and scalable end-to-end data driven workflows.
  • Popper Stars - Lightweight, YAML based container-native workflow engine supporting Docker, Singularity, Vagrant VMs with Docker daemon in VM, and local host.
  • Prefect Stars - Prefect is a new workflow management system, designed for modern infrastructure and powered by the open-source Prefect Core workflow engine
  • Restate Stars - A low-latency durable execution engine for workflows, event-driven handlers, transactional state machines, and stateful orchestration. Fully self-contained in a single binary. Supports programs in TypeScript, Java/Kotlin, Go, Python, and Rust.
  • River Pro Stars - Postgres-backed workflow engine and web dashboard for the River background queue, written in Go.
  • RunDeck Stars - Job Scheduler and Runbook Automation.
  • Snakemake Stars - Workflow management system to create reproducible and scalable data analyses; python-based inspired by GNU Make.
  • StackStorm Stars - Robust Automation Engine providing Sensors, Triggers, Rules, Workflows, and Actions. StackStorm is how you "glue" your applications together.
  • Temporal Stars - Temporal is a microservice orchestration platform which enables developers to build scalable applications without sacrificing productivity or reliability. Temporal is a mature technology, a fork of Uber's Cadence. Temporal is being developed by Temporal Technologies, a startup by the creators of Cadence.
  • Titanoboa Stars - Titanoboa is a platform for creating complex workflows on JVM.
  • Tork Stars - Tork is a very lightweight workflow engine written in Golang.
  • uTask Stars - Automation engine that models and executes business processes declared in yaml.
  • Wexflow Stars .NET Workflow Engine and Automation Platform.
  • Windmill Stars - Turn scripts into workflows and UIs. Open-source alternative to Airplane and Retool.
  • Workflow Engine - A lightweight .NET and Java workflow engine.
  • YAWL Stars - (Yet Another Workflow Language), Java-based, handles complex data transformations, and full integration with organizational resources and external Web Services.
  • Zeebe Stars - A horizontally scalable, cloud-native workflow engine that executes BPMN models and is best operated on Kubernetes; polyglot clients connect via gRPC or available language clients.

BPM Suite

  • Activiti Stars - Activiti is a leading lightweight, java-centric open-source BPMN engine supporting real-world process automation needs.
  • Activiti Cloud - is now the new generation of business automation platform offering a set of cloud native building blocks designed to run on distributed infrastructures.
  • Bonita Stars - BPMN engine that comes with an optional development environment, a designer, an optional user interface and administrative tools.
  • Flowable Stars - The Flowable project provides a core set of open source business process engines that are compact and highly efficient. They provide a workflow and Business Process Management (BPM) platform for developers, system admins and business users.
  • jBPM Stars - The core of jBPM is a light-weight, extensible workflow engine written in pure Java that allows you to execute business processes using the latest BPMN 2.0 specification.

SAAS

  • AWS Step Functions - Clear workflows for modern applications.
  • Azure Logic Apps - Built on a containerized runtime, deploy and run anywhere to increase scale and portability while automating business-critical workflows.
  • Braze - Power customer-centric interactions between consumers and brands in real-time.
  • Camunda Cloud - A workflow service executing BPMN, providing various language clients, based on the open source project Zeebe Stars.
  • Corezoid - Hyperautomation engine.
  • Embed Workflow - Simple native workflow builder for your end-users
  • Orkes Conductor - Orkes provides Netflix Conductor as a cloud services across all the major cloud providers with enterprise features such as security, integrations and Visual workflow code editor.
  • Google Cloud Workflows - Combine Google Cloud services and APIs to build reliable applications, process automation, and data and machine learning pipelines.
  • Refinery.io - Serverless IDE that allows you to visually build complex workflows (HTTP APIs, map/reduce, etc) on top of AWS Lambda. Supports writing in Python, Node.js, Golang, Ruby, and other languages.
  • Zenaton - Workflow engine for data processes and background jobs available in PHP, Node.js, Python and Ruby.

Library (embedded usage)

  • Automatiko Stars - a toolkit to build services and functions based on workflows (primarily BPMN2). Introduces and implements concepts: workflow as a service, workflow as a function and workflow as a function flow.
  • C++ Workflow Stars - C++ Parallel Computing and Asynchronous Networking Engine.
  • Camunda Stars - BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
  • Captain Stars - Distributed, light-weight java workflow engine for a microservice architecture.
  • CoreWF Stars - WF runtime ported to work on .NET Core
  • Dagger - Dagger is a distributed, horizontally scalable, durable, and highly available orchestration engine in python based on Faust-Streaming for running millions of long running tasks with direct integration with Kafka
  • Django River Stars - Django workflow library that supports on the fly changes for states, transitions, and authorizations
  • DBOS Transact Stars - DBOS typescript library for writing durable and transactional workflows.
  • Durable Task Framework Stars - Durable Task Framework (DTFx) is a library that allows users to write long running persistent workflows in C#.
  • Kogito Stars - Cloud-native business automation technology. Embeddable to produce JVM or GraalVM artifacts or interacted through Kafka & REST APIs
  • Luigi Stars - Python module that helps you build complex pipelines of batch jobs.
  • nFlow Stars - Embeddable JVM-based workflow engine with high availability, fault tolerance, and support for multiple databases. Additional libraries are provided for visualization and REST API.
  • Oban - Robust job processing in Elixir, backed by modern PostgreSQL or SQLite3
  • SciPipe Stars - A Go library for writing pipelines of Bash commands or Go-code using the dataflow / flow-based programming paradigm.
  • SpiffWorkflow Stars - SpiffWorkflow - a BPMN 2.0 workflow engine implemented in pure Python.
  • Symfony Workflow Stars - Symfony Workflow component - The Workflow component provides tools for managing a workflow or finite state machine in PHP.
  • Unify Flowret Stars - A lightweight Java based workflow / orchestration engine.
  • Viewflow Stars - Reusable workflow library that helps organize people collaboration business logic in django applications.
  • Workflow Core Stars - Lightweight workflow engine for .NET Standard
  • WorkflowEngine.NET Stars - WorkflowEngine.NET - component that adds workflow in your application. It can be fully integrated into your application, or be in the form of a specific service (such as a web service)