Apache Airflow

lastmod 2026-03-04created 2024-02-0110 edits

Apache Airflow is an open-source workflow management platform for data engineering pipelines. It started at Airbnb in October 2014 as a solution for managing the company's increasingly complex workflows.

Airflow is written in Python, and workflows are created through Python scripts.

Categories

• Airflow:Basic

See also

• Workflow management system (WfMS or WFMS)
• Kubeflow
• Airflow
• JupyterFlow
• Argo Workflows
• NodeRed
• n8n
• OpenWorkflow - open-source workflow automation and execution platform that runs on Postgres alone

Favorite site

• Apache Airflow web site
• Apache Airflow - Wikipedia
• (Airflow) What is Airflow? Basic concepts, pros and cons
• Story of a Person with Many Dreams - Getting started with Apache Airflow - What is Airflow?, installing Airflow and basic examples

Guides

• The simplest Airflow tutorial in the world