Apache Airflow

Apache Airflow
Original author(s)Maxime Beauchemin / Airbnb
Developer(s)Apache Software Foundation
Initial releaseJune 3, 2015 (2015-06-03)
Stable release2.8.2[1] Edit this on Wikidata (26 February 2024 (26 February 2024)) [±]
Repository
Written inPython
Operating systemWindows, macOS, Linux
TypeWorkflow management platform
LicenseApache License 2.0
Websiteairflow.apache.org

Apache Airflow is an open-source workflow management platform for data engineering pipelines. It started at Airbnb in October 2014[2] as a solution to manage the company's increasingly complex workflows. Creating Airflow allowed Airbnb to programmatically author and schedule their workflows and monitor them via the built-in Airflow user interface.[3][4] From the beginning, the project was made open source, becoming an Apache Incubator project in March 2016 and a top-level Apache Software Foundation project in January 2019.

Airflow is written in Python, and workflows are created via Python scripts. Airflow is designed under the principle of "configuration as code". While other "configuration as code" workflow platforms exist using markup languages like XML, using Python allows developers to import libraries and classes to help them create their workflows.

  1. ^ https://airflow.apache.org/docs/apache-airflow/stable/release_notes.html#airflow-2-8-2-2024-02-26. {{cite web}}: Missing or empty |title= (help)
  2. ^ "Apache Airflow". Apache Airflow. Archived from the original on August 12, 2019. Retrieved September 30, 2019.
  3. ^ Beauchemin, Maxime (June 2, 2015). "Airflow: a workflow management platform". Medium. Archived from the original on August 13, 2019. Retrieved September 30, 2019.
  4. ^ "Airflow". Archived from the original on July 6, 2019. Retrieved September 30, 2019.

© MMXXIII Rich X Search. We shall prevail. All rights reserved. Rich X Search