Illyoung Choi | fe121d0 | 2019-07-16 10:47:41 -0700 | [diff] [blame] | 1 | Airflow Extensions for CORD Workflow |
| 2 | ==================================== |
| 3 | This library provides airflow extensions and tools for CORD Workflow. |
| 4 | Three packages are provided as below: |
| 5 | |
| 6 | Essence Extractor |
| 7 | ----------------- |
| 8 | A tool to extract **essence** from Airflow workflow code. Extracted essence is |
| 9 | used to register the workflow to CORD Workflow Controller. |
| 10 | |
| 11 | Workflow Kickstarter |
| 12 | -------------------- |
| 13 | A daemon that monitors kickstart events from CORD Workflow Controller, and |
| 14 | instantiate Airflow Workflows. |
| 15 | |
| 16 | Airflow Extensions |
| 17 | ------------------ |
| 18 | A set of Airflow extensions that provide Python library to access CORD data |
| 19 | models and Airflow operators/sensors. |
| 20 | |
| 21 | |
| 22 | |
| 23 | Note |
| 24 | ---- |
| 25 | Installing Airflow 1.10 has an issue of PEP 517 when installing it with pip 19.1. |
| 26 | PEP 517 makes installing pendulum 1.4.4 which is required by Airflow failed. |
| 27 | Higher version of pendulum is not compatible to Airflow. |