PythonOperator Passing in arguments Templating PythonVirtualenvOperator Passing in arguments ExternalPythonOperator Passing in arguments ShortCircuitOperator Passing in argu...
Kerberos Limitations Enabling Kerberos Airflow Hadoop Using Kerberos authentication Kerberos Airflow has initial support for Kerberos. This means that Airflow can renew Ker...
API API Authentication Disable authentication Kerberos authentication Basic authentication Roll your own API authentication Enabling CORS Page size limit API API Authent...
Using the Command Line Interface Set Up Bash/Zsh Completion Creating a Connection Exporting DAG structure as an image Display DAGs structure Formatting commands output Purge h...
Logging & Monitoring Logging & Monitoring Since data pipelines are generally run without any manual supervision, observability is critical. Airflow has support for multiple log...
Working with TaskFlow Example “TaskFlow API” Pipeline It’s a DAG definition file Instantiate a DAG Tasks Main flow of the DAG But how? Reusing a decorated task Using the Tas...
Customizing the UI Customizing state colours Screenshots Before After Customizing DAG UI Header and Airflow Page Titles Screenshots Before After Add custom alert messages o...