Workload Impersonation Default Impersonation Workload This topic describes how to configure Airflow to secure your workload. Impersonation Airflow has the ability to imperso...

Logging for Tasks Configuring logging Writing to task logs from your code Interleaving of logs Troubleshooting Advanced configuration External Links Serving logs from workers...

Email Configuration Send email using SendGrid Using Default SMTP Using SendGrid Provider Send email using AWS SES Email Configuration You can configure the email that is bei...

How-to Guides How-to Guides Setting up the sandbox in the Quick Start section was easy; building a production-grade environment requires a bit more work! These how-to guides w...

Building a Running Pipeline Initial setup Table Creation Tasks Optional: Using SQL From Files Data Retrieval Task Data Merge Task Completing our DAG What’s Next? Building...

Fundamental Concepts Example Pipeline definition It’s a DAG definition file Importing Modules Default Arguments Instantiate a DAG Operators Tasks Templating with Jinja Addi...

Setting Configuration Options Configuring Flask Application for Airflow Webserver Setting Configuration Options The first time you run Airflow, it will create a file called air...

Command Line Interface and Environment Variables Reference Command Line Interface Positional Arguments Sub-commands celery Positional Arguments Sub-commands flower stop worker ...

Logging and Monitoring architecture Logging and Monitoring architecture Airflow supports a variety of logging and monitoring mechanisms as shown below. By default, Airflow su...

Lineage Apache Atlas Lineage 注意 Lineage 支持是非常实验性的，可能会发生变化。 Airflow可以帮助跟踪数据的来源，发生的事情以及数据随时间的变化。 这有助于实现审计跟踪和数据治理，还可以调试数据流。 气流通过任务的入口和出口跟踪数据。 让我们从一个例子开始，看看它是如何工作的。 from ai...