Fundamental Concepts Example Pipeline definition It’s a DAG definition file Importing Modules Default Arguments Instantiate a DAG Operators Tasks Templating with Jinja Addi...

Operators Jinja Templating Rendering Fields as Native Python Objects Reserved params keyword Operators An Operator is conceptually a template for a predefined Task , that you...

Metrics Setup Counters Gauges Timers Metrics Airflow can be set up to send metrics to StatsD . Setup First you must install StatsD requirement: pip install 'apache-airfl...

命令行接口 必填参数 子命令： resetdb 可选参数 render 必填参数 可选参数 变量 可选参数 connections 可选参数 create_user 可选参数 pause 必填参数 可选参数 task_failed_deps 必填参数 可选参数 version trigger_dag 必填参数 可选参数...

Working with TaskFlow Example “TaskFlow API” Pipeline It’s a DAG definition file Instantiate a DAG Tasks Main flow of the DAG But how? Reusing a decorated task Using the Tas...

Directed Acyclic Graph Directed Acyclic Graph Use cases Usage Limitations DAG Visualization Enable or disable DAG Visualization Directed Acyclic Graph 原文：https://docs.gi...

Listener Plugin of Airflow Listener Registration Listener Plugin of Airflow Airflow has feature that allows to add listener for monitoring and tracking the task state using Plu...

Best Practices Writing a DAG Creating a Custom Operator/Hook Creating a task Deleting a task Communication Top level Python Code Dynamic DAG Generation Airflow Variables Tim...

Callbacks Callback Types Example Callbacks A valuable component of logging and monitoring is the use of task callbacks to act upon changes in state of a given task, or across ...

Data-aware scheduling Quickstart What is a “dataset”? How to use datasets in your DAGs Multiple Datasets Notes on schedules Data-aware scheduling New in version 2.4. Quic...