Apache DolphinScheduler is a cloud-native visual Big Data workflow scheduler system, committed to “solving complex big-data task dependencies and triggering relationships in data OPS orchestration so that various types of big data tasks can be used out of the box”.

High Reliability

• Decentralized multi-master and multi-worker, HA is supported by itself, overload processing

User-Friendly

• All process definition operations are visualized, Visualization process defines key information at a glance, One-click deployment

Rich Scenarios

• Support multi-tenant. Support many task types e.g., spark,flink,hive, mr, shell, python, sub_process

High Expansibility

• Support custom task types, Distributed scheduling, and the overall scheduling capability will increase linearly with the scale of the cluster