Apache Zeppelin

Overview

Use Zeppelin Task to create a zeppelin-type task and execute zeppelin notebook paragraphs. When the worker executes Zeppelin Task, it will call Zeppelin Client API to trigger zeppelin notebook paragraph. Click here for details about Apache Zeppelin Notebook.

Create Task

• Click Project Management -> Project Name -> Workflow Definition, and click the Create Workflow button to enter the DAG editing page.
• Drag from the toolbar to the canvas.

Task Parameters

• Please refer to DolphinScheduler Task Parameters Appendix for default parameters.

Production (Clone) Mode

• Fill in the optional Zeppelin Production Note Directory parameter to enable Production Mode.
• In Production Mode, the target note gets copied to the Zeppelin Production Note Directory you choose. Zeppelin Task Plugin will execute the cloned note instead of the original one. Once execution done, Zeppelin Task Plugin will delete the cloned note automatically. Therefore, it increases the stability as the modification to a running note triggered by Dolphin Scheduler will not affect the production task.
• If you leave the Zeppelin Production Note Directory empty, Zeppelin Task Plugin will execute the original note.
• ‘Zeppelin Production Note Directory’ should both start and end with a slash. e.g. /production_note_directory/

Task Example

Zeppelin Paragraph Task Example

This example illustrates how to create a zeppelin paragraph task node.