SkyWalking Agent Deployment

The dolphinscheduler-skywalking module provides SkyWalking monitor agent for the Dolphinscheduler project.

This document describes how to enable SkyWalking 8.4+ support with this module (recommended to use SkyWalking 8.5.0).

Installation

The following configuration is used to enable SkyWalking agent.

Through environment variable configuration (for Docker Compose)

Modify SkyWalking environment variables in docker/docker-swarm/config.env.sh:

  1. SKYWALKING_ENABLE=true
  2. SW_AGENT_COLLECTOR_BACKEND_SERVICES=127.0.0.1:11800
  3. SW_GRPC_LOG_SERVER_HOST=127.0.0.1
  4. SW_GRPC_LOG_SERVER_PORT=11800

And run

  1. $ docker-compose up -d

Through environment variable configuration (for Docker)

  1. $ docker run -d --name dolphinscheduler \
  2. -e DATABASE_HOST="192.168.x.x" -e DATABASE_PORT="5432" -e DATABASE_DATABASE="dolphinscheduler" \
  3. -e DATABASE_USERNAME="test" -e DATABASE_PASSWORD="test" \
  4. -e ZOOKEEPER_QUORUM="192.168.x.x:2181" \
  5. -e SKYWALKING_ENABLE="true" \
  6. -e SW_AGENT_COLLECTOR_BACKEND_SERVICES="your.skywalking-oap-server.com:11800" \
  7. -e SW_GRPC_LOG_SERVER_HOST="your.skywalking-log-reporter.com" \
  8. -e SW_GRPC_LOG_SERVER_PORT="11800" \
  9. -p 12345:12345 \
  10. apache/dolphinscheduler:2.0.0 all

Through install_config.conf configuration (for DolphinScheduler install.sh)

Add the following configurations to ${workDir}/conf/config/install_config.conf.

  2. # SkyWalking config
  3. # note: enable SkyWalking tracking plugin
  4. enableSkywalking="true"
  5. # note: configure SkyWalking backend service address
  6. skywalkingServers="your.skywalking-oap-server.com:11800"
  7. # note: configure SkyWalking log reporter host
  8. skywalkingLogReporterHost="your.skywalking-log-reporter.com"
  9. # note: configure SkyWalking log reporter port
  10. skywalkingLogReporterPort="11800"

Usage

Import Dashboard

Import DolphinScheduler Dashboard to SkyWalking Sever

Copy the ${dolphinscheduler.home}/ext/skywalking-agent/dashboard/dolphinscheduler.yml file into ${skywalking-oap-server.home}/config/ui-initialized-templates/ directory, and restart SkyWalking oap-server.

View DolphinScheduler Dashboard

If you have opened SkyWalking dashboard with a browser before, you need to clear the browser cache.

img1