EngineConnManager Design

EngineConnManager architecture design

EngineConnManager (ECM): EngineConn’s manager, provides engine lifecycle management, and reports load information and its own health status to RM.

ECM architecture

EngineConnManager Design - 图1

Introduction to the second-level module

Linkis-engineconn-linux-launch

The engine launcher, whose core class is LinuxProcessEngineConnLauch, is used to provide instructions for executing commands.

Linkis-engineconn-manager-core

The core module of ECM includes the top-level interface of ECM health report and EngineConn health report function, defines the relevant indicators of ECM service, and the core method of constructing EngineConn process.

Core top-level interface/classCore function
EngineConnDefines the properties of EngineConn, including methods and parameters
EngineConnLaunchDefine the start method and stop method of EngineConn
ECMEventECM related events are defined
ECMEventListenerDefined ECM related event listeners
ECMEventListenerBusDefines the listener bus of ECM
ECMMetricsDefines the indicator information of ECM
ECMHealthReportDefines the health report information of ECM
NodeHealthReportDefines the health report information of the node

Linkis-engineconn-manager-server

The server side of ECM defines top-level interfaces and implementation classes such as ECM health information processing service, ECM indicator information processing service, ECM registration service, EngineConn start service, EngineConn stop service, EngineConn callback service, etc., which are mainly used for ECM to itself and EngineConn Life cycle management, health information reporting, heartbeat sending, etc. Core Service and Features module are as follows:

Core serviceCore function
EngineConnLaunchServiceContains core methods for generating EngineConn and starting the process
BmlResourceLocallizationServiceUsed to download BML engine related resources and generate localized file directory
ECMHealthServiceReport your own healthy heartbeat to AM regularly
ECMMetricsServiceReport your own indicator status to AM regularly
EngineConnKillSerivceProvides related functions to stop the engine
EngineConnListServiceProvide caching and management engine related functions
EngineConnCallBackServiceProvide the function of the callback engine