gRPC Hook Extension

The Extension Hook is supported by the emqx-exhook plugin. It allows users to process EMQX Hooks using other programming languages.

In this way, other programming languages can handle emqx events for the purpose of customizing and extending emqx. For example, users can use other programming languages to implement:

  • Authentication for client connecting
  • Authorization for publishing/subscribing
  • Persistence and bridging for messages
  • Process client connected/disconnected events

Design

The emqx-exhook plugin uses gRPCgRPC Hook Extension - 图1 (opens new window) as the communication framework for RPC.

The architecture is as illustrated below:

exhook_workflow

It indicates that EMQX acts as a gRPC client, sending hook events from EMQX to the user’s gRPC server.

Consistent with EMQX native hooks, it also supports a chained approach to calculating and returning.

Callback Functions Chain

APIs

As the event handler, i.e. user implemented server side of gRPC. It can define the list of hooks that need to be mounted, and the implement callback functions for how to go about handling each event when it arrives.

These interfaces are defined as a gRPC service called HookProvider:

  1. syntax = "proto3";
  3. package emqx.exhook.v2;
  5. service HookProvider {
  7.   rpc OnProviderLoaded(ProviderLoadedRequest) returns (LoadedResponse) {};
  9.   rpc OnProviderUnloaded(ProviderUnloadedRequest) returns (EmptySuccess) {};
  11.   rpc OnClientConnect(ClientConnectRequest) returns (EmptySuccess) {};
  13.   rpc OnClientConnack(ClientConnackRequest) returns (EmptySuccess) {};
  15.   rpc OnClientConnected(ClientConnectedRequest) returns (EmptySuccess) {};
  17.   rpc OnClientDisconnected(ClientDisconnectedRequest) returns (EmptySuccess) {};
  19.   rpc OnClientAuthenticate(ClientAuthenticateRequest) returns (ValuedResponse) {};
  21.   rpc OnClientAuthorize(ClientAuthorizeRequest) returns (ValuedResponse) {};
  23.   rpc OnClientSubscribe(ClientSubscribeRequest) returns (EmptySuccess) {};
  25.   rpc OnClientUnsubscribe(ClientUnsubscribeRequest) returns (EmptySuccess) {};
  27.   rpc OnSessionCreated(SessionCreatedRequest) returns (EmptySuccess) {};
  29.   rpc OnSessionSubscribed(SessionSubscribedRequest) returns (EmptySuccess) {};
  31.   rpc OnSessionUnsubscribed(SessionUnsubscribedRequest) returns (EmptySuccess) {};
  33.   rpc OnSessionResumed(SessionResumedRequest) returns (EmptySuccess) {};
  35.   rpc OnSessionDiscarded(SessionDiscardedRequest) returns (EmptySuccess) {};
  37.   rpc OnSessionTakenover(SessionTakenoverRequest) returns (EmptySuccess) {};
  39.   rpc OnSessionTerminated(SessionTerminatedRequest) returns (EmptySuccess) {};
  41.   rpc OnMessagePublish(MessagePublishRequest) returns (ValuedResponse) {};
  43.   rpc OnMessageDelivered(MessageDeliveredRequest) returns (EmptySuccess) {};
  45.   rpc OnMessageDropped(MessageDroppedRequest) returns (EmptySuccess) {};
  47.   rpc OnMessageAcked(MessageAckedRequest) returns (EmptySuccess) {};
  48. }

The HookProvider part:

  • OnProviderLoaded: Defines how the HookProvider will be loaded. This method returns the list of hooks that need to be mounted. Only the hooks in this list will be called back to the user’s HookProvider service.
  • OnProviderUnloaded: Notify the user that the HookProvider has been uninstalled from emqx

The hook events part:

  • The methods prefixed with OnClient, OnSession, and OnMessage correspond to the methods in hooks. They have the same call timing and a similar argument list.
  • Only OnClientAuthenticate, OnClientCheckAcl, OnMessagePublish are allowed to carry the return values to EMQX, other callbacks are not supported.

For details of the interface and parameter data structures refer to: exhook.protogRPC Hook Extension - 图3 (opens new window)

Developing Guide

The user needs to implement the gRPC service of HookProvider to receive callback events from EMQX.

The main development steps are as following:

  1. Copy the lib/emqx_exhook-<x.y.z>/priv/protos/exhook.proto file to your project.
  2. Generate the code for the gRPC server side of exhook.proto using the gRPC framework for the corresponding programming language.
  3. Implement the interfaces defined in exhook.proto on demand

Once the development is complete, the service needs to be deployed to a server that can communicate with EMQX and ensure that the ports are open.

You can use the EMQX DashboardgRPC Hook Extension - 图4 (opens new window) to manage and monitor the ExHook service.

One of the gRPC frameworks for each language can be found at: grpc-ecosystem/awesome-grpcgRPC Hook Extension - 图5 (opens new window)

We also provide sample programs for some common programming languages: emqx-extension-examplesgRPC Hook Extension - 图6 (opens new window)