3 Recovery operations

Overview

Recovery operations allow you to be notified when problems are resolved.

Both messages and remote commands are supported in recovery operations. While several operations can be added, escalation is not supported - all operations are assigned to a single step and therefore will be performed simultaneously.

Use cases

Some use cases for recovery operations are as follows:

  1. Notify all users that were notified on the problem

    • Select ‘Send recovery message’ as operation type

  2. Have multiple operations upon recovery: send a notification and execute a remote command

    • Add operation types for sending a message and executing a command

  3. Open a ticket in external helpdesk/ticketing system and close it when the problem is resolved

    • Create an external script that communicates with the helpdesk system

    • Create an action having operation that executes this script and thus opens a ticket

    • Have a recovery operation that executes this script with other parameters and closes the ticket

    • Use the {EVENT.ID} macro to reference the original problem

Configuring a recovery operation

To configure a recovery operation, go to the Operations tab in action configuration.

3 Recovery operations - 图1

To configure details of a new recovery operation, click on 3 Recovery operations - 图2 in the Recovery operations block. To edit an existing operation, click on 3 Recovery operations - 图3 next to the operation. A popup window will open where you can edit the operation step details.

Recovery operation details

3 Recovery operations - 图4

ParameterDescription
Operation typeThree operation types are available for recovery events:
Send message - send recovery message to specified user
Remote command - execute a remote command
Notify all involved - send recovery message to all users who were notified on the problem event
Note that if the same recipient is defined in several operation types without specified Custom message, duplicate notifications are not sent.
Operation type: send message
Send to user groupsClick on Add to select user groups to send the recovery message to.
The user group must have at least “read” permissions to the host in order to be notified.
Send to usersClick on Add to select users to send the recovery message to.
The user must have at least “read” permissions to the host in order to be notified.
Send only toSend default recovery message to all defined media types or a selected one only.
Custom messageIf selected, a custom message can be defined.
SubjectSubject of the custom message. The subject may contain macros.
MessageThe custom message. The message may contain macros.
Operation type: remote command
Target listSelect targets to execute the command on:
Current host - command is executed on the host of the trigger that caused the problem event. This option will not work if there are multiple hosts in the trigger.
Host - select host(s) to execute the command on.
Host group - select host group(s) to execute the command on. Specifying a parent host group implicitly selects all nested host groups. Thus the remote command will also be executed on hosts from nested groups.
A command on a host is executed only once, even if the host matches more than once (e.g. from several host groups; individually and from a host group).
The target list is meaningless if the command is executed on Zabbix server. Selecting more targets in this case only results in the command being executed on the server more times.
Note that for global scripts, the target selection also depends on the Host group setting in global script configuration.
TypeSelect the command type:
IPMI - execute an IPMI command
Custom script - execute a custom set of commands
SSH - execute an SSH command
Telnet - execute a Telnet command
Global script - execute one of the global scripts defined in Administration→Scripts.
Execute onExecute a custom script on:
Zabbix agent - the script will be executed by Zabbix agent on the host
Zabbix server (proxy) - the script will be executed by Zabbix server or proxy - depending on whether the host is monitored by server or proxy
Zabbix server - the script will be executed by Zabbix server only
To execute scripts on the agent, it must be configured to allow remote commands from the server.
This field is available if ‘Custom script’ is selected as Type.
CommandsEnter the command(s).
Supported macros will be resolved based on the trigger expression that caused the event. For example, host macros will resolve to the hosts of the trigger expression (and not of the target list).
Operation type: notify all involved
Custom messageIf selected, a custom message can be defined.
SubjectSubject of the custom message. The subject may contain macros.
MessageThe custom message. The message may contain macros.

All mandatory input fields are marked with a red asterisk. When done, click on Add to add operation to the list of Recovery operations.