Notification Template Reference

Prometheus creates and sends alerts to the Alertmanager which then sends notifications out to different receivers based on their labels. A receiver can be one of many integrations including: Slack, PagerDuty, email, or a custom integration via the generic webhook interface.

The notifications sent to receivers are constructed via templates. The Alertmanager comes with default templates but they can also be customized. To avoid confusion it’s important to note that the Alertmanager templates differ from templating in Prometheus, however Prometheus templating also includes the templating in alert rule labels/annotations.

The Alertmanager’s notification templates are based on the Go templating system. Note that some fields are evaluated as text, and others as HTML which will affect escaping.

Data Structures

Data

Data is the structure passed to notification templates and webhook pushes.

NameTypeNotes
ReceiverstringDefines the receiver’s name that the notification will be sent to (slack, email etc.).
StatusstringDefined as firing if at least one alert is firing, otherwise resolved.
AlertsAlertList of all alert objects in this group (see below).
GroupLabelsKVThe labels these alerts were grouped by.
CommonLabelsKVThe labels common to all of the alerts.
CommonAnnotationsKVSet of common annotations to all of the alerts. Used for longer additional strings of information about the alert.
ExternalURLstringBacklink to the Alertmanager that sent the notification.

The Alerts type exposes functions for filtering alerts:

  • Alerts.Firing returns a list of currently firing alert objects in this group
  • Alerts.Resolved returns a list of resolved alert objects in this group

Alert

Alert holds one alert for notification templates.

NameTypeNotes
StatusstringDefines whether or not the alert is resolved or currently firing.
LabelsKVA set of labels to be attached to the alert.
AnnotationsKVA set of annotations for the alert.
StartsAttime.TimeThe time the alert started firing. If omitted, the current time is assigned by the Alertmanager.
EndsAttime.TimeOnly set if the end time of an alert is known. Otherwise set to a configurable timeout period from the time since the last alert was received.
GeneratorURLstringA backlink which identifies the causing entity of this alert.
FingerprintstringFingerprint that can be used to identify the alert.

KV

KV is a set of key/value string pairs used to represent labels and annotations.

  1. type KV map[string]string

Annotation example containing two annotations:

  1. {
  2. summary: "alert summary",
  3. description: "alert description",
  4. }

In addition to direct access of data (labels and annotations) stored as KV, there are also methods for sorting, removing, and viewing the LabelSets:

KV methods

NameArgumentsReturnsNotes
SortedPairs-Pairs (list of key/value string pairs.)Returns a sorted list of key/value pairs.
Remove[]stringKVReturns a copy of the key/value map without the given keys.
Names-[]stringReturns the names of the label names in the LabelSet.
Values-[]stringReturns a list of the values in the LabelSet.

Functions

Note the default functions also provided by Go templating.

Strings

NameArgumentsReturnsNotes
titlestringstrings.Title, capitalises first character of each word.
toUpperstringstrings.ToUpper, converts all characters to upper case.
toLowerstringstrings.ToLower, converts all characters to lower case.
matchpattern, stringRegexp.MatchString. Match a string using Regexp.
reReplaceAllpattern, replacement, textRegexp.ReplaceAllString Regexp substitution, unanchored.
joinsep string, s []stringstrings.Join, concatenates the elements of s to create a single string. The separator string sep is placed between elements in the resulting string. (note: argument order inverted for easier pipelining in templates.)
safeHtmltext stringhtml/template.HTML, Marks string as HTML not requiring auto-escaping.
stringSlice…stringReturns the passed strings as a slice of strings.