Alerting Message (Workload Level)

Alert messages record detailed information of alerts triggered based on alert rules, including monitoring targets, alert policies, recent notifications and comments.

Prerequisites

You have created a workload-level alert policy and received alert notifications of it. If it is not ready, please refer to Alert Policy (Workload Level) to create one first.

Hands-on Lab

Task 1: View Alert Message

1. Log in the console and go to your project. Navigate to Alerting Message under Monitoring & Alerting, and you can see alert messages in the list. In the example of Alert Policy (Workload Level), you set two monitoring targets (reviews-v1 and details-v1), and both of their memory usage are higher than the threshold, so you can see two alert messages corresponding to them.

1. Select one of the alert messages to enter the detail page. In Alerting Detail, you can see the graph of the memory usage of the monitored workload over time, which has been continuously higher than the threshold of 20 MiB set in the alert rule, so the alert was triggered.

Task 2: View Alert Policy

Switch to Alerting Policy to view the alert policy corresponding to this alert message, and you can see the triggering rule of it set in the example of Alert Policy (Workload Level).

Task 3: View Recent Notification

1. Switch to Recent Notification. It can be seen that 3 notifications have been received, because the notification rule was set with a repetition period of Alert once every 5 minutes and retransmission of Resend up to 3 times.

1. Log in your email to see alert notification mails sent by the KubeSphere mail server. You have received a total of 6 emails. This is because the memory usage of two monitored workloads (Deployments) has exceeded the threshold of 20 MiB continuously, and the notification email is sent every 5 minutes for 3 consecutive times based on the notification rule.

Task 4: Add Comment

Click Comment to add comments to current alert messages. For example, as the memory usage of workload is higher than the threshold set based on the alert rule, you can add a comment in the dialog: Default maximum memory usage quota needs to be increased for this workload.