InfluxDB Line Protocol

Host metrics refer to the metrics collected from the operating system of the host where your applications are running. These metrics include CPU, memory, disk, and network usage. Understanding host metrics is crucial as it helps you identify potential problems or bottlenecks that could affect the overall performance of your applications.

In this tutorial, we will show you how to collect host metrics, send them to GreptimeDB and visualize them.

Create Service

To experience the full power of GreptimeCloud, you need to create a service which contains a database with authentication. Open the GreptimeCloud console, signup and login. Then click the New Service button and config the following:

  • Service Name: The name you want to describe your service.
  • Description: More information about your service.
  • Region: Select the region where the database is located.
  • Plan: Select the pricing plan you want to use.

Now create the service and we are ready to write some metrics to it.

Write Data

We will write a Bash script and showcase the core code to collect host metrics and send them to GreptimeDB. For reference, you can view the complete demo on GitHub.

To begin, create a new directory named quick-start-influxdb to host our project. Then create a new file named quick-start.sh and make it executable:

bash

  1. touch quick-start.sh
  2. chmod +x quick-start.sh

Write code to collect CPU and memory metrics and format the data into InfluxDB line protocol format:

bash

  1. #!/bin/bash
  3. generate_data()
  4. {
  5.  unameOut="$(uname -s)"
  6.  case "${unameOut}" in
  7.   Linux*)
  8.    user_cpu_util=$(top -bn1 | grep "Cpu(s)" | awk '{print $2 + $4}')
  9.    sys_cpu_util=$(top -bn1 | grep "Cpu(s)" | awk '{print $6}')
  10.    idle_cpu_util=$(top -bn1 | grep "Cpu(s)" | awk -F "," '{print $4}' | awk -F " " '{print $1}')
  11.    mem_util=$(free | grep Mem | awk '{print $3}')
  12.    ;;
  13.   Darwin*)
  14.    user_cpu_util=$(top -l 1 | awk '/^CPU usage: / { print substr($3, 1, length($3)-1) }')
  15.    sys_cpu_util=$(top -l 1 | awk '/^CPU usage: / { print substr($5, 1, length($5)-1) }')
  16.    idle_cpu_util=$(top -l 1 | awk '/^CPU usage: / { print substr($7, 1, length($7)-1) }')
  17.    mem_util=$(top -l 1 | awk '/^PhysMem:/ { print substr($6, 1, length($6)-1) }')
  18.    ;;
  19.   *)
  20.    user_cpu_util=$(shuf -i 10-15 -n 1)
  21.    sys_cpu_util=$(shuf -i 5-10 -n 1)
  22.    idle_cpu_util=$(shuf -i 70-80 -n 1)
  23.    mem_util=$(shuf -i 50-60 -n 1)
  24.  esac
  25.  now=$(($(date +%s)*1000000000))
  26.  cat <<EOF
  27. monitor,host=$unameOut user_cpu=$user_cpu_util,sys_cpu=$sys_cpu_util,idle_cpu=$idle_cpu_util,memory=$mem_util $now
  28. EOF
  29. }

Then send the metrics to GreptimeDB every 5 seconds:

sh

  1. echo Sending metrics to GreptimeCloud...
  2. while true
  3. do
  4.  sleep 2
  5.  curl -i -XPOST "https://$host/v1/influxdb/write?db=$database&u=$username&p=$password" --data-binary "$(generate_data)"
  6. done

For information on the host, database, username, and password required for the InfluxDB API, please refer to the InfluxDB documentation in GreptimeDB or GreptimeCloud.

Congratulations on successfully completing the core section of the demo! You can now run the complete demo by following the instructions in the README.md file on the GitHub repository.

The connection information can be found on the service page of GreptimeCloud console.

Visualize Data

Visualizing data in panels and monitoring metrics is important in a developer’s daily work. From the GreptimeCloud console, click on Open Prometheus Workbench, then click on + New Ruleset and Add Group. Name the group host-monitor and add panels.

To add panels for all the tables you’re concerned with, select a table and click on Add Panel one by one. Once you’ve added all the necessary panels, click on the Save button to save them. You can then view the panels in your daily work to monitor the metrics. Additionally, you can set up alert rules for the panels to be notified when the metrics exceed the threshold.