Scrape Prometheus metrics

Use Telegraf, InfluxDB scrapers, or the prometheus.scrape Flux function to scrape Prometheus-formatted metrics from an HTTP-accessible endpoint and store them in InfluxDB.

• Use Telegraf
• Use an InfluxDB scraper
• Use prometheus.scrape()

Use Telegraf

To use Telegraf to scrape Prometheus-formatted metrics from an HTTP-accessible endpoint and write them to InfluxDB, follow these steps:

1. Add the Prometheus input plugin to your Telegraf configuration file.
   1. Set the urls to scrape metrics from.
   2. Set the metric_version configuration option to specify which metric parsing version to use (version 2 is recommended).
2. Add the InfluxDB v2 output plugin to your Telegraf configuration file and configure it to to write to InfluxDB.

Example telegraf.conf

# ...
## Collect Prometheus formatted metrics
[[inputs.prometheus]]
  urls = ["http://example.com/metrics"]
  metric_version = 2
## Write Prometheus formatted metrics to InfluxDB
[[outputs.influxdb_v2]]
  urls = ["http://localhost:8086"]
  token = "$INFLUX_TOKEN"
  organization = "example-org"
  bucket = "example-bucket"
# ...

Use an InfluxDB scraper

InfluxDB scrapers automatically scrape Prometheus-formatted metrics from an HTTP-accessible endpoint at a regular interval.

• Create a scraper with the InfluxDB API
• Create a scraper with the InfluxDB UI

Create a scraper with the InfluxDB API

Use the InfluxDB API /api/v2/scrapers endpoint to manage scrapers and member privileges for scrapers.

To create a scraper, send an HTTP POST request to the /api/v2/scrapers endpoint.

POST http://localhost:8086/api/v2/scrapers

Include the following in your request:

Optionally, to force the scraper to skip TLS verification and ignore self-signed certificates at the url, pass "allowInsecure": true in the request body.

Example

curl -v --request POST http://localhost:8086/api/v2/scrapers \
  --header "Authorization: Token ${INFLUX_TOKEN}" \
  --header 'Content-type: application/json' \
  --data-binary @- << JSON
    {
      "name": "Scraper name",
      "type": "prometheus",
      "url": "http://localhost:9090/metrics",
      "orgID": "${INFLUX_ORG}",
      "bucketID": "c55193a037c3b0ca",
      "allowInsecure": true
    }
JSON

Create a scraper with the InfluxDB UI

To use the InfluxDB UI to manage scrapers, see Scrape data using InfluxDB scrapers.

Use prometheus.scrape()

To use the prometheus.scrape() Flux function to scrape Prometheus-formatted metrics from an HTTP-accessible endpoint and write them to InfluxDB, do the following in your Flux script:

1. Import the experimental/prometheus package.
2. Use prometheus.scrape() and provide the URL to scrape metrics from.
3. Use to() and specify the InfluxDB bucket to write the scraped metrics to.

Example Flux script

import "experimental/prometheus"
prometheus.scrape(url: "http://example.com/metrics")
    |> to(bucket: "example-bucket")

1. (Optional) To scrape Prometheus metrics at regular intervals using Flux, add your Flux scraping script as an InfluxDB task.

For information about scraping Prometheus-formatted metrics with prometheus.scrape(), see Scrape Prometheus metrics with Flux.

Related

• Telegraf Prometheus input plugin
• Scrape Prometheus metrics with Flux
• prometheus.scrape() function
• Work with Prometheus metric types
• Prometheus metric parsing formats
• Scrape data using InfluxDB scrapers

prometheus scraper