CollectD protocol support in InfluxDB

The collectd input allows InfluxDB to accept data transmitted in collectd native format. This data is transmitted over UDP.

A note on UDP/IP buffer sizes

If you’re running Linux or FreeBSD, please adjust your operating system UDP buffer size limit, see here for more details.

Configuration

Each collectd input allows the binding address, target database, and target retention policy to be set. If the database does not exist, it will be created automatically when the input is initialized. If the retention policy is not configured, then the default retention policy for the database is used. However if the retention policy is set, the retention policy must be explicitly created. The input will not automatically create it.

Each collectd input also performs internal batching of the points it receives, as batched writes to the database are more efficient. The default batch size is 1000, pending batch factor is 5, with a batch timeout of 1 second. This means the input will write batches of maximum size 1000, but if a batch has not reached 1000 points within 1 second of the first point being added to a batch, it will emit that batch regardless of size. The pending batch factor controls how many batches can be in memory at once, allowing the input to transmit a batch, while still building other batches.

Multi-value plugins can be handled two ways. Setting parse-multivalue-plugin to “split” will parse and store the multi-value plugin data (e.g., df free:5000,used:1000) into separate measurements (e.g., (df_free, value=5000) (df_used, value=1000)), while “join” will parse and store the multi-value plugin as a single multi-value measurement (e.g., (df, free=5000,used=1000)). “split” is the default behavior for backward compatibility with previous versions of influxdb.

The path to the collectd types database file may also be set.

Large UDP packets

Please note that UDP packets larger than the standard size of 1452 are dropped at the time of ingestion. Be sure to set MaxPacketSize to 1452 in the collectd configuration.

Config Example

  1. [[collectd]]
  2.   enabled = true
  3.   bind-address = ":25826" # the bind address
  4.   database = "collectd" # Name of the database that will be written to
  5.   retention-policy = ""
  6.   batch-size = 5000 # will flush if this many points get buffered
  7.   batch-pending = 10 # number of batches that may be pending in memory
  8.   batch-timeout = "10s"
  9.   read-buffer = 0 # UDP read buffer size, 0 means to use OS default
  10.   typesdb = "/usr/share/collectd/types.db"
  11.   security-level = "none" # "none", "sign", or "encrypt"
  12.   auth-file = "/etc/collectd/auth_file"
  13.   parse-multivalue-plugin = "split"  # "split" or "join"

Content from README on GitHub.