AWS Metadata

The AWS Filter Enriches logs with AWS Metadata. Currently the plugin adds the EC2 instance ID and availability zone to log records. To use this plugin, you must be running in EC2 and have the instance metadata service enabled.

Configuration Parameters

The plugin supports the following configuration parameters:

Key Description Default
imds_version Specify which version of the instance metadata service to use. Valid values are ‘v1’ or ‘v2’. v2

Note: If you run Fluent Bit in a container, you may have to use instance metadata v1. The plugin behaves the same regardless of which version is used.

Usage

Metadata Fields

Currently, the plugin only adds the instance ID and availability zone. AWS plans to expand this plugin in the future.

Key Value
az The availability zone; for example, “us-east-1a”.
ec2_instance_id The EC2 instance ID.

Command Line

  1. $ bin/fluent-bit -i dummy -F aws -m '*' -o stdout
  3. [2020/01/17 07:57:17] [ info] [engine] started (pid=32744)
  4. [0] dummy.0: [1579247838.000171227, {"message"=>"dummy", "az"=>"us-west-2b", "ec2_instance_id"=>"i-06bc83dbc2ac2fdf8"}]
  5. [1] dummy.0: [1579247839.000125097, {"message"=>"dummy", "az"=>"us-west-2b", "ec2_instance_id"=>"i-06bc87dbc2ac3fdf8"}]

Configuration File

  1. [INPUT]
  2.     Name dummy
  3.     Tag dummy
  5. [FILTER]
  6.     Name aws
  7.     Match *
  8.     imds_version v1
  10. [OUTPUT]
  11.     Name stdout
  12.     Match *