Getting Started

The following guide assumes that you are familiar with Fluent Bit, if that is not the case we suggest you review the official manual first:

Requirements

  • Fluent Bit >= v1.1.0 or Fluent Bit from GIT Master
  • Basic understanding of Structured Query Language (SQL)

Technical Concepts

Concept Description
Stream A Stream represents an unique flow of data being ingested by an Input plugin. By default Streams get a name using the plugin name plus an internal numerical identification, e.g: tail.0 . Stream name can be changed setting the alias property.
Task Stream Processor configuration have the notion of Tasks that represents an execution unit, for short: SQL queries are configured in a Task.
Results When Stream Processor runs a SQL query, results are generated. These results can be re-ingested back into the main Fluent Bit pipeline or simply redirected to the standard output interfaces for debugging purposes.
Tag Fluent Bit group records and associate a Tag to them. Tags are used to define routing rules or in the case of the stream processor to attach to specific Tag that matches a pattern.
Match Matching rule that can use a wildcard to match specific records associated to a Tag.