description: Data processing with reliability

Buffer

Previously defined in the Buffering concept section, the buffer phase in the pipeline aims to provide a unified and persistent mechanism to store your data, either using the primary in-memory model or using the filesystem based mode.

The buffer phase already contains the data in an immutable state, meaning, no other filter can be applied.

{% hint style=”info” %} Note that buffered data is not longer a raw text, instead it’s in Fluent Bit internal binary representation. {% endhint %}

Fluent Bit offers a buffering mechanism in the file system that acts as a backup system to avoid data loss in case of system failures.