Flink provides a set of table formats that can be used with table connectors. A table format is a storage format that defines how to map binary data onto table columns.
Flink supports the following formats:
Formats | Supported Connectors |
---|
CSV | Apache Kafka, Upsert Kafka, Amazon Kinesis Data Streams, Amazon Kinesis Data Firehose, Filesystem |
JSON | Apache Kafka, Upsert Kafka, Amazon Kinesis Data Streams, Amazon Kinesis Data Firehose, Filesystem, Elasticsearch |
Apache Avro | Apache Kafka, Upsert Kafka, Amazon Kinesis Data Streams, Amazon Kinesis Data Firehose, Filesystem |
Confluent Avro | Apache Kafka, Upsert Kafka |
Protobuf | Apache Kafka |
Debezium CDC | Apache Kafka, Filesystem |
Canal CDC | Apache Kafka, Filesystem |
Maxwell CDC | Apache Kafka, Filesystem |
OGG CDC | Apache Kafka, Filesystem |
Apache Parquet | Filesystem |
Apache ORC | Filesystem |
Raw | Apache Kafka, Upsert Kafka, Amazon Kinesis Data Streams, Amazon Kinesis Data Firehose, Filesystem |