pulsar

pulsar sink用于发送数据至pulsar存储。
该sink为beta试用状态,请谨慎使用于生产环境。

Example

  1. sink:
  2. type: pulsar
  3. url: pulsar://localhost:6650
  4. topic: my-topic

url

字段类型是否必填默认值含义
urlstring必填日志发送端pulsar连接地址

topic

字段类型是否必填默认值含义
topicstring必填发送日志至pulsar的topic

producerName

字段类型是否必填默认值含义
producerNamestring非必填specifies a name for the producer

properties

字段类型是否必填默认值含义
producerNamemap非必填Properties specifies a set of application defined properties for the producer

operationTimeoutSeconds

字段类型是否必填默认值含义
operationTimeoutSecondstime.Duration非必填30sProducer-create, subscribe and unsubscribe operations will be retried until this interval, after which the operation will be marked as failed

connectionTimeout

字段类型是否必填默认值含义
connectionTimeouttime.Duration非必填5sTimeout for the establishment of a TCP connection

sendTimeout

字段类型是否必填默认值含义
sendTimeouttime.Duration非必填30sSendTimeout set the timeout for a message that is not acknowledged by the server 30s

maxPendingMessages

字段类型是否必填默认值含义
sendTimeouttime.Duration非必填MaxPendingMessages specifies the max size of the queue holding the messages pending to receive an acknowledgment from the broker

hashingSchema

字段类型是否必填默认值含义
hashingSchemaint非必填0HashingScheme is used to define the partition on where to publish a particular message. 0:JavaStringHash,1:Murmur3_32Hash

compressionType

字段类型是否必填默认值含义
compressionTypeint非必填00:NoCompression, 1:LZ4, 2:ZLIB, 3:ZSTD

compressionLevel

字段类型是否必填默认值含义
compressionLevelint非必填00:Default, 1:Faster, 2:Better

logLevel

字段类型是否必填默认值含义
logLevelstring非必填0日志级别: “info”,”debug”, “error”

batchingMaxSize

字段类型是否必填默认值含义
batchingMaxSizeint非必填2048(KB)BatchingMaxSize specifies the maximum number of bytes permitted in a batch

batchingMaxMessages

字段类型是否必填默认值含义
batchingMaxMessagesint非必填1000BatchingMaxMessages specifies the maximum number of messages permitted in a batch

batchingMaxPublishDelay

字段类型是否必填默认值含义
batchingMaxPublishDelaytime.Duration非必填10msBatchingMaxPublishDelay specifies the time period within which the messages sent will be batched

useTLS

字段类型是否必填默认值含义
useTLSbool非必填false是否使用TLS认证

tlsTrustCertsFilePath

字段类型是否必填默认值含义
tlsTrustCertsFilePathstring非必填the path to the trusted TLS certificate file

tlsAllowInsecureConnection

字段类型是否必填默认值含义
tlsAllowInsecureConnectionbool非必填falseConfigure whether the Pulsar client accept untrusted TLS certificate from broker

certificatePath

字段类型是否必填默认值含义
certificatePathstring非必填TLS证书路径

privateKeyPath

字段类型是否必填默认值含义
privateKeyPathstring非必填TLS privateKey路径

token

字段类型是否必填默认值含义
tokenstring非必填如果使用token认证鉴权pulsar,请填写此项

tokenFilePath

字段类型是否必填默认值含义
tokenFilePathstring非必填auth token from a file