Running the Apache Beam samples With Apache Spark Get Spark Start your local Spark single node cluster Run sample pipeline with Spark Submit Running the Apache Beam samples W...

Pulsar adaptor for Apache Spark Spark Streaming receiver Prerequisites Maven Gradle Usage Pulsar adaptor for Apache Spark Spark Streaming receiver The Spark Streaming rece...

Apache Kafka Component format Spec metadata fields Authentication None SASL Password Mutual TLS OAuth2 or OpenID Connect Communication using TLS Per-call metadata fields Pa...

Apache Kylin Apache Kylin The recommended connector library for Apache Kylin is kylinpy . The expected connection string is formatted as follows: kylin : //<username>:<passwor...

Apache Hive Apache Hive The pyhive library is the recommended way to connect to Hive through SQLAlchemy. The expected connection string is formatted as follows: hive : //hive...

Apache Drill SQLAlchemy JDBC ODBC Apache Drill SQLAlchemy The recommended way to connect to Apache Drill is through SQLAlchemy. You can use the sqlalchemy-drill package. O...

Apache Derby Apache Derby Option Info Type Relational Driver Included Version Included 10.15.1.3 Hop Dependencies None Documentation Documentation Link JDBC Url jd...

Apache Tika Description Options Metadata Injection Support Apache Tika Description The Apache Tika transform parses files in all sorts of formats and extracts the text conte...

Apache Derby Apache Derby Option Info Type Relational Driver Included Version Included 10.15.1.3 Hop Dependencies None Documentation Documentation Link JDBC Url jd...

Apache Kafka 配置 Warning 元数据字段规范 每次调用的元数据字段 分区键 创建 Kafka 实例 相关链接 Apache Kafka 关于Apache Kafka pubsub组件的详细文档 配置 要设置Apache Kafka pubsub，请创建一个pubsub.kafka 类型的组件。 See this gu...