Package Java Functions

Package Java Functions - 图1note

If you plan to package and distribute your function for others to use, you are obligated to license and copyright your own code properly. Remember to add the license and copyright to all libraries your code uses and to your distribution.

If you use the NAR method, the NAR plugin automatically creates a DEPENDENCIES file in the generated NAR package, including the proper licensing and copyrights of all libraries of your function.

For the runtime Java version, refer to Pulsar Runtime Java Version Recommendation according to your target Pulsar version.

There are two methods to package Java Functions:

Package as JAR

To package a Java function as JAR, complete the following steps.

  1. Create a new maven project with a pom file. In the following code sample, the value of mainClass is your package name.

    1.  <?xml version="1.0" encoding="UTF-8"?>
    2.  <project xmlns="http://maven.apache.org/POM/4.0.0"
    3.          xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    4.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    5.      <modelVersion>4.0.0</modelVersion>
    7.      <groupId>java-function</groupId>
    8.      <artifactId>java-function</artifactId>
    9.      <version>1.0-SNAPSHOT</version>
    11.      <dependencies>
    12.          <dependency>
    13.              <groupId>org.apache.pulsar</groupId>
    14.              <artifactId>pulsar-functions-api</artifactId>
    15.              <version>4.0.0</version>
    16.          </dependency>
    17.      </dependencies>
    19.      <build>
    20.          <plugins>
    21.              <plugin>
    22.                  <artifactId>maven-assembly-plugin</artifactId>
    23.                  <configuration>
    24.                      <appendAssemblyId>false</appendAssemblyId>
    25.                      <descriptorRefs>
    26.                          <descriptorRef>jar-with-dependencies</descriptorRef>
    27.                      </descriptorRefs>
    28.                      <archive>
    29.                      <manifest>
    30.                          <mainClass>org.example.test.ExclamationFunction</mainClass>
    31.                      </manifest>
    32.                  </archive>
    33.                  </configuration>
    34.                  <executions>
    35.                      <execution>
    36.                          <id>make-assembly</id>
    37.                          <phase>package</phase>
    38.                          <goals>
    39.                              <goal>assembly</goal>
    40.                          </goals>
    41.                      </execution>
    42.                  </executions>
    43.              </plugin>
    44.              <plugin>
    45.                  <groupId>org.apache.maven.plugins</groupId>
    46.                  <artifactId>maven-compiler-plugin</artifactId>
    47.                  <version>3.11.0</version>
    48.                  <configuration>
    49.                      <release>17</release>
    50.                  </configuration>
    51.              </plugin>
    52.          </plugins>
    53.      </build>
    55.  </project>

  2. Package your Java function.

    1.  mvn package

    After the Java function is packaged, a target directory is created automatically. Open the target directory to check if there is a JAR package similar to java-function-1.0-SNAPSHOT.jar.

  3. Run the Java function using the following command.

    1.  ./bin/pulsar-admin functions localrun \
    2.     --classname org.example.test.ExclamationFunction \
    3.     --jar $PWD/target/java-function-1.0-SNAPSHOT.jar \
    4.     --inputs persistent://public/default/my-topic-1 \
    5.     --output persistent://public/default/test-1 \
    6.     --tenant public \
    7.     --namespace default \
    8.     --name JavaFunction

    The following log indicates that the Java function starts successfully.

    1.  ...
    2.  07:55:03.724 [main] INFO  org.apache.pulsar.functions.runtime.ProcessRuntime - Started process successfully
    3.  ...

Package as NAR

To package a Java function as NAR, complete the following steps.

  1. Create a new maven project with a pom file.

    1.  <?xml version="1.0" encoding="UTF-8"?>
    2.  <project xmlns="http://maven.apache.org/POM/4.0.0"
    3.          xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    4.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    5.      <modelVersion>4.0.0</modelVersion>
    7.      <groupId>java-function</groupId>
    8.      <artifactId>java-function</artifactId>
    9.      <version>1.0-SNAPSHOT</version>
    11.      <dependencies>
    12.          <dependency>
    13.              <groupId>org.apache.pulsar</groupId>
    14.              <artifactId>pulsar-functions-api</artifactId>
    15.              <version>4.0.0</version>
    16.          </dependency>
    17.      </dependencies>
    19.      <build>
    20.          <plugins>
    21.              <plugin>
    22.                  <groupId>org.apache.nifi</groupId>
    23.                  <artifactId>nifi-nar-maven-plugin</artifactId>
    24.                  <version>1.5.0</version>
    25.                  </plugin>
    26.              <plugin>
    27.                  <groupId>org.apache.maven.plugins</groupId>
    28.                  <artifactId>maven-compiler-plugin</artifactId>
    29.                  <version>3.11.0</version>
    30.                  <configuration>
    31.                      <release>17</release>
    32.                  </configuration>
    33.              </plugin>
    34.          </plugins>
    35.      </build>
    37.  </project>

    You must also create a resources/META-INF/services/pulsar-io.yaml file. In the following code sample, the value of functionClass is your function class name. The name is the one used when the Function is deployed as a built-in one.

    1. name: java-function
    2. description: my java function
    3. functionClass: org.example.test.ExclamationFunction

  2. Package your Java function.

    1. mvn package

    After the Java function is packaged, a target directory is created automatically. Open the target directory to check if there is a NAR package similar to java-function-1.0-SNAPSHOT.nar.

  3. Run the Java function using the following command.

    1.  ./bin/pulsar-admin functions localrun \
    2.     --jar $PWD/target/java-function-1.0-SNAPSHOT.nar \
    3.     --inputs persistent://public/default/my-topic-1 \
    4.     --output persistent://public/default/test-1 \
    5.     --tenant public \
    6.     --namespace default \
    7.     --name JavaFunction

    The following log indicates that the Java function starts successfully.

    1.  ...
    2.  07:55:03.724 [main] INFO  org.apache.pulsar.functions.runtime.ProcessRuntime - Started process successfully
    3.  ...