Pulsar Encryption

Pulsar encryption allows applications to encrypt messages at the producer and decrypt at the consumer. Encryption is performed using the public/private key pair configured by the application. Encrypted messages can only be decrypted by consumers with a valid key.

Asymmetric and symmetric encryption

Pulsar uses dynamically generated symmetric AES key to encrypt messages(data). The AES key(data key) is encrypted using application provided ECDSA/RSA key pair, as a result there is no need to share the secret with everyone.

Key is a public/private key pair used for encryption/decryption. The producer key is the public key, and the consumer key is the private key of the key pair.

The application configures the producer with the public key. This key is used to encrypt the AES data key. The encrypted data key is sent as part of message header. Only entities with the private key(in this case the consumer) will be able to decrypt the data key which is used to decrypt the message.

A message can be encrypted with more than one key. Any one of the keys used for encrypting the message is sufficient to decrypt the message

Pulsar does not store the encryption key anywhere in the pulsar service. If you lose/delete the private key, your message is irretrievably lost, and is unrecoverable

Producer

alt text

Consumer

alt text

Here are the steps to get started:

  1. Create your ECDSA or RSA public/private key pair.
  2. openssl ecparam -name secp521r1 -genkey -param_enc explicit -out test_ecdsa_privkey.pem
  3. openssl ec -in test_ecdsa_privkey.pem -pubout -outform pkcs8 -out test_ecdsa_pubkey.pem
  1. Add the public and private key to the key management and configure your producers to retrieve public keys and consumers clients to retrieve private keys.
  2. Implement CryptoKeyReader::getPublicKey() interface from producer and CryptoKeyReader::getPrivateKey() interface from consumer, which will be invoked by Pulsar client to load the key.
  3. Add encryption key to producer configuration: conf.addEncryptionKey(“myapp.key”)
  4. Add CryptoKeyReader implementation to producer/consumer config: conf.setCryptoKeyReader(keyReader)
  5. Sample producer application:
  2. class RawFileKeyReader implements CryptoKeyReader {
  4.     String publicKeyFile = "";
  5.     String privateKeyFile = "";
  7.     RawFileKeyReader(String pubKeyFile, String privKeyFile) {
  8.         publicKeyFile = pubKeyFile;
  9.         privateKeyFile = privKeyFile;
  10.     }
  12.     @Override
  13.     public EncryptionKeyInfo getPublicKey(String keyName, Map<String, String> keyMeta) {
  14.         EncryptionKeyInfo keyInfo = new EncryptionKeyInfo();
  15.         try {
  16.             keyInfo.setKey(Files.readAllBytes(Paths.get(publicKeyFile)));
  17.         } catch (IOException e) {
  18.             System.out.println("ERROR: Failed to read public key from file " + publicKeyFile);
  19.             e.printStackTrace();
  20.         }
  21.         return keyInfo;
  22.     }
  24.     @Override
  25.     public EncryptionKeyInfo getPrivateKey(String keyName, Map<String, String> keyMeta) {
  26.         EncryptionKeyInfo keyInfo = new EncryptionKeyInfo();
  27.         try {
  28.             keyInfo.setKey(Files.readAllBytes(Paths.get(privateKeyFile)));
  29.         } catch (IOException e) {
  30.             System.out.println("ERROR: Failed to read private key from file " + privateKeyFile);
  31.             e.printStackTrace();
  32.         }
  33.         return keyInfo;
  34.     }
  35. }
  36. PulsarClient pulsarClient = PulsarClient.create("http://localhost:8080");
  38. ProducerConfiguration prodConf = new ProducerConfiguration();
  39. prodConf.setCryptoKeyReader(new RawFileKeyReader("test_ecdsa_pubkey.pem", "test_ecdsa_privkey.pem"));
  40. prodConf.addEncryptionKey("myappkey");
  42. Producer producer = pulsarClient.createProducer("persistent://my-tenant/my-ns/my-topic", prodConf);
  44. for (int i = 0; i < 10; i++) {
  45.     producer.send("my-message".getBytes());
  46. }
  48. pulsarClient.close();
  1. Sample Consumer Application:
  2. class RawFileKeyReader implements CryptoKeyReader {
  4.     String publicKeyFile = "";
  5.     String privateKeyFile = "";
  7.     RawFileKeyReader(String pubKeyFile, String privKeyFile) {
  8.         publicKeyFile = pubKeyFile;
  9.         privateKeyFile = privKeyFile;
  10.     }
  12.     @Override
  13.     public EncryptionKeyInfo getPublicKey(String keyName, Map<String, String> keyMeta) {
  14.         EncryptionKeyInfo keyInfo = new EncryptionKeyInfo();
  15.         try {
  16.             keyInfo.setKey(Files.readAllBytes(Paths.get(publicKeyFile)));
  17.         } catch (IOException e) {
  18.             System.out.println("ERROR: Failed to read public key from file " + publicKeyFile);
  19.             e.printStackTrace();
  20.         }
  21.         return keyInfo;
  22.     }
  24.     @Override
  25.     public EncryptionKeyInfo getPrivateKey(String keyName, Map<String, String> keyMeta) {
  26.         EncryptionKeyInfo keyInfo = new EncryptionKeyInfo();
  27.         try {
  28.             keyInfo.setKey(Files.readAllBytes(Paths.get(privateKeyFile)));
  29.         } catch (IOException e) {
  30.             System.out.println("ERROR: Failed to read private key from file " + privateKeyFile);
  31.             e.printStackTrace();
  32.         }
  33.         return keyInfo;
  34.     }
  35. }
  37. ConsumerConfiguration consConf = new ConsumerConfiguration();
  38. consConf.setCryptoKeyReader(new RawFileKeyReader("test_ecdsa_pubkey.pem", "test_ecdsa_privkey.pem"));
  39. PulsarClient pulsarClient = PulsarClient.create("http://localhost:8080");
  40. Consumer consumer = pulsarClient.subscribe("persistent://my-tenant//my-ns/my-topic", "my-subscriber-name", consConf);
  41. Message msg = null;
  43. for (int i = 0; i < 10; i++) {
  44.     msg = consumer.receive();
  45.     // do something
  46.     System.out.println("Received: " + new String(msg.getData()));
  47. }
  49. // Acknowledge the consumption of all messages at once
  50. consumer.acknowledgeCumulative(msg);
  51. pulsarClient.close();

Key rotation

Pulsar generates new AES data key every 4 hours or after a certain number of messages are published. The asymmetric public key is automatically fetched by producer every 4 hours by calling CryptoKeyReader::getPublicKey() to retrieve the latest version.

Enabling encryption at the producer application:

If you produce messages that are consumed across application boundaries, you need to ensure that consumers in other applications have access to one of the private keys that can decrypt the messages. This can be done in two ways:

  1. The consumer application provides you access to their public key, which you add to your producer keys
  2. You grant access to one of the private keys from the pairs used by producer

In some cases, the producer may want to encrypt the messages with multiple keys. For this, add all such keys to the config. Consumer will be able to decrypt the message, as long as it has access to at least one of the keys.

E.g: If messages needs to be encrypted using 2 keys myapp.messagekey1 and myapp.messagekey2,

  2. conf.addEncryptionKey("myapp.messagekey1");
  3. conf.addEncryptionKey("myapp.messagekey2");

Decrypting encrypted messages at the consumer application:

Consumers require access one of the private keys to decrypt messages produced by the producer. If you would like to receive encrypted messages, create a public/private key and give your public key to the producer application to encrypt messages using your public key.

Handling Failures:

  • Producer/ Consumer loses access to the key
    • Producer action will fail indicating the cause of the failure. Application has the option to proceed with sending unencrypted message in such cases. Call conf.setCryptoFailureAction(ProducerCryptoFailureAction) to control the producer behavior. The default behavior is to fail the request.
    • If consumption failed due to decryption failure or missing keys in consumer, application has the option to consume the encrypted message or discard it. Call conf.setCryptoFailureAction(ConsumerCryptoFailureAction) to control the consumer behavior. The default behavior is to fail the request. Application will never be able to decrypt the messages if the private key is permanently lost.
  • Batch messaging
    • If decryption fails and the message contain batch messages, client will not be able to retrieve individual messages in the batch, hence message consumption fails even if conf.setCryptoFailureAction() is set to CONSUME.
  • If decryption fails, the message consumption stops and application will notice backlog growth in addition to decryption failure messages in the client log. If application does not have access to the private key to decrypt the message, the only option is to skip/discard backlogged messages.