How to Keep Sensitive Information Secret

How to Keep Sensitive Information Secret

New in version 4.4: The Secrets management was introduced in Symfony 4.4.

Environment variables are the best way to store configuration that depends on where the application is run - for example, some API key that might be set to one value while developing locally and another value on production.

When these values are sensitive and need to be kept private, you can safely store them by using Symfony’s secrets management system - sometimes called a “vault”.

Note

The Secrets system requires the sodium PHP extension that is bundled with PHP 7.2. If you’re using an earlier PHP version, you can install the libsodium PHP extension or use the paragonie/sodium_compat package.

Generate Cryptographic Keys

In order to encrypt and decrypt secrets, Symfony needs cryptographic keys. A pair of keys can be generated by running:

  1. $ php bin/console secrets:generate-keys

This will generate a pair of asymmetric cryptographic keys. Each environment has its own set of keys. Assuming you’re coding locally in the dev environment, this will create:

config/secrets/dev/dev.encrypt.public.php

Used to encrypt/add secrets to the vault. Can be safely committed.

config/secrets/dev/dev.decrypt.private.php

Used to decrypt/read secrets from the vault. The dev decryption key can be committed (assuming no highly-sensitive secrets are stored in the dev vault) but the prod decryption key should never be committed.

You can generate a pair of cryptographic keys for the prod environment by running:

  1. $ php bin/console secrets:generate-keys --env=prod

This will generate config/secrets/prod/prod.encrypt.public.php and config/secrets/prod/prod.decrypt.private.php.

Caution

The prod.decrypt.private.php file is highly sensitive. Your team of developers and even Continuous Integration services don’t need that key. If the decryption key has been exposed (ex-employee leaving for instance), you should consider generating a new one by running: secrets:generate-keys --rotate.

Create or Update Secrets

Suppose you want to store your database password as a secret. By using the secrets:set command, you should add this secret to both the dev and prod vaults:

  1. # the input is hidden as you type for security reasons
  2. # set your default development value (can be overridden locally)
  3. $ php bin/console secrets:set DATABASE_PASSWORD
  4. # set your production value
  5. $ php bin/console secrets:set DATABASE_PASSWORD --env=prod

This will create a new file for the secret in config/secrets/dev and another in config/secrets/prod. You can also set the secret in a few other ways:

  1. # provide a file where to read the secret from
  2. $ php bin/console secrets:set DATABASE_PASSWORD ~/Download/password.json
  3. # or contents passed to STDIN
  4. $ echo -n "$DB_PASS" | php bin/console secrets:set DATABASE_PASSWORD -
  5. # or let Symfony generate a random value for you
  6. $ php bin/console secrets:set REMEMBER_ME --random

Referencing Secrets in Configuration Files

Secret values can be referenced in the same way as environment variables. Be careful that you don’t accidentally define a secret and an environment variable with the same name: environment variables override secrets.

If you stored a DATABASE_PASSWORD secret, you can reference it by:

  • YAML

    1. # config/packages/doctrine.yaml
    2. doctrine:
    3. dbal:
    4. password: '%env(DATABASE_PASSWORD)%'
    5. # ...
    6. # ...
  • XML

    1. <!-- config/packages/doctrine.xml -->
    2. <?xml version="1.0" encoding="UTF-8" ?>
    3. <container xmlns="http://symfony.com/schema/dic/services"
    4. xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    5. xmlns:doctrine="http://symfony.com/schema/dic/doctrine"
    6. xsi:schemaLocation="http://symfony.com/schema/dic/services
    7. https://symfony.com/schema/dic/services/services-1.0.xsd
    8. http://symfony.com/schema/dic/doctrine
    9. https://symfony.com/schema/dic/doctrine/doctrine-1.0.xsd">
    10. <doctrine:config>
    11. <doctrine:dbal
    12. password="%env(DATABASE_PASSWORD)%"
    13. />
    14. </doctrine:config>
    15. </container>
  • PHP

    1. // config/packages/doctrine.php
    2. $container->loadFromExtension('doctrine', [
    3. 'dbal' => [
    4. 'password' => '%env(DATABASE_PASSWORD)%',
    5. ]
    6. ]);

The actual value will be resolved at runtime: container compilation and cache warmup don’t need the decryption key.

List Existing Secrets

Everybody is allowed to list the secrets names with the command secrets:list. If you have the decryption key you can also reveal the secrets’ values by passing the --reveal option:

  1. $ php bin/console secrets:list --reveal
  2. ------------------- ------------ -------------
  3. Name Value Local Value
  4. ------------------- ------------ -------------
  5. DATABASE_PASSWORD "my secret"
  6. ------------------- ------------ -------------

Remove Secrets

Symfony provides a convenient command to remove a Secret:

  1. $ php bin/console secrets:remove DATABASE_PASSWORD

Local secrets: Overriding Secrets Locally

The dev environment secrets should contain nice default values for development. But sometimes a developer still needs to override a secret value locally when developing.

Most of the secrets commands - including secrets:set - have a --local option that stores the “secret” in the .env.{env}.local file as a standard environment variable. To override the DATABASE_PASSWORD secret locally, run:

  1. $ php bin/console secrets:set DATABASE_PASSWORD --local

If you entered root, you will now see this in your .env.dev.local file:

  1. DATABASE_PASSWORD=root

This will override the DATABASE_PASSWORD secret because environment variables always take precedence over secrets.

Listing the secrets will now also display the local variable:

  1. $ php bin/console secrets:list --reveal
  2. ------------------- ------------- -------------
  3. Name Value Local Value
  4. ------------------- ------------- -------------
  5. DATABASE_PASSWORD "dev value" "root"
  6. ------------------- ------------- -------------

Symfony also provides the secrets:decrypt-to-local command which decrypts all secrets and stores them in the local vault and the secrets:encrypt-from-local command to encrypt all local secrets to the vault.

Secrets in the test Environment

If you add a secret in the dev and prod environments, it will be missing from the test environment. You could create a “vault” for the test environment and define the secrets there. But an easier way is to set the test values via the .env.test file:

  1. # .env.test
  2. DATABASE_PASSWORD="testing"

Deploy Secrets to Production

Due to the fact that decryption keys should never be committed, you will need to manually store this file somewhere and deploy it. There are 2 ways to do that:

  1. Uploading the file:

The first option is to copy the production decryption key - config/secrets/prod/prod.decrypt.private.php to your server.

  1. Using an Environment Variable

The second way is to set the SYMFONY_DECRYPTION_SECRET environment variable to the base64 encoded value of the production decryption key. A fancy way to fetch the value of the key is:

  1. # this command only gets the value of the key; you must also set an env var
  2. # in your system with this value (e.g. `export SYMFONY_DECRYPTION_SECRET=...`)
  3. $ php -r 'echo base64_encode(require "config/secrets/prod/prod.decrypt.private.php");'

To improve performance (i.e. avoid decrypting secrets at runtime), you can decrypt your secrets during deployment to the “local” vault:

  1. $ php bin/console secrets:decrypt-to-local --force --env=prod

This will write all the decrypted secrets into the .env.prod.local file. After doing this, the decryption key does not need to remain on the server(s).

Rotating Secrets

The secrets:generate-keys command provides a --rotate option to regenerate the cryptographic keys. Symfony will decrypt existing secrets with the old key, generate new cryptographic keys and re-encrypt secrets with the new key. In order to decrypt previous secrets, the developer must have the decryption key.

Configuration

The secrets system is enabled by default and some of its behavior can be configured:

  • YAML

    1. # config/packages/framework.yaml
    2. framework:
    3. secrets:
    4. #vault_directory: '%kernel.project_dir%/config/secrets/%kernel.environment%'
    5. #local_dotenv_file: '%kernel.project_dir%/.env.%kernel.environment%.local'
    6. #decryption_env_var: 'base64:default::SYMFONY_DECRYPTION_SECRET'
  • XML

    1. <!-- config/packages/framework.xml -->
    2. <?xml version="1.0" encoding="UTF-8" ?>
    3. <container xmlns="http://symfony.com/schema/dic/services"
    4. xmlns:framework="http://symfony.com/schema/dic/framework"
    5. xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    6. xsi:schemaLocation="http://symfony.com/schema/dic/services https://symfony.com/schema/dic/services/services-1.0.xsd
    7. http://symfony.com/schema/dic/framework https://symfony.com/schema/dic/framework/framework-1.0.xsd"
    8. >
    9. <framework:config secret="%env(APP_SECRET)%">
    10. <framework:secrets
    11. vault_directory="%kernel.project_dir%/config/secrets/%kernel.environment%"
    12. local_dotenv_file="%kernel.project_dir%/.env.%kernel.environment%.local"
    13. decryption_env_var="base64:default::SYMFONY_DECRYPTION_SECRET"
    14. />
    15. </framework:config>
    16. </container>
  • PHP

    1. // config/packages/framework.php
    2. $container->loadFromExtension('framework', [
    3. 'secrets' => [
    4. // 'vault_directory' => '%kernel.project_dir%/config/secrets/%kernel.environment%',
    5. // 'local_dotenv_file' => '%kernel.project_dir%/.env.%kernel.environment%.local',
    6. // 'decryption_env_var' => 'base64:default::SYMFONY_DECRYPTION_SECRET',
    7. ],
    8. ]);

This work, including the code samples, is licensed under a Creative Commons BY-SA 3.0 license.