- Testing
- Installing PHPUnit
- Test Database Setup
- Checking the Test Setup
- Test Case Conventions
- Creating Your First Test Case
- Running Tests
- Test Case Lifecycle Callbacks
- Fixtures
- Testing Table Classes
- Controller Integration Testing
- Setting up the Request
- Testing Actions That Require Authentication
- Testing Stateless Authentication and APIs
- Testing Actions Protected by CsrfComponent or SecurityComponent
- Integration Testing PSR-7 Middleware
- Testing with Encrypted Cookies
- Testing Flash Messages
- Testing a JSON Responding Controller
- Disabling Error Handling Middleware in Tests
- Assertion methods
- Comparing test results to a file
- Console Integration Testing
- Testing Views
- Testing Components
- Testing Helpers
- Testing Events
- Testing Email
- Creating Test Suites
- Creating Tests for Plugins
- Generating Tests with Bake
- Integration with Jenkins
Testing
CakePHP comes with comprehensive testing support built-in. CakePHP comes withintegration for PHPUnit. In addition to the featuresoffered by PHPUnit, CakePHP offers some additional features to make testingeasier. This section will cover installing PHPUnit, and getting started withUnit Testing, and how you can use the extensions that CakePHP offers.
Installing PHPUnit
CakePHP uses PHPUnit as its underlying test framework. PHPUnit is the de-factostandard for unit testing in PHP. It offers a deep and powerful set of featuresfor making sure your code does what you think it does. PHPUnit can be installedthrough using either a PHAR package orComposer.
Install PHPUnit with Composer
To install PHPUnit with Composer:
- $ php composer.phar require --dev phpunit/phpunit:"^7.0"
This will add the dependency to the require-dev
section of yourcomposer.json
, and then install PHPUnit along with any dependencies.
You can now run PHPUnit using:
- $ vendor/bin/phpunit
Using the PHAR File
After you have downloaded the phpunit.phar file, you can use it to run yourtests:
- php phpunit.phar
Tip
As a convenience you can make phpunit.phar available globallyon Unix or Linux with the following:
- chmod +x phpunit.phar
- sudo mv phpunit.phar /usr/local/bin/phpunit
- phpunit --version
Please refer to the PHPUnit documentation for instructions regardingGlobally installing the PHPUnit PHAR on Windows.
Test Database Setup
Remember to have debug enabled in your config/app.php file before runningany tests. Before running any tests you should be sure to add a test
datasource configuration to config/app.php. This configuration is used byCakePHP for fixture tables and data:
- 'Datasources' => [
- 'test' => [
- 'datasource' => 'Cake\Database\Driver\Mysql',
- 'persistent' => false,
- 'host' => 'dbhost',
- 'username' => 'dblogin',
- 'password' => 'dbpassword',
- 'database' => 'test_database'
- ],
- ],
Note
It’s a good idea to make the test database and your actual databasedifferent databases. This will prevent embarrassing mistakes later.
Checking the Test Setup
After installing PHPUnit and setting up your test
datasource configurationyou can make sure you’re ready to write and run your own tests by running yourapplication’s tests:
- # For phpunit.phar
- $ php phpunit.phar
- # For Composer installed phpunit
- $ vendor/bin/phpunit
The above should run any tests you have, or let you know that no tests were run.To run a specific test you can supply the path to the test as a parameter toPHPUnit. For example, if you had a test case for ArticlesTable class you couldrun it with:
- $ vendor/bin/phpunit tests/TestCase/Model/Table/ArticlesTableTest
You should see a green bar with some additional information about the tests run,and number passed.
Note
If you are on a Windows system you probably won’t see any colours.
Test Case Conventions
Like most things in CakePHP, test cases have some conventions. Concerningtests:
- PHP files containing tests should be in your
tests/TestCase/[Type]
directories. - The filenames of these files should end in Test.php insteadof just .php.
- The classes containing tests should extend
Cake\TestSuite\TestCase
,Cake\TestSuite\IntegrationTestCase
or\PHPUnit\Framework\TestCase
. - Like other classnames, the test case classnames should match the filename.RouterTest.php should contain
class RouterTest extends TestCase
. - The name of any method containing a test (i.e. containing anassertion) should begin with
test
, as intestPublished()
.You can also use the@test
annotation to mark methods as test methods.
Creating Your First Test Case
In the following example, we’ll create a test case for a very simple helpermethod. The helper we’re going to test will be formatting progress bar HTML.Our helper looks like:
- namespace App\View\Helper;
- use Cake\View\Helper;
- class ProgressHelper extends Helper
- {
- public function bar($value)
- {
- $width = round($value / 100, 2) * 100;
- return sprintf(
- '<div class="progress-container">
- <div class="progress-bar" style="width: %s%%"></div>
- </div>', $width);
- }
- }
This is a very simple example, but it will be useful to show how you can createa simple test case. After creating and saving our helper, we’ll create the testcase file in tests/TestCase/View/Helper/ProgressHelperTest.php. In that filewe’ll start with the following:
- namespace App\Test\TestCase\View\Helper;
- use App\View\Helper\ProgressHelper;
- use Cake\TestSuite\TestCase;
- use Cake\View\View;
- class ProgressHelperTest extends TestCase
- {
- public function setUp()
- {
- }
- public function testBar()
- {
- }
- }
We’ll flesh out this skeleton in a minute. We’ve added two methods to startwith. First is setUp()
. This method is called before every test methodin a test case class. Setup methods should initialize the objects needed for thetest, and do any configuration needed. In our setup method we’ll add thefollowing:
- public function setUp()
- {
- parent::setUp();
- $View = new View();
- $this->Progress = new ProgressHelper($View);
- }
Calling the parent method is important in test cases, as TestCase::setUp()
does a number things like backing up the values inCore\Configure
and, storing the paths inCore\App
.
Next, we’ll fill out the test method. We’ll use some assertions to ensure thatour code creates the output we expect:
- public function testBar()
- {
- $result = $this->Progress->bar(90);
- $this->assertContains('width: 90%', $result);
- $this->assertContains('progress-bar', $result);
- $result = $this->Progress->bar(33.3333333);
- $this->assertContains('width: 33%', $result);
- }
The above test is a simple one but shows the potential benefit of using testcases. We use assertContains()
to ensure that our helper is returning astring that contains the content we expect. If the result did not contain theexpected content the test would fail, and we would know that our code isincorrect.
By using test cases you can describe the relationship between a set ofknown inputs and their expected output. This helps you be more confident of thecode you’re writing as you can ensure that the code you wrote fulfills theexpectations and assertions your tests make. Additionally because tests arecode, they are easy to re-run whenever you make a change. This helps preventthe creation of new bugs.
Note
EventManager is refreshed for each test method. This means that when runningmultiple tests at once, you will lose your event listeners that wereregistered in config/bootstrap.php as the bootstrap is only executed once.
Running Tests
Once you have PHPUnit installed and some test cases written, you’ll want to runthe test cases very frequently. It’s a good idea to run tests before committingany changes to help ensure you haven’t broken anything.
By using phpunit
you can run your application tests. To run yourapplication’s tests you can simply run:
- # composer install
- $ vendor/bin/phpunit
- # phar file
- php phpunit.phar
If you have cloned the CakePHP source from GitHuband wish to run CakePHP’s unit-tests don’t forget to execute the following Composer
command prior to running phpunit
so that any dependencies are installed:
- $ composer install
From your application’s root directory. To run tests for a plugin that is partof your application source, first cd
into the plugin directory, then usephpunit
command that matches how you installed phpunit:
- cd plugins
- # Using composer installed phpunit
- ../vendor/bin/phpunit
- # Using phar file
- php ../phpunit.phar
To run tests on a standalone plugin, you should first install the project ina separate directory and install its dependencies:
- git clone git://github.com/cakephp/debug_kit.git
- cd debug_kit
- php ~/composer.phar install
- php ~/phpunit.phar
Filtering Test Cases
When you have larger test cases, you will often want to run a subset of the testmethods when you are trying to work on a single failing case. With theCLI runner you can use an option to filter test methods:
- $ phpunit --filter testSave tests/TestCase/Model/Table/ArticlesTableTest
The filter parameter is used as a case-sensitive regular expression forfiltering which test methods to run.
Generating Code Coverage
You can generate code coverage reports from the command line using PHPUnit’sbuilt-in code coverage tools. PHPUnit will generate a set of static HTML filescontaining the coverage results. You can generate coverage for a test case bydoing the following:
- $ phpunit --coverage-html webroot/coverage tests/TestCase/Model/Table/ArticlesTableTest
This will put the coverage results in your application’s webroot directory. Youshould be able to view the results by going tohttp://localhost/your_app/coverage
.
You can also use phpdbg
to generate coverage instead of xdebug.phpdbg
is generally faster at generating coverage:
- $ phpdbg -qrr phpunit --coverage-html webroot/coverage tests/TestCase/Model/Table/ArticlesTableTest
Combining Test Suites for Plugins
Often times your application will be composed of several plugins. In thesesituations it can be pretty tedious to run tests for each plugin. You can makerunning tests for each of the plugins that compose your application by addingadditional <testsuite>
sections to your application’s phpunit.xml.distfile:
- <testsuites>
- <testsuite name="app">
- <directory>./tests/TestCase/</directory>
- </testsuite>
- <!-- Add your plugin suites -->
- <testsuite name="forum">
- <directory>./plugins/Forum/tests/TestCase/</directory>
- </testsuite>
- </testsuites>
Any additional test suites added to the <testsuites>
element willautomatically be run when you use phpunit
.
If you are using <testsuites>
to use fixtures from plugins that you haveinstalled with composer, the plugin’s composer.json
file should add thefixture namespace to the autoload section. Example:
- "autoload-dev": {
- "psr-4": {
- "PluginName\\Test\\Fixture\\": "tests/Fixture/"
- }
- },
Test Case Lifecycle Callbacks
Test cases have a number of lifecycle callbacks you can use when doing testing:
setUp
is called before every test method. Should be used to create theobjects that are going to be tested, and initialize any data for the test.Always remember to callparent::setUp()
tearDown
is called after every test method. Should be used to cleanup afterthe test is complete. Always remember to callparent::tearDown()
.setupBeforeClass
is called once before test methods in a case are started.This method must be static.tearDownAfterClass
is called once after test methods in a case are started.This method must be static.
Fixtures
When testing code that depends on models and the database, one can usefixtures as a way to generate temporary data tables loaded with sample datathat can be used by the test. The benefit of using fixtures is that your testhas no chance of disrupting live application data. In addition, you can begintesting your code prior to actually developing live content for an application.
CakePHP uses the connection named test
in your config/app.phpconfiguration file. If this connection is not usable, an exception will beraised and you will not be able to use database fixtures.
CakePHP performs the following during the course of a fixture basedtest case:
- Creates tables for each of the fixtures needed.
- Populates tables with data, if data is provided in fixture.
- Runs test methods.
- Empties the fixture tables.
- Removes fixture tables from database.
Test Connections
By default CakePHP will alias each connection in your application. Eachconnection defined in your application’s bootstrap that does not start withtest
will have a test
prefixed alias created. Aliasing connectionsensures, you don’t accidentally use the wrong connection in test cases.Connection aliasing is transparent to the rest of your application. For exampleif you use the ‘default’ connection, instead you will get the test
connection in test cases. If you use the ‘replica’ connection, the test suitewill attempt to use ‘test_replica’.
PHPUnit Configuration
Before you can use fixtures you should double check that your phpunit.xml
contains the fixture listener:
- <!-- in phpunit.xml -->
- <!-- Setup a listener for fixtures -->
- <listeners>
- <listener
- class="\Cake\TestSuite\Fixture\FixtureInjector">
- <arguments>
- <object class="\Cake\TestSuite\Fixture\FixtureManager" />
- </arguments>
- </listener>
- </listeners>
The listener is included in your application and plugins generated by bake
by default.
Creating Fixtures
When creating a fixture you will mainly define two things: how the table iscreated (which fields are part of the table), and which records will beinitially populated to the table. Let’s create our first fixture, that will beused to test our own Article model. Create a file named ArticlesFixture.phpin your tests/Fixture directory, with the following content:
- namespace App\Test\Fixture;
- use Cake\TestSuite\Fixture\TestFixture;
- class ArticlesFixture extends TestFixture
- {
- // Optional. Set this property to load fixtures to a different test datasource
- public $connection = 'test';
- public $fields = [
- 'id' => ['type' => 'integer'],
- 'title' => ['type' => 'string', 'length' => 255, 'null' => false],
- 'body' => 'text',
- 'published' => ['type' => 'integer', 'default' => '0', 'null' => false],
- 'created' => 'datetime',
- 'modified' => 'datetime',
- '_constraints' => [
- 'primary' => ['type' => 'primary', 'columns' => ['id']]
- ]
- ];
- public $records = [
- [
- 'title' => 'First Article',
- 'body' => 'First Article Body',
- 'published' => '1',
- 'created' => '2007-03-18 10:39:23',
- 'modified' => '2007-03-18 10:41:31'
- ],
- [
- 'title' => 'Second Article',
- 'body' => 'Second Article Body',
- 'published' => '1',
- 'created' => '2007-03-18 10:41:23',
- 'modified' => '2007-03-18 10:43:31'
- ],
- [
- 'title' => 'Third Article',
- 'body' => 'Third Article Body',
- 'published' => '1',
- 'created' => '2007-03-18 10:43:23',
- 'modified' => '2007-03-18 10:45:31'
- ]
- ];
- }
Note
It is recommended to not manually add values to auto incremental columns,as it interferes with the sequence generation in PostgreSQL and SQLServer.
The $connection
property defines the datasource of which the fixture willuse. If your application uses multiple datasources, you should make thefixtures match the model’s datasources but prefixed with test_
.For example if your model uses the mydb
datasource, your fixture should usethe test_mydb
datasource. If the test_mydb
connection doesn’t exist,your models will use the default test
datasource. Fixture datasources mustbe prefixed with test
to reduce the possibility of accidentally truncatingall your application’s data when running tests.
We use $fields
to specify which fields will be part of this table, and howthey are defined. The format used to define these fields is the same used withCake\Database\Schema\Table
. The keys available for tabledefinition are:
- type
CakePHP internal data type. Currently supported:
string
: maps toVARCHAR
char
: maps toCHAR
uuid
: maps toUUID
text
: maps toTEXT
integer
: maps toINT
biginteger
: maps toBIGINTEGER
decimal
: maps toDECIMAL
float
: maps toFLOAT
datetime
: maps toDATETIME
datetimefractional
: maps toDATETIME(6)
orTIMESTAMP
timestamp
: maps toTIMESTAMP
timestampfractional
: maps toTIMESTAMP(6)
orTIMESTAMP
timestamp
: maps toTIMESTAMP
time
: maps toTIME
date
: maps toDATE
binary
: maps toBLOB
- length
- Set to the specific length the field should take.
- precision
- Set the number of decimal places used on float & decimal fields.
- null
- Set to either
true
(to allow NULLs) orfalse
(to disallow NULLs). - default
- Default value the field takes.
We can define a set of records that will be populated after the fixture table iscreated. The format is fairly straight forward, $records
is an array ofrecords. Each item in $records
should be a single row. Inside each row,should be an associative array of the columns and values for the row. Just keepin mind that each record in the $records array must have a key for everyfield specified in the $fields
array. If a field for a particular recordneeds to have a null
value, just specify the value of that key as null
.
Dynamic Data and Fixtures
Since records for a fixture are declared as a class property, you cannot usefunctions or other dynamic data to define fixtures. To solve this problem, youcan define $records
in the init()
function of your fixture. For exampleif you wanted all the created and modified timestamps to reflect today’s dateyou could do the following:
- namespace App\Test\Fixture;
- use Cake\TestSuite\Fixture\TestFixture;
- class ArticlesFixture extends TestFixture
- {
- public $fields = [
- 'id' => ['type' => 'integer'],
- 'title' => ['type' => 'string', 'length' => 255, 'null' => false],
- 'body' => 'text',
- 'published' => ['type' => 'integer', 'default' => '0', 'null' => false],
- 'created' => 'datetime',
- 'modified' => 'datetime',
- '_constraints' => [
- 'primary' => ['type' => 'primary', 'columns' => ['id']],
- ]
- ];
- public function init()
- {
- $this->records = [
- [
- 'title' => 'First Article',
- 'body' => 'First Article Body',
- 'published' => '1',
- 'created' => date('Y-m-d H:i:s'),
- 'modified' => date('Y-m-d H:i:s'),
- ],
- ];
- parent::init();
- }
- }
When overriding init()
remember to always call parent::init()
.
Importing Table Information
Defining the schema in fixture files can be really handy when creating pluginsor libraries or if you are creating an application that needs to be portablebetween database vendors. Redefining the schema in fixtures can become difficultto maintain in larger applications. Because of this CakePHP provides the abilityto import the schema from an existing connection and use the reflected tabledefinition to create the table definition used in the test suite.
Let’s start with an example. Assuming you have a table named articles availablein your application, change the example fixture given in the previous section(tests/Fixture/ArticlesFixture.php) to:
- class ArticlesFixture extends TestFixture
- {
- public $import = ['table' => 'articles'];
- }
If you want to use a different connection use:
- class ArticlesFixture extends TestFixture
- {
- public $import = ['table' => 'articles', 'connection' => 'other'];
- }
Usually, you have a Table class along with your fixture, as well. You can alsouse that to retrieve the table name:
- class ArticlesFixture extends TestFixture
- {
- public $import = ['model' => 'Articles'];
- }
Since this uses TableRegistry::getTableLocator()->get()
, it also supports plugin syntax.
You can naturally import your table definition from an existing model/table, buthave your records defined directly on the fixture as it was shown on previoussection. For example:
- class ArticlesFixture extends TestFixture
- {
- public $import = ['table' => 'articles'];
- public $records = [
- [
- 'title' => 'First Article',
- 'body' => 'First Article Body',
- 'published' => '1',
- 'created' => '2007-03-18 10:39:23',
- 'modified' => '2007-03-18 10:41:31'
- ],
- [
- 'title' => 'Second Article',
- 'body' => 'Second Article Body',
- 'published' => '1',
- 'created' => '2007-03-18 10:41:23',
- 'modified' => '2007-03-18 10:43:31'
- ],
- [
- 'title' => 'Third Article',
- 'body' => 'Third Article Body',
- 'published' => '1',
- 'created' => '2007-03-18 10:43:23',
- 'modified' => '2007-03-18 10:45:31'
- ]
- ];
- }
Finally, it’s possible to not load/create any schema in a fixture. This is useful if youalready have a test database setup with all the empty tables created. Bydefining neither $fields
nor $import
, a fixture will only insert itsrecords and truncate the records on each test method.
Loading Fixtures in your Test Cases
After you’ve created your fixtures, you’ll want to use them in your test cases.In each test case you should load the fixtures you will need. You should load afixture for every model that will have a query run against it. To load fixturesyou define the $fixtures
property in your model:
- class ArticlesTest extends TestCase
- {
- public $fixtures = ['app.Articles', 'app.Comments'];
- }
Note
You can also override TestCase::getFixtures()
instead of definingthe $fixtures
property:
- public function getFixtures()
- {
- return ['app.Articles', 'app.Comments'];
- }
The above will load the Article and Comment fixtures from the application’sFixture directory. You can also load fixtures from CakePHP core, or plugins:
- class ArticlesTest extends TestCase
- {
- public $fixtures = [
- 'plugin.DebugKit.Articles',
- 'plugin.MyVendorName/MyPlugin.Messages',
- 'core.Comments'
- ];
- }
Using the core
prefix will load fixtures from CakePHP, and using a pluginname as the prefix, will load the fixture from the named plugin.
You can control when your fixtures are loaded by settingCake\TestSuite\TestCase::$autoFixtures
to false
and later loadthem using Cake\TestSuite\TestCase::loadFixtures()
:
- class ArticlesTest extends TestCase
- {
- public $fixtures = ['app.Articles', 'app.Comments'];
- public $autoFixtures = false;
- public function testMyFunction()
- {
- $this->loadFixtures('Articles', 'Comments');
- }
- }
You can load fixtures in subdirectories. Using multiple directories can make iteasier to organize your fixtures if you have a larger application. To loadfixtures in subdirectories, simply include the subdirectory name in the fixturename:
- class ArticlesTest extends CakeTestCase
- {
- public $fixtures = ['app.Blog/Articles', 'app.Blog/Comments'];
- }
In the above example, both fixtures would be loaded fromtests/Fixture/Blog/
.
Testing Table Classes
Let’s say we already have our Articles Table class defined insrc/Model/Table/ArticlesTable.php, and it looks like:
- namespace App\Model\Table;
- use Cake\ORM\Table;
- use Cake\ORM\Query;
- class ArticlesTable extends Table
- {
- public function findPublished(Query $query, array $options)
- {
- $query->where([
- $this->alias() . '.published' => 1
- ]);
- return $query;
- }
- }
We now want to set up a test that will test this table class. Let’s now createa file named ArticlesTableTest.php in your tests/TestCase/Model/Table directory,with the following contents:
- namespace App\Test\TestCase\Model\Table;
- use App\Model\Table\ArticlesTable;
- use Cake\ORM\TableRegistry;
- use Cake\TestSuite\TestCase;
- class ArticlesTableTest extends TestCase
- {
- public $fixtures = ['app.Articles'];
- }
In our test cases’ variable $fixtures
we define the set of fixtures thatwe’ll use. You should remember to include all the fixtures that will havequeries run against them.
Creating a Test Method
Let’s now add a method to test the function published()
in the Articlestable. Edit the file tests/TestCase/Model/Table/ArticlesTableTest.php so itnow looks like this:
- namespace App\Test\TestCase\Model\Table;
- use App\Model\Table\ArticlesTable;
- use Cake\ORM\TableRegistry;
- use Cake\TestSuite\TestCase;
- class ArticlesTableTest extends TestCase
- {
- public $fixtures = ['app.Articles'];
- public function setUp()
- {
- parent::setUp();
- $this->Articles = TableRegistry::getTableLocator()->get('Articles');
- }
- public function testFindPublished()
- {
- $query = $this->Articles->find('published');
- $this->assertInstanceOf('Cake\ORM\Query', $query);
- $result = $query->enableHydration(false)->toArray();
- $expected = [
- ['id' => 1, 'title' => 'First Article'],
- ['id' => 2, 'title' => 'Second Article'],
- ['id' => 3, 'title' => 'Third Article']
- ];
- $this->assertEquals($expected, $result);
- }
- }
You can see we have added a method called testFindPublished()
. We start bycreating an instance of our ArticlesTable
class, and then run ourfind('published')
method. In $expected
we set what we expect should bethe proper result (that we know since we have defined which records areinitially populated to the article table.) We test that the result equals ourexpectation by using the assertEquals()
method. See the Running Testssection for more information on how to run your test case.
Mocking Model Methods
There will be times you’ll want to mock methods on models when testing them. Youshould use getMockForModel
to create testing mocks of table classes. Itavoids issues with reflected properties that normal mocks have:
- public function testSendingEmails()
- {
- $model = $this->getMockForModel('EmailVerification', ['send']);
- $model->expects($this->once())
- ->method('send')
- ->will($this->returnValue(true));
- $model->verifyEmail('test@example.com');
- }
In your tearDown()
method be sure to remove the mock with:
- TableRegistry::clear();
Controller Integration Testing
While you can test controller classes in a similar fashion to Helpers, Models,and Components, CakePHP offers a specialized IntegrationTestTrait
trait.Using this trait in your controller test cases allows you totest controllers from a high level.
If you are unfamiliar with integration testing, it is a testing approach thatmakes it easy to test multiple units in concert. The integration testingfeatures in CakePHP simulate an HTTP request being handled by your application.For example, testing your controller will also exercise any components, modelsand helpers that would be involved in handling a given request. This gives you amore high level test of your application and all its working parts.
Say you have a typical ArticlesController, and its corresponding model. Thecontroller code looks like:
- namespace App\Controller;
- use App\Controller\AppController;
- class ArticlesController extends AppController
- {
- public $helpers = ['Form', 'Html'];
- public function index($short = null)
- {
- if ($this->request->is('post')) {
- $article = $this->Articles->newEntity($this->request->getData());
- if ($this->Articles->save($article)) {
- // Redirect as per PRG pattern
- return $this->redirect(['action' => 'index']);
- }
- }
- if (!empty($short)) {
- $result = $this->Articles->find('all', [
- 'fields' => ['id', 'title']
- ]);
- } else {
- $result = $this->Articles->find();
- }
- $this->set([
- 'title' => 'Articles',
- 'articles' => $result
- ]);
- }
- }
Create a file named ArticlesControllerTest.php in yourtests/TestCase/Controller directory and put the following inside:
- namespace App\Test\TestCase\Controller;
- use Cake\ORM\TableRegistry;
- use Cake\TestSuite\IntegrationTestTrait;
- use Cake\TestSuite\TestCase;
- class ArticlesControllerTest extends TestCase
- {
- use IntegrationTestTrait;
- public $fixtures = ['app.Articles'];
- public function testIndex()
- {
- $this->get('/articles');
- $this->assertResponseOk();
- // More asserts.
- }
- public function testIndexQueryData()
- {
- $this->get('/articles?page=1');
- $this->assertResponseOk();
- // More asserts.
- }
- public function testIndexShort()
- {
- $this->get('/articles/index/short');
- $this->assertResponseOk();
- $this->assertResponseContains('Articles');
- // More asserts.
- }
- public function testIndexPostData()
- {
- $data = [
- 'user_id' => 1,
- 'published' => 1,
- 'slug' => 'new-article',
- 'title' => 'New Article',
- 'body' => 'New Body'
- ];
- $this->post('/articles', $data);
- $this->assertResponseSuccess();
- $articles = TableRegistry::getTableLocator()->get('Articles');
- $query = $articles->find()->where(['title' => $data['title']]);
- $this->assertEquals(1, $query->count());
- }
- }
This example shows a few of the request sending methods and a few of theassertions that IntegrationTestTrait
provides. Before you can do anyassertions you’ll need to dispatch a request. You can use one of the followingmethods to send a request:
get()
Sends a GET request.post()
Sends a POST request.put()
Sends a PUT request.delete()
Sends a DELETE request.patch()
Sends a PATCH request.options()
Sends an OPTIONS request.head()
Sends a HEAD request.
All of the methods except get()
and delete()
accept a second parameterthat allows you to send a request body. After dispatching a request you can usethe various assertions provided by IntegrationTestTrait
or PHPUnit toensure your request had the correct side-effects.
Setting up the Request
The IntegrationTestTrait
trait comes with a number of helpers to make it easyto configure the requests you will send to your application under test:
- // Set cookies
- $this->cookie('name', 'Uncle Bob');
- // Set session data
- $this->session(['Auth.User.id' => 1]);
- // Configure headers
- $this->configRequest([
- 'headers' => ['Accept' => 'application/json']
- ]);
The state set by these helper methods is reset in the tearDown()
method.
Testing Actions That Require Authentication
If you are using AuthComponent
you will need to stub out the session datathat AuthComponent uses to validate a user’s identity. You can use helpermethods in IntegrationTestTrait
to do this. Assuming you had anArticlesController
that contained an add method, and that add methodrequired authentication, you could write the following tests:
- public function testAddUnauthenticatedFails()
- {
- // No session data set.
- $this->get('/articles/add');
- $this->assertRedirect(['controller' => 'Users', 'action' => 'login']);
- }
- public function testAddAuthenticated()
- {
- // Set session data
- $this->session([
- 'Auth' => [
- 'User' => [
- 'id' => 1,
- 'username' => 'testing',
- // other keys.
- ]
- ]
- ]);
- $this->get('/articles/add');
- $this->assertResponseOk();
- // Other assertions.
- }
Testing Stateless Authentication and APIs
To test APIs that use stateless authentication, such as Basic authentication,you can configure the request to inject environment conditions or headers thatsimulate actual authentication request headers.
When testing Basic or Digest Authentication, you can add the environmentvariables that PHP createsautomatically. These environment variables used in the authentication adapteroutlined in Using Basic Authentication:
- public function testBasicAuthentication()
- {
- $this->configRequest([
- 'environment' => [
- 'PHP_AUTH_USER' => 'username',
- 'PHP_AUTH_PW' => 'password',
- ]
- ]);
- $this->get('/api/posts');
- $this->assertResponseOk();
- }
If you are testing other forms of authentication, such as OAuth2, you can setthe Authorization header directly:
- public function testOauthToken()
- {
- $this->configRequest([
- 'headers' => [
- 'authorization' => 'Bearer: oauth-token'
- ]
- ]);
- $this->get('/api/posts');
- $this->assertResponseOk();
- }
The headers key in configRequest()
can be used to configure any additionalHTTP headers needed for an action.
Testing Actions Protected by CsrfComponent or SecurityComponent
When testing actions protected by either SecurityComponent or CsrfComponent youcan enable automatic token generation to ensure your tests won’t fail due totoken mismatches:
- public function testAdd()
- {
- $this->enableCsrfToken();
- $this->enableSecurityToken();
- $this->post('/posts/add', ['title' => 'Exciting news!']);
- }
It is also important to enable debug in tests that use tokens to prevent theSecurityComponent from thinking the debug token is being used in a non-debugenvironment. When testing with other methods like requireSecure()
youcan use configRequest()
to set the correct environment variables:
- // Fake out SSL connections.
- $this->configRequest([
- 'environment' => ['HTTPS' => 'on']
- ]);
If your action requires unlocked fields you can declare them withsetUnlockedFields()
:
$this->setUnlockedFields(['dynamic_field']);
Integration Testing PSR-7 Middleware
Integration testing can also be used to test your entire PSR-7 application andMiddleware. By default IntegrationTestTrait
willauto-detect the presence of an App\Application
class and automaticallyenable integration testing of your Application. You can toggle this behaviorwith the useHttpServer()
method:
public function setUp() { // Enable PSR-7 integration testing. $this->useHttpServer(true); // Disable PSR-7 integration testing. $this->useHttpServer(false); }
You can customize the application class name used, and the constructorarguments, by using the configApplication()
method:
public function setUp() { $this->configApplication('App\App', [CONFIG]); }
After enabling the PSR-7 mode, and possibly configuring your application class,you can use the remaining IntegrationTestTrait
features as normal.
You should also take care to try and use Application::bootstrap() to loadany plugins containing events/routes. Doing so will ensure that yourevents/routes are connected for each test case. Alternatively if you wish toload plugins manually in a test you can use the loadPlugins()
method.
Testing with Encrypted Cookies
If you use the encrypted-cookie-middleware: in yourapplication, there are helper methods for setting encrypted cookies in yourtest cases:
// Set a cookie using AES and the default key. $this->cookieEncrypted('my_cookie', 'Some secret values'); // Assume this action modifies the cookie. $this->get('/bookmarks/index'); $this->assertCookieEncrypted('An updated value', 'my_cookie');
Testing Flash Messages
If you want to assert the presence of flash messages in the session and not therendered HTML, you can use enableRetainFlashMessages()
in your tests toretain flash messages in the session so you can write assertions:
// Enable retention of flash messages instead of consuming them. $this->enableRetainFlashMessages(); $this->get('/bookmarks/delete/9999'); $this->assertSession('That bookmark does not exist', 'Flash.flash.0.message'); // Assert a flash message in the 'flash' key. $this->assertFlashMessage('Bookmark deleted', 'flash'); // Assert the second flash message, also in the 'flash' key. $this->assertFlashMessageAt(1, 'Bookmark really deleted'); // Assert a flash message in the 'auth' key at the first position $this->assertFlashMessageAt(0, 'You are not allowed to enter this dungeon!', 'auth'); // Assert a flash messages uses the error element $this->assertFlashElement('Flash/error'); // Assert the second flash message element $this->assertFlashElementAt(1, 'Flash/error');
Testing a JSON Responding Controller
JSON is a friendly and common format to use when building a web service.Testing the endpoints of your web service is very simple with CakePHP. Let usbegin with a simple example controller that responds in JSON:
class MarkersController extends AppController { public function initialize(): void { parent::initialize(); $this->loadComponent('RequestHandler'); } public function view($id) { $marker = $this->Markers->get($id); $this->set('marker', $marker); $this->viewBuilder()->setOption('serialize', ['marker']); } }
Now we create the file tests/TestCase/Controller/MarkersControllerTest.phpand make sure our web service is returning the proper response:
class MarkersControllerTest extends IntegrationTestCase { public function testGet() { $this->configRequest([ 'headers' => ['Accept' => 'application/json'] ]); $result = $this->get('/markers/view/1.json'); // Check that the response was a 200 $this->assertResponseOk(); $expected = [ ['id' => 1, 'lng' => 66, 'lat' => 45], ]; $expected = json_encode($expected, JSON_PRETTY_PRINT); $this->assertEquals($expected, (string)$this->_response->getBody()); } }
We use the JSON_PRETTY_PRINT
option as CakePHP’s built in JsonView will usethat option when debug
is enabled.
Disabling Error Handling Middleware in Tests
When debugging tests that are failing because your application is encounteringerrors it can be helpful to temporarily disable the error handling middleware toallow the underlying error to bubble up. You can usedisableErrorHandlerMiddleware()
to do this:
public function testGetMissing() { $this->disableErrorHandlerMiddleware(); $this->get('/markers/not-there'); $this->assertResponseCode(404); }
In the above example, the test would fail and the underlying exception messageand stack trace would be displayed instead of the rendered error page beingchecked.
Assertion methods
The IntegrationTestTrait
trait provides a number of assertion methods thatmake testing responses much simpler. Some examples are:
// Check for a 2xx response code $this->assertResponseOk(); // Check for a 2xx/3xx response code $this->assertResponseSuccess(); // Check for a 4xx response code $this->assertResponseError(); // Check for a 5xx response code $this->assertResponseFailure(); // Check for a specific response code, e.g. 200 $this->assertResponseCode(200); // Check the Location header $this->assertRedirect(['controller' => 'Articles', 'action' => 'index']); // Check that no Location header has been set $this->assertNoRedirect(); // Check a part of the Location header $this->assertRedirectContains('/articles/edit/'); // Assert location header does not contain $this->assertRedirectNotContains('/articles/edit/'); // Assert not empty response content $this->assertResponseNotEmpty(); // Assert empty response content $this->assertResponseEmpty(); // Assert response content $this->assertResponseEquals('Yeah!'); // Assert response content doesn't equal $this->assertResponseNotEquals('No!'); // Assert partial response content $this->assertResponseContains('You won!'); $this->assertResponseNotContains('You lost!'); // Assert file sent back $this->assertFileResponse('/absolute/path/to/file.ext'); // Assert layout $this->assertLayout('default'); // Assert which template was rendered (if any) $this->assertTemplate('index'); // Assert data in the session $this->assertSession(1, 'Auth.User.id'); // Assert response header. $this->assertHeader('Content-Type', 'application/json'); $this->assertHeaderContains('Content-Type', 'html'); // Assert content-type header doesn't contain xml $this->assertHeaderNotContains('Content-Type', 'xml'); // Assert view variables $user = $this->viewVariable('user'); $this->assertEquals('jose', $user->username); // Assert cookies in the response $this->assertCookie('1', 'thingid'); // Check the content type $this->assertContentType('application/json');
In addition to the above assertion methods, you can also use all of theassertions in TestSuite and thosefound in PHPUnit.
Comparing test results to a file
For some types of test, it may be easier to compare the result of a test to thecontents of a file - for example, when testing the rendered output of a view.The StringCompareTrait
adds a simple assert method for this purpose.
Usage involves using the trait, setting the comparison base path and callingassertSameAsFile
:
use Cake\TestSuite\StringCompareTrait; use Cake\TestSuite\TestCase; class SomeTest extends TestCase { use StringCompareTrait; public function setUp() { $this->_compareBasePath = APP . 'tests' . DS . 'comparisons' . DS; parent::setUp(); } public function testExample() { $result = ...; $this->assertSameAsFile('example.php', $result); } }
The above example will compare $result
to the contents of the fileAPP/tests/comparisons/example.php
.
A mechanism is provided to write/update test files, by setting the environmentvariable UPDATE_TEST_COMPARISON_FILES
, which will create and/or update testcomparison files as they are referenced:
phpunit ... FAILURES! Tests: 6, Assertions: 7, Failures: 1 UPDATE_TEST_COMPARISON_FILES=1 phpunit ... OK (6 tests, 7 assertions) git status ... # Changes not staged for commit: # (use "git add <file>..." to update what will be committed) # (use "git checkout -- <file>..." to discard changes in working directory) # # modified: tests/comparisons/example.php
Console Integration Testing
See Testing Commands for information on testing shells andcommands.
Testing Views
Generally most applications will not directly test their HTML code. Doing so isoften results in fragile, difficult to maintain test suites that are prone tobreaking. When writing functional tests using IntegrationTestTrait
you can inspect the rendered view content by setting the return
option to‘view’. While it is possible to test view content using IntegrationTestTrait
,a more robust and maintainable integration/view testing can be accomplishedusing tools like Selenium webdriver.
Testing Components
Let’s pretend we have a component called PagematronComponent in our application.This component helps us set the pagination limit value across all thecontrollers that use it. Here is our example component located insrc/Controller/Component/PagematronComponent.php:
class PagematronComponent extends Component { public $controller = null; public function setController($controller) { $this->controller = $controller; // Make sure the controller is using pagination if (!isset($this->controller->paginate)) { $this->controller->paginate = []; } } public function startup(EventInterface $event) { $this->setController($event->getSubject()); } public function adjust($length = 'short') { switch ($length) { case 'long': $this->controller->paginate['limit'] = 100; break; case 'medium': $this->controller->paginate['limit'] = 50; break; default: $this->controller->paginate['limit'] = 20; break; } } }
Now we can write tests to ensure our paginate limit
parameter is being setcorrectly by the adjust()
method in our component. We create the filetests/TestCase/Controller/Component/PagematronComponentTest.php:
namespace App\Test\TestCase\Controller\Component; use App\Controller\Component\PagematronComponent; use Cake\Controller\Controller; use Cake\Controller\ComponentRegistry; use Cake\Event\Event; use Cake\Http\ServerRequest; use Cake\Http\Response; use Cake\TestSuite\TestCase; class PagematronComponentTest extends TestCase { protected $component; protected $controller; public function setUp() { parent::setUp(); // Setup our component and fake test controller $request = new ServerRequest(); $response = new Response(); $this->controller = $this->getMockBuilder('Cake\Controller\Controller') ->setConstructorArgs([$request, $response]) ->setMethods(null) ->getMock(); $registry = new ComponentRegistry($this->controller); $this->component = new PagematronComponent($registry); $event = new Event('Controller.startup', $this->controller); $this->component->startup($event); } public function testAdjust() { // Test our adjust method with different parameter settings $this->component->adjust(); $this->assertEquals(20, $this->controller->paginate['limit']); $this->component->adjust('medium'); $this->assertEquals(50, $this->controller->paginate['limit']); $this->component->adjust('long'); $this->assertEquals(100, $this->controller->paginate['limit']); } public function tearDown() { parent::tearDown(); // Clean up after we're done unset($this->component, $this->controller); } }
Testing Helpers
Since a decent amount of logic resides in Helper classes, it’simportant to make sure those classes are covered by test cases.
First we create an example helper to test. The CurrencyRendererHelper
willhelp us display currencies in our views and for simplicity only has one methodusd()
:
// src/View/Helper/CurrencyRendererHelper.php namespace App\View\Helper; use Cake\View\Helper; class CurrencyRendererHelper extends Helper { public function usd($amount) { return 'USD ' . number_format($amount, 2, '.', ','); } }
Here we set the decimal places to 2, decimal separator to dot, thousandsseparator to comma, and prefix the formatted number with ‘USD’ string.
Now we create our tests:
// tests/TestCase/View/Helper/CurrencyRendererHelperTest.php namespace App\Test\TestCase\View\Helper; use App\View\Helper\CurrencyRendererHelper; use Cake\TestSuite\TestCase; use Cake\View\View; class CurrencyRendererHelperTest extends TestCase { public $helper = null; // Here we instantiate our helper public function setUp() { parent::setUp(); $View = new View(); $this->helper = new CurrencyRendererHelper($View); } // Testing the usd() function public function testUsd() { $this->assertEquals('USD 5.30', $this->helper->usd(5.30)); // We should always have 2 decimal digits $this->assertEquals('USD 1.00', $this->helper->usd(1)); $this->assertEquals('USD 2.05', $this->helper->usd(2.05)); // Testing the thousands separator $this->assertEquals( 'USD 12,000.70', $this->helper->usd(12000.70) ); } }
Here, we call usd()
with different parameters and tell the test suite tocheck if the returned values are equal to what is expected.
Save this and execute the test. You should see a green bar and messagingindicating 1 pass and 4 assertions.
When you are testing a Helper which uses other helpers, be sure to mock theView clases loadHelpers
method.
Testing Events
The Events System is a great way to decouple your applicationcode, but sometimes when testing, you tend to test the results of events in thetest cases that execute those events. This is an additional form of couplingthat can be removed by using assertEventFired
and assertEventFiredWith
instead.
Expanding on the Orders example, say we have the following tables:
class OrdersTable extends Table { public function place($order) { if ($this->save($order)) { // moved cart removal to CartsTable $event = new Event('Model.Order.afterPlace', $this, [ 'order' => $order ]); $this->getEventManager()->dispatch($event); return true; } return false; } } class CartsTable extends Table { public function implementedEvents() { return [ 'Model.Order.afterPlace' => 'removeFromCart' ]; } public function removeFromCart(EventInterface $event) { $order = $event->getData('order'); $this->delete($order->cart_id); } }
Note
To assert that events are fired, you must first enableTracking Events on the event manager you wish to assert against.
To test the OrdersTable
above, we enable tracking in setUp()
then assertthat the event was fired, and assert that the $order
entity was passed inthe event data:
namespace App\Test\TestCase\Model\Table; use App\Model\Table\OrdersTable; use Cake\Event\EventList; use Cake\ORM\TableRegistry; use Cake\TestSuite\TestCase; class OrdersTableTest extends TestCase { public $fixtures = ['app.Orders']; public function setUp() { parent::setUp(); $this->Orders = TableRegistry::getTableLocator()->get('Orders'); // enable event tracking $this->Orders->getEventManager()->setEventList(new EventList()); } public function testPlace() { $order = new Order([ 'user_id' => 1, 'item' => 'Cake', 'quantity' => 42, ]); $this->assertTrue($this->Orders->place($order)); $this->assertEventFired('Model.Order.afterPlace', $this->Orders->getEventManager()); $this->assertEventFiredWith('Model.Order.afterPlace', 'order', $order, $this->Orders->getEventManager()); } }
By default, the global EventManager
is used for assertions, so testingglobal events does not require passing the event manager:
$this->assertEventFired('My.Global.Event'); $this->assertEventFiredWith('My.Global.Event', 'user', 1);
Testing Email
See Testing Mailer for information on testing email.
Creating Test Suites
If you want several of your tests to run at the same time, you can create a testsuite. A test suite is composed of several test cases. You can either createtest suites in your application’s phpunit.xml file. A simple examplewould be:
<testsuites> <testsuite name="Models"> <directory>src/Model</directory> <file>src/Service/UserServiceTest.php</file> <exclude>src/Model/Cloud/ImagesTest.php</exclude> </testsuite> </testsuites>
Creating Tests for Plugins
Tests for plugins are created in their own directory inside the pluginsfolder.
/src /plugins /Blog /tests /TestCase /Fixture
They work just like normal tests but you have to remember to use the namingconventions for plugins when importing classes. This is an example of a testcasefor the BlogPost
model from the plugins chapter of this manual. A differencefrom other tests is in the first line where ‘Blog.BlogPost’ is imported. Youalso need to prefix your plugin fixtures with plugin.Blog.BlogPosts
:
namespace Blog\Test\TestCase\Model\Table; use Blog\Model\Table\BlogPostsTable; use Cake\TestSuite\TestCase; class BlogPostsTableTest extends TestCase { // Plugin fixtures located in /plugins/Blog/tests/Fixture/ public $fixtures = ['plugin.Blog.BlogPosts']; public function testSomething() { // Test something. } }
If you want to use plugin fixtures in the app tests you canreference them using plugin.pluginName.fixtureName
syntax in the$fixtures
array. Additionally if you use vendor plugin name or fixturedirectories you can use the following: plugin.vendorName/pluginName.folderName/fixtureName
.
Before you can use fixtures you should ensure you have the fixturelistener configured in your phpunit.xml
file. You should also ensure that your fixtures are loadable. Ensure thefollowing is present in your composer.json file:
"autoload-dev": { "psr-4": { "MyPlugin\\Test\\": "plugins/MyPlugin/tests/" } }
Note
Remember to run composer.phar dumpautoload
when adding new autoloadmappings.
Generating Tests with Bake
If you use bake togenerate scaffolding, it will also generate test stubs. If you need tore-generate test case skeletons, or if you want to generate test skeletons forcode you wrote, you can use bake
:
bin/cake bake test <type> <name>
<type>
should be one of:
- Entity
- Table
- Controller
- Component
- Behavior
- Helper
- Shell
- Task
- ShellHelper
- Cell
- Form
- Mailer
- CommandWhile
<name>
should be the name of the object you want to bake a testskeleton for.
Integration with Jenkins
Jenkins is a continuous integration server, that canhelp you automate the running of your test cases. This helps ensure that allyour tests stay passing and your application is always ready.
Integrating a CakePHP application with Jenkins is fairly straightforward. Thefollowing assumes you’ve already installed Jenkins on *nix system, and are ableto administer it. You also know how to create jobs, and run builds. If you areunsure of any of these, refer to the Jenkins documentation .
Create a Job
Start off by creating a job for your application, and connect your repositoryso that jenkins can access your code.
Add Test Database Config
Using a separate database just for Jenkins is generally a good idea, as it stopsbleed through and avoids a number of basic problems. Once you’ve created a newdatabase in a database server that jenkins can access (usually localhost). Adda shell script step to the build that contains the following:
cat > config/app_local.php <<'CONFIG' <?php return [ 'Datasources' => [ 'test' => [ 'datasource' => 'Database/Mysql', 'host' => 'localhost', 'database' => 'jenkins_test', 'username' => 'jenkins', 'password' => 'cakephp_jenkins', 'encoding' => 'utf8' ] ] ]; CONFIG
Then uncomment the following line in your config/bootstrap.php file:
//Configure::load('app_local', 'default');
By creating an app_local.php file, you have an easy way to defineconfiguration specific to Jenkins. You can use this same configuration file tooverride any other configuration files you need on Jenkins.
It’s often a good idea to drop and re-create the database before each build aswell. This insulates you from chained failures, where one broken build causesothers to fail. Add another shell script step to the build that contains thefollowing:
mysql -u jenkins -pcakephp_jenkins -e 'DROP DATABASE IF EXISTS jenkins_test; CREATE DATABASE jenkins_test';
Add your Tests
Add another shell script step to your build. In this step install yourdependencies and run the tests for your application. Creating a junit log file,or clover coverage is often a nice bonus, as it gives you a nice graphical viewof your testing results:
# Download Composer if it is missing. test -f 'composer.phar' || curl -sS https://getcomposer.org/installer | php # Install dependencies php composer.phar install vendor/bin/phpunit --log-junit junit.xml --coverage-clover clover.xml
If you use clover coverage, or the junit results, make sure to configure thosein Jenkins as well. Failing to configure those steps will mean you won’t see theresults.
Run a Build
You should be able to run a build now. Check the console output and make anynecessary changes to get a passing build.