Functional Tests
Now that we've written some acceptance tests, functional tests are almost the same, with just one major difference: functional tests don't require a web server to run tests.
In simple terms we set $_REQUEST
, $_GET
and $_POST
variables and then we execute application from a test. This may be valuable as functional tests are faster and provide detailed stack traces on failures.
Codeception can connect to different web frameworks which support functional testing: Symfony2, Laravel5, Yii2, Zend Framework and others. You just need to enable desired module in your functional suite config to start.
Modules for all of these frameworks share the same interface, and thus your tests are not bound to any one of them. This is a sample functional test.
<?php
$I = new FunctionalTester($scenario);
$I->amOnPage('/');
$I->click('Login');
$I->fillField('Username', 'Miles');
$I->fillField('Password', 'Davis');
$I->click('Enter');
$I->see('Hello, Miles', 'h1');
// $I->seeEmailIsSent() - special for Symfony2
As you see you can use same tests for functional and acceptance testing.
Pitfalls
Acceptance tests are usually much slower than functional tests. But functional tests are less stable as they run Codeception and application in one environment. If your application was not designed to run in long living process, for instance you use exit
operator or global variables, probably functional tests are not for you.
Headers, Cookies, Sessions
One of the common issues with functional tests is usage of PHP functions that deal with headers
, sessions
, cookies
.
As you know, header
function triggers an error if it is executed more than once for the same header. In functional tests we run application multiple times, thus, we will get lots of trash errors in the result.
Shared Memory
In functional testing unlike the traditional way, PHP application does not stop after it finished processing a request. As all requests run in one memory container they are not isolated. So if you see that your tests are mysteriously failing when they shouldn't - try to execute a single test. This will check if tests were isolated during run. Because it's really easy to spoil environment as all tests are run in shared memory. Keep your memory clean, avoid memory leaks and clean global and static variables.
Enabling Framework Modules
You have a functional testing suite in tests/functional
dir.
To start you need to include one of the framework modules in suite config file: tests/functional.suite.yml
. Below we provide simplified instructions for setting up functional tests with the most popular PHP frameworks.
Symfony
To perform Symfony integrations you don't need to install any bundles or do any configuration changes.
You just need to include the Symfony
module into your test suite. If you also use Doctrine2, don't forget to include it too.
To make Doctrine2 module connect using doctrine
service from Symfony DIC you should specify Symfony module as a dependency for Doctrine2.
Example of functional.suite.yml
class_name: FunctionalTester
modules:
enabled:
- Symfony
- Doctrine2:
depends: Symfony # connect to Symfony
- \Helper\Functional
By default this module will search for App Kernel in the app
directory.
The module uses the Symfony Profiler to provide additional information and assertions.
Laravel5
Laravel5 module is included and requires no configuration.
class_name: FunctionalTester
modules:
enabled:
- Laravel5
- \Helper\Functional
Yii2
Yii2 tests are included in Basic and Advanced application templates. Follow Yii2 guides to start.
Yii
By itself Yii framework does not have an engine for functional testing.
So Codeception is the first and the only functional testing framework for Yii.
To use it with Yii include Yii1
module into config.
class_name: FunctionalTester
modules:
enabled:
- Yii1
- \Helper\Functional
To avoid common pitfalls we discussed earlier, Codeception provides basic hooks over Yii engine. Please set them up following the installation steps in module reference.
Zend Framework 2
Use ZF2 module to run functional tests inside Zend Framework 2.
class_name: FunctionalTester
modules:
enabled:
- ZF2
- \Helper\Functional
Zend Framework 1.x
The module for Zend Framework is highly inspired by ControllerTestCase class, used for functional testing with PHPUnit.
It follows similar approaches for bootstrapping and cleaning up. To start using Zend Framework in your functional tests, include the ZF1
module.
Example of functional.suite.yml
class_name: FunctionalTester
modules:
enabled:
- ZF1
- \Helper\Functional
Phalcon
Phalcon
module requires creating bootstrap file which returns instance of \Phalcon\Mvc\Application
. To start writing functional tests with Phalcon support you should enable Phalcon
module and provide path to this bootstrap file:
class_name: FunctionalTester
modules:
enabled:
- Phalcon:
bootstrap: 'app/config/bootstrap.php'
cleanup: true
savepoints: true
- \Helper\Functional
Writing Functional Tests
Functional tests are written in the same manner as Acceptance Tests with PhpBrowser
module enabled. All framework modules and PhpBrowser
module share the same methods and the same engine.
Therefore we can open a web page with amOnPage
command.
<?php
$I = new FunctionalTester($scenario);
$I->amOnPage('/login');
We can click links to open web pages of application.
<?php
$I->click('Logout');
// click link inside .nav element
$I->click('Logout', '.nav');
// click by CSS
$I->click('a.logout');
// click with strict locator
$I->click(['class' => 'logout']);
We can submit forms as well:
<?php
$I->submitForm('form#login', ['name' => 'john', 'password' => '123456']);
// alternatively
$I->fillField('#login input[name=name]', 'john');
$I->fillField('#login input[name=password]', '123456');
$I->click('Submit', '#login');
And do assertions:
<?php
$I->see('Welcome, john');
$I->see('Logged in successfully', '.notice');
$I->seeCurrentUrlEquals('/profile/john');
Framework modules also contain additional methods to access framework internals. For instance, Laravel5
, Phalcon
, and Yii2
modules have seeRecord
method which uses ActiveRecord layer to check that record exists in database.
Take a look at the complete reference for module you are using. Most of its methods are common for all modules but some of them are unique.
Also you can access framework globals inside a test or access Dependency Injection containers inside Helper\Functional
class.
<?php
namespace Helper;
class Functional extends \Codeception\Module
{
function doSomethingWithMyService()
{
$service = $this->getModule('Symfony')->grabServiceFromContainer('myservice');
$service->doSomething();
}
}
Check also all available Public Properties of used modules to get full access to its data.
Error Reporting
By default Codeception uses E_ALL & ~E_STRICT & ~E_DEPRECATED
error reporting level.
In functional tests you might want to change this level depending on framework's error policy.
The error reporting level can be set in the suite configuration file:
class_name: FunctionalTester
modules:
enabled:
- Yii1
- \Helper\Functional
error_level: "E_ALL & ~E_STRICT & ~E_DEPRECATED"
error_level
can be set globally in codeception.yml
file.
Conclusion
Functional tests are great if you are using powerful frameworks. By using functional tests you can access and manipulate their internal state. This makes your tests shorter and faster. In other cases, if you don't use frameworks there is no practical reason to write functional tests. If you are using a framework other than the ones listed here, create a module for it and share it with community.