Jan.dagefoerde: Suddenly (as of M2.9), a Moodle dependency seems to require the intl extension as well.

2015-05-06T12:41:18Z

Suddenly (as of M2.9), a Moodle dependency seems to require the intl extension as well.

← Older revision		Revision as of 12:41, 6 May 2015
Line 20:		Line 20:
	<div style='padding-left: 30pt'>		<div style='padding-left: 30pt'>
	<code>sudo apt-get install postgresql<br />		<code>sudo apt-get install postgresql<br />
	sudo apt-get install php5-cli php-pear php5-curl php5-pgsql php5-gd</code>		sudo apt-get install php5-cli php-pear php5-curl php5-pgsql php5-gd php5-intl</code>
	</div>		</div>

Jan.dagefoerde: Created page with "
This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Mood..."

2015-05-05T10:19:15Z

Created page with "<p> This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Mood..."

New page

<p>
This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Moodle's way of running PHPUnit and Behat tests using the command line.<br>
</p>

<p>
Integration scenario: We are developing a Moodle plugin. We want to run automated tests, ensuring that it runs correctly on multiple Moodle platform versions, e.g., Moodle 2.7 and Moodle 2.8. This is motivated by the fact that we announce compatibility with these versions in the Moodle plugin directory, and we want to - at least - know, when a plugin becomes incompatible with an older version or needs to be changed. Since we are only running one recent Moodle version for development, automated tests with other versions are useful for us.<br>
</p>

<p>
Prerequisites for this manual: Ubuntu-based integration server, headless (i.e. without a graphical environment), here: Ubuntu 14.04. <br>
</p>

== Installation of required software ==
<p>
<ul>
<li>Install Jenkins as a Ubuntu native package, as described on their website (instructions currently at http://pkg.jenkins-ci.org/debian/).</li>
<li>Install a Moodle runtime environment. A web server is not needed, since PHP 5's standalone server will be used. The following commands were used for our system:</li>
</ul>
</p>
<div style='padding-left: 30pt'>
<code>sudo apt-get install postgresql<br />
sudo apt-get install php5-cli php-pear php5-curl php5-pgsql php5-gd</code>
</div>

<p>
<ul>
<li>Install git, which will be used to obtain the sources of Moodle and of your plugin.</li>
</ul>
<div style='padding-left: 30pt'>
<code>sudo apt-get install git</code><br>
</div>
<ul>
<li>For acceptance tests, you need to use a browser. Therefore you need to be able to run graphical applications. On headless servers (i.e. those without a display), you can install Xvfb, emulating a display which will be used by your browser.</li>
</ul>
<div style='padding-left: 30pt'>
<code>sudo apt-get install xvfb firefox</code><br>
</div>
<ul>
<li>Furthermore, acceptance tests require the Selenium standalone server to be installed. Download from http://www.seleniumhq.org/download/ (here: Version 2.45.0) and unpack it at a jenkins-accessible location, e.g. $JENKINS_HOME/selenium (here: /var/lib/jenkins/selenium).</li>
</ul>
</p>

== Basic configuration of Jenkins using the shell ==
<p>
<ul>
<li>Configuration of the init script can be found at <code>/etc/default/jenkins</code>. It is not strictly necessary to change anything here, but we set <code>HTTP_PORT=-1</code> and added <code>HTTPS_PORT=8998</code> to make the server only via HTTPS. In that case, you also need to add <code>--httpsPort=$HTTPS_PORT</code> to the <code>JENKINS_ARGS</code> variable and restart Jenkins.</li>
<li>Furthermore, Moodle requires a <code>config.php</code> which is not contained in a repository. Therefore, configuration files need to be stored at a separate location, from where they can be pulled in. For our scenario, we stored the configuration file at <code>$JENKINS_HOME/moodle-config/config_$target.php</code>, where $target indicates a Moodle branch to build against (e.g., /var/lib/jenkins/moodle-config/config_MOODLE_28_STABLE.php).</li>
</ul>
</p>

== Jenkins server configuration ==
<p>
For all following steps you need to open Jenkins in your browser.<br>
</p>

<p>
Install or update the following plugins:<br>
<ul>
<li>Xvfb plugin</li>
<li>Multiple SCMs plugin</li>
<li>Matrix project plugin</li>
<li>JUnit plugin</li>
<li>GitHub plugin</li>
<li>Job Configuration History Plugin (optional, but very useful)</li>
</ul>
</p>

<p>
Configure Jenkins in the following way (Manage Jenkins → Configure System):<br>
<ul>
<li>Git</li>
<ul>
<li>Add a git installation. Choose an arbitrary name and set the path to <code>git</code> </li>
</ul>
<li>Git plugin</li>
<ul>
<li>Set the fields <code>Global Config user.name Value</code> and <code>Global Config user.email Value</code>. In our case, we set those values to account and e-mail of a technical GitHub account that is only used by the Jenkins server</li>
</ul>
</ul>
</p>

<p>
Create a job for your integration scenario:<br>
<ul>
<li>On the dashboard, select New Item. </li>
<li>Choose Multi-configuration project and define an Item name without any spaces.</li>
<li>On the next page, define the following settings (Change to your requirements. Remember our integration scenario described above!):</li>
<ul>
<li>GitHub project: URL to the web page of your repository</li>
<li>Source Code management:</li>
<ul>
<li>Choose <code>Multiple SCMs</code>.</li>
<li>Use <code>Add SCM</code> to add two git repositories.</li>
<li>For the first repository,</li>
<ul>
<li>set the URL to <code>git://git.moodle.org/moodle.git</code>.</li>
<li>Since this is a public repository, credentials are not required.</li>
<li>Under Additional Behaviours, add <code>Advanced clone behaviours</code> and check the option <code>Shallow clone</code>.</li>
</ul>
<li>For the second repository,</li>
<ul>
<li>set the URL to the URL of your git repository.</li>
<li>If this is a private repository, add credentials for accessing it (consider SSH authentication!)</li>
<li>Under Additional Behaviours, add <code>Check out to a sub-directory</code> and, for <code>Local subdirectory for repo</code>, enter the path where you would deploy your module in a usual Moodle installation (e.g., <code>mod/yourmodule</code>), without surrounding slashes.</li>
<li>Under Additional Behaviours, add <code>Advanced clone behaviours</code> and check the option <code>Shallow clone</code>.</li>
</ul>
</ul>
<li>Build Triggers:</li>
<ul>
<li>Check Build when a change is pushed to GitHub.</li>
<li>Check Poll SCM. As a schedule, define e.g. <code>H/5 * * * *</code> for polling every five minutes.</li>
</ul>
<li>Configuration Matrix:</li>
<ul>
<li>Add two user-defined axes.</li>
<ul>
<li>For the first axis, set name to <code>target</code> and values to <code>MOODLE_28_STABLE MOODLE_27_STABLE</code>. These values correspond to the branch names used in the Moodle repository.</li>
<li>For the second axis, set name to <code>testtype</code> and values to <code>UnitTest BehatTest</code>. These are used later on to perform different test types - be patient :).</li>
</ul>
<li>Check Run each configuration sequentially.</li>
</ul>
<li>Build Environment:</li>
<ul>
<li>Check Start Xvfb before the build, and shut it down after.</li>
</ul>
<li>Build:</li>
<ul>
<li>Add Execute shell</li>
<ul>
<li>Enter the following commands (Note that we use <code>$target</code> here, which always holds the current value of <code>target</code> in a particular configuration. Furthermore, this copies an appropriate config.php file into the current workspace):</li>
</ul>
</ul>
</ul>
</ul>
</p>
<div style='padding-left: 120pt'>
<code>git checkout $target;<br />
curl -s https://getcomposer.org/installer | php;<br />
php composer.phar install --prefer-source;<br />
cp $JENKINS_HOME/moodle-config/config_$target.php config.php;</code>
</div>

<p>
<ul style='padding-left: 60pt'>
<li>Add Conditional step (single)</li>
<ul>
<li>Run?: <code>Strings match</code>, String 1: <code>${testtype}</code>, String 2: <code>UnitTest</code> (the motivation is that this command is only run for unit tests. In contrast, the other step will be for behat acceptance tests).</li>
<li>Builder: <code>Execute shell</code></li>
<li>Enter the following commands:</li>
</ul>
</ul>
</p>
<div style='padding-left: 120pt'>
<code>mkdir -p ../moodledata/phpunit;<br />
php admin/tool/phpunit/cli/init.php;<br />
vendor/bin/phpunit --log-junit results/phpunit/phpunit.xml --group mod_ratingallocate || true;</code>
</div>

<p>
<ul style='padding-left: 60pt'>
<li>Add Conditional step (single)</li>
<ul>
<li>Run?: <code>Strings match</code>, String 1: <code>${testtype}</code>, String 2: <code>BehatTest</code>.</li>
<li>Builder: <code>Execute shell</code></li>
<li>Enter the following commands (replace <code>[SeleniumVersion]</code>, <code>[ModuleTag]</code>, and <code>[JobName]</code> accordingly):</li>
</ul>
</ul>
</p>
<div style='padding-left: 120pt'>
<code>mkdir -p ../moodledata/behat;<br />
php admin/tool/behat/cli/init.php;<br />
java -jar /var/lib/jenkins/selenium/selenium-server-standalone-[SeleniumVersion].jar > /dev/null 2>&1 &<br />
SELENIUM_PID=$!<br />
php -S localhost:8000 > /dev/null 2>&1 &<br />
PHP_PID=$!<br />
vendor/bin/behat --config /var/lib/jenkins/jobs/[JobName]/workspace/target/moodledata/behat/behat/behat.yml --tags '@[ModuleTag]' --format moodle_progress,junit --out ,behatlog || true;<br />
kill $SELENIUM_PID<br />
kill $PHP_PID</code>
</div>

<p>
<ul style='padding-left: 30pt'>
<li>Post-build Actions:</li>
<ul>
<li>Add Publish JUnit test result report</li>
<ul>
<li>Change the pattern for <code>Test report XMLs</code> to the value <code>**/phpunit/phpunit.xml,**/behatlog/*.xml</code></li>
</ul>
</ul>
<li>Save the configuration and start the first build to test it.</li>
</ul>
</p>

[[Category:Developer tools]]

Jenkins Integration Testing for Plugin Development - Revision history

Sarjona: This page will not be migrated to new devdocs

Mudrd8mz: Text replacement - "" to ""

Mudrd8mz: Text replacement - "`" to ""`

Jan.dagefoerde: Suddenly (as of M2.9), a Moodle dependency seems to require the intl extension as well.

Jan.dagefoerde: Created page with "
This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Mood..."

← Older revision		Revision as of 10:15, 27 January 2025
Line 1:		Line 1:
			{{Template:WillNotMigrate}}
	<p>		<p>
	This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Moodle's way of running PHPUnit and Behat tests using the command line.<br>		This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Moodle's way of running PHPUnit and Behat tests using the command line.<br>

Jenkins Integration Testing for Plugin Development - Revision history

Sarjona: This page will not be migrated to new devdocs

Mudrd8mz: Text replacement - "" to ""

Mudrd8mz: Text replacement - "" to ""

Jan.dagefoerde: Suddenly (as of M2.9), a Moodle dependency seems to require the intl extension as well.

Jan.dagefoerde: Created page with " This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Mood..."

Mudrd8mz: Text replacement - "`" to ""`

Jan.dagefoerde: Created page with "
This article describes how to use a Jenkins continuous integration server for automating PHPUnit and Behat tests for Moodle and Moodle plugins. The configuration uses Mood..."