PHP Wiki - qa:runtests

configure

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/05/18 21:05		current
Line 7:		Line 7:
	./configure --prefix=/Users/g2/php/ --with-config-file-path=/Users/g2/php/php53/ --with-pear=/opt/local/ --with-iconv=/opt/local --with-bz2=/opt/local/ --with-zlib=/opt/local/ --with-libxml-dir=/opt/local --with-gettext=/opt/local --with-libexpat-dir=/opt/local --with-freetype-dir=/opt/local --with-openssl=/opt/local/ --with-t1lib=/opt/local/ --with-tidy=/opt/local --with-xsl=/opt/local --with-curl=/opt/local --with-pcre-regex=/opt/local --with-gd --with-jpeg-dir=/opt/local --with-png-dir=/opt/local --with-mhash=/opt/local --with-mcrypt=/opt/local --with-readline=/opt/local --enable-fastcgi --disable-short-tags --enable-pcntl --enable-soap --enable-exif --enable-sockets --enable-sysvsem --enable-sysvshm --with-xml --enable-sysvmsg --enable-calendar --enable-exif --with-xmlrpc --enable-ftp --enable-wdd --enable-soap --enable-bcmath --enable-mbstring --enable-dba --enable-zip --with-mime-magic --enable-gd-native-ttf --enable-xdebug		./configure --prefix=/Users/g2/php/ --with-config-file-path=/Users/g2/php/php53/ --with-pear=/opt/local/ --with-iconv=/opt/local --with-bz2=/opt/local/ --with-zlib=/opt/local/ --with-libxml-dir=/opt/local --with-gettext=/opt/local --with-libexpat-dir=/opt/local --with-freetype-dir=/opt/local --with-openssl=/opt/local/ --with-t1lib=/opt/local/ --with-tidy=/opt/local --with-xsl=/opt/local --with-curl=/opt/local --with-pcre-regex=/opt/local --with-gd --with-jpeg-dir=/opt/local --with-png-dir=/opt/local --with-mhash=/opt/local --with-mcrypt=/opt/local --with-readline=/opt/local --enable-fastcgi --disable-short-tags --enable-pcntl --enable-soap --enable-exif --enable-sockets --enable-sysvsem --enable-sysvshm --with-xml --enable-sysvmsg --enable-calendar --enable-exif --with-xmlrpc --enable-ftp --enable-wdd --enable-soap --enable-bcmath --enable-mbstring --enable-dba --enable-zip --with-mime-magic --enable-gd-native-ttf --enable-xdebug
	</html>		</html>
		+
		+	=====Further Information=====
		+
		+	[[http://www.php.net/manual/en/configure.php\|PHP Manual - configure options]]

decisions

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/07/25 11:02		current
Line 4:		Line 4:
	* [[http://wiki.php.net/qa/runtests/decisions/codingstandards\|Coding Standards]]		* [[http://wiki.php.net/qa/runtests/decisions/codingstandards\|Coding Standards]]
	* [[http://wiki.php.net/qa/runtests/decisions/notimplemented\|Decided not to re-implement]]		* [[http://wiki.php.net/qa/runtests/decisions/notimplemented\|Decided not to re-implement]]
		+	* [[http://wiki.php.net/qa/runtests/decisions/design\|Design decisions]]

development

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2012/05/22 08:06		current
Line 1:		Line 1:
	====== Setting up development environment ======		====== Setting up development environment ======
	run-tests.php is a PHP script so all you really need is a fairly standard development environment. This is a brief set of instructions.		run-tests.php is a PHP script so all you really need is a fairly standard development environment. This is a brief set of instructions.
-	If you just want to run the code this page is not for you - look [[http://wiki.php.net/qa/runtests/howtorun\|here]]	+	If you just want to run the code this page is not for you - look [[http://wiki.php.net/qa/runtests/howtorun\|here]]

	==== Installing PHP ====		==== Installing PHP ====

difference

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/07/19 16:08		current
Line 1:		Line 1:
-	^ Summary ^ Test name ^ Reason for difference ^	+	^ Summary ^ Test name ^Reason for difference ^
	\|1 tests fail in phpruntests and do not fail in run-tests \| \| \|		\|1 tests fail in phpruntests and do not fail in run-tests \| \| \|
-	\| \|ext/standard/tests/general_functions/phpinfo.phpt \| Occasional fail – can't explain \|	+	\| \|ext/standard/tests/general_functions/phpinfo.phpt \|Occasional fail – can't explain \|
	\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|		\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|
-	\| \|ext/phar/tests/zip/phar_stub.phpt \| Occasional fail - can't explain \|	+	\| \|ext/standard/tests/mail/mail_variation2.phpt \|Occasional fail - can't explain \|
-	\|39 tests bork in phpruntests and do not bork in run-tests \| \| \|	+	\|4 tests bork in phpruntests and do not bork in run-tests \| \| \|
-	\| \| Zend/tests/function_exists_error.phpt \| empty section \|	+	\| \|ext/pdo_sqlite/tests/common.phpt \|Requires REDIRECTTEST \|
-	\| \| ext/pcre/tests/preg_split_basic.phpt \| empty section \|	+	\| \|ext/sqlite/tests/pdo/common.phpt \|Requires REDIRECTTEST \|
-	\| \|ext/pdo_sqlite/tests/common.phpt \| REDIRECTTEST \|	+	\| \|tests/lang/bug35382.phpt \|Requires FILEEOF, will not be implemented\|
-	\| \|ext/posix/tests/posix_access.phpt \| DESCRIPTION \|	+	\| \|tests/lang/comments2.phpt\|Requires FILEEOF, will not be implemented\|
-	\| \|ext/posix/tests/posix_access_error_modes.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_access_error_wrongparams.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_ctermid.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getcwd.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getgrnam.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getpwnam.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getrlimit.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getsid.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getsid_error.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_initgroups.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_isatty.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_mkfifo_safemode.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_mknod.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_times.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_ttyname.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_ttyname_error_wrongparams.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_uname.phpt \| DESCRIPTION \|	+
-	\| \|ext/sqlite/tests/pdo/common.phpt \| REDIRECTTEST \|	+
-	\| \|ext/standard/tests/array/bug40709.phpt \| empty section \|	+
-	\| \|ext/standard/tests/file/mkdir_variation5-win32.phpt \| empty section \|	+
-	\| \|ext/standard/tests/file/touch_basic-win32.phpt \| empty section \|	+
-	\| \|ext/standard/tests/strings/addslashes_basic.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_error.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_variation1.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_variation2.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_variation3.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/join_variation6.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/stripcslashes_variation1.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/ucwords_basic.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/ucwords_error.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/wordwrap_variation3.phpt \| empty section\|	+
-	\| \| tests/classes/arrayobject_001.phpt \| empty section\|	+
-	\| \|tests/lang/bug35382.phpt \| FILEEOF\|	+
-	\| \|tests/lang/comments2.phpt\| FILEEOF\|	+
-	\| \|tests/run-test/test010.phpt \| STDIN \|	+
	\|0 tests bork in run-tests and do not bork in phpruntests \| \| \|		\|0 tests bork in run-tests and do not bork in phpruntests \| \| \|
	\|0 tests skip in phpruntests and do not skip in run-tests \| \| \|		\|0 tests skip in phpruntests and do not skip in run-tests \| \| \|
-	\| 3 tests skip in run-tests and do not skip in phpruntests \| \| \|	+	\|0 tests skip in run-tests and do not skip in phpruntests \| \| \|
-	\| \|ext/posix/tests/posix_ttyname_error_wrongparams.phpt \|BORKS instead, could fix by deleting empty sects \|	+
-	\| \|ext/standard/tests/file/mkdir_variation5-win32.phpt \|BORKS instead, could fix by deleting empty sects \|	+
-	\| \|ext/standard/tests/file/touch_basic-win32.phpt \| BORKS instead, could fix by deleting empty sects\|	+

differencemac

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/08/05 20:43		current
Line 2:		Line 2:
	\|4 tests fail in phpruntests and do not fail in run-tests \| \| \|		\|4 tests fail in phpruntests and do not fail in run-tests \| \| \|
	\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|		\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|
-	\| \| ext/standard/tests/strings/htmlentities02.phpt \| not sure, but to me it looks like an encoding-problem of the test-files (?) \|	+	\| \| ext/standard/tests/strings/htmlentities02.phpt \| This test fails when mbstring is configd. It fails on both new and old code, its just that the status is reported as WARN&FAIL on the old version. The new one does not support mixed status flags \|
	\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|
	\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|

differencemac4

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/08/05 20:44		current
Line 2:		Line 2:
	\|5 tests fail in phpruntests and do not fail in run-tests \| \| \|		\|5 tests fail in phpruntests and do not fail in run-tests \| \| \|
	\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|		\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|
-	\| \| ext/standard/tests/strings/htmlentities02.phpt \| not sure, but to me it looks like an encoding-problem of the test-files (?) \|	+	\| \| ext/standard/tests/strings/htmlentities02.phpt \| This test fails when mbstring is configd. It fails on both new and old code, its just that the status is reported as WARN&FAIL on the old version. The new one does not support mixed status flags \|
	\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|
	\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|

differencewindows

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/08/06 08:17		current
Line 1:		Line 1:
	^ Summary ^ Test name ^Reason for difference ^		^ Summary ^ Test name ^Reason for difference ^
-	\|3 tests fail in phpruntests and do not fail in run-tests \| \| \|	+	\|6 tests fail in phpruntests and do not fail in run-tests \| \| \|
	\| \| ext\standard\tests\general_functions\phpinfo.phpt\|Occasional fail – can't explain \|		\| \| ext\standard\tests\general_functions\phpinfo.phpt\|Occasional fail – can't explain \|
	\| \| tests\basic\bug20539.phpt \|This warns and skips in the old version, we are missing the warn and skip. Needs a fix? \|		\| \| tests\basic\bug20539.phpt \|This warns and skips in the old version, we are missing the warn and skip. Needs a fix? \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt1-win32.phpt \| -"- \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt2-win32.phpt \| -"- \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt3-win32.phpt \| -"- \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt4-win32.phpt \| -"- \|
	\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|		\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|
	\| \|ext\standard\tests\strings\bug37244.phpt \| \|		\| \|ext\standard\tests\strings\bug37244.phpt \| \|

documentation

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/09/01 20:04		current
Line 114:		Line 114:
	Parent class for classes that set run configuration settings. See 'setting' directory for sub-classes. Note that run settings can be derived from eith command line options or Environment variables, the functions of teh settings classes is mainly to determine which of these has been used and to set the run configuration accordingly.		Parent class for classes that set run configuration settings. See 'setting' directory for sub-classes. Note that run settings can be derived from eith command line options or Environment variables, the functions of teh settings classes is mainly to determine which of these has been used and to set the run configuration accordingly.

		+	===== Test case classes =====
		+	====rtPhpTestFile====
		+	Reads the contents of a test file, checks that it's a valid test (see precondtions) and removes windows-style line endings.
		+	rtPhpTest
		+	The main test case class. Takes the contents of the file read by rtPhpTestFile and creates section objects for each section (see Test Case Sections). The run() method runs any executable sections and then compares teh test out put with the expected output.
		+
		+	====rtTestPreCondtion====
		+	There are a number of preconditions that must be met before a test can be run. This is the parent class for preconditions. Preconditions are checked as the test file is read (see section on test precondtions)
		+	====rtTestConfiguration ====
		+	The run configuration can be modified by test case sections. The test configuration class implements the modifications and is used by rtFileSection when running the test.
		+	====rtPhpRunner ====
		+	As the name suggests, this runs PHP code. It's an almost exact copy of the original run-tests code (system_with_timeout()). No reason to change something that works fine as it is.
		+	==== rtPhpTestResults ====
		+	Collates the results of running (or attempting to run) a test. If the test has failed ensures that the difference between the expected and actual output is calculated and saved. Decides which files to keep and which to delete. Keeps a record of any saved files and of teh overall status (pass, fail, skip etc) of the test.
		+
		+	==== rtTestDifference ====
		+	Exact copy of the differencing code in the original run-tests. This code is complex, it might be possible to do better but for now it seems best not to try and modify it.
		+
		+	==== rtOutputWriter ====
		+	Takes the list of test results and writes in the desired format. Is a parent class for various different formats out output class. Currently only the 'list' format is implemented.
		+
		+
		+
		+	====Test Section Classes ====
		+
		+	Each test is made up from a number of sections, for example,
		+	--TEST--
		+	a title
		+	--FILE--
		+	<?php
		+	some php code
		+	?>
		+	--EXPECT--
		+	the expected result of running the PHP code.
		+
		+	All sections have a name and some contents. Sometimes the contents just have information - for example the test title, sometimes the contents are executable, or used to compare against the output.
		+
		+	The base class for all sections is rtSection. This class has a method which initialises the contents to an array of strings.
		+
		+	There are four subclasses which extend rtSection, these are rtInformationSection, rtExecutableSection, rtoutputSection and rtConfigurationSection. Each of these are extended again by classes which represent specific sections. The class hierarchy is shown in the attached ODP charts.
		+
		+	A brief description of the responsibilities of each class is given below.
		+
		+	====Information Sections====
		+	===rtTestSection ===
		+	This class just contains the test case title.
		+
		+	===rtCreditsSection ===
		+	This class contains information about who wrote the test
		+
		+	===rtXfailSection===
		+	The presence of this section in the test indicates that the test is expected to fail. The contents contain information about the reason for an expected failure.
		+
		+	====Executable Sections====
		+
		+	===rtFileSection===
		+	This is the most complex of the sections. The contents represent the PHP code that needs to be run. The section is responsible for assembling the command line that will run the code. The format of the command line is:
		+
		+	php_executable php_arguments test.php test_arguments
		+
		+	Note that both php_arguments aand test_arguments can be modified by other test sections and are therefore supplied from a TestConfiguration object and not from the RunConfiguration.
		+	The executable code is supplied in a file called test.php, where 'test' is the name of the testcase. The file is constructed fron teh test case contents and written by this section.
		+	===rtSkipIfSection===
		+	Executes code to determine if the test should be run or not. For example:
		+	<?php
		+	if( substr(PHP_OS, 0, 3) == 'WIN') {
		+	die('skip Not for Windows');
		+	Note that the first word in the comment is always 'skip' or 'warn'. For example in ext/standard/tests/time/001.phpt:
		+
		+	<?php
		+	if (!function_exists('microtime'))
		+	die('skip microtime() not available');
		+	die('warn system dependent');
		+	?>
		+	Note: the warning is a pretty strange thing to do as part of a section called SKIPIF. I've implemented it here for compatibility but it would be better to have a separate WARN section
		+
		+
		+
		+	===rtCleanSection===
		+	This section runs code that should clean up after a test. Many people forget that this is a separate piece of executable code - therefore you can't define $myFile in the body of the test and expect to be able to unling $myFile in the CLEAN section. There are currently 71 tests that need to be fixed because the CLEAN sections are a mess.
		+
		+	The old run-tests code just chucks away any results from running a CLAEN section. In this code if the results of running the clean section are not an empty string then the results are printed out with a WARN flag.
		+	====OutputSections====
		+	These sections deal with the expected output of the test and compare it with the actual output.
		+	rtExpectSection
		+
		+	rtExpectFSection
		+
		+	rtExectRegexSection
		+
		+	====Configuration sections====
		+	These sections have additional configuration information that changes the way that a single test is run
		+	===rtArgsSection===
		+	This section contains command line arguments for the test case. For an example of the usage see
		+	ext/standard/tests/general_functions/getopt.phpt
		+
		+	Test test_arguments are appended after the testcase as a string preceeded by '--'
		+
		+	php_executable php_arguments test.php test_arguments
		+	===rtEnvSection===
		+	This section adds any environmental variables that are required by a single testcase. For an example of usage see:
		+	ext/standard/tests/general_functions/parse_ini_basic.phpt
		+	The environmental variables specified in the test case are appended to the array of environment variables which is constructed in the run configuration and set in teh testsConfiguration
		+	===rtIniSection===
		+	This section adds additional commanline arguments to the PHP command line:
		+	php_executable php_arguments test.php test_arguments
		+
		+	These are added in the form of -d flags and are appended to those already set in the runConfiguration

	====== Parallel Execution ======		====== Parallel Execution ======

faq

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2026/04/18 19:40	current
Line 1:	Line 1:
	+	====== FAQ ======

howtorun

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2012/05/22 07:59		current
Line 26:		Line 26:

	===== Run the code =====		===== Run the code =====
-	At the moment the code will run a single test, eg:	+	Run a single test, eg:
	<code>		<code>
	runtests my_test.phpt		runtests my_test.phpt
	</code>		</code>

-	All the tests under a given directory, eg:	+	Run all the tests under a given directory, eg:
	<code>		<code>
	runtests ext/standard/tests/		runtests ext/standard/tests/
Line 37:		Line 37:

	The output format is different to run-tests.php. If a single test is run a short summary is printed to stdout. If one or more directories of tests are run the output is printed after each group (directory) of tests has been run. Again, a summary is printed to stdout but details are written to a file.		The output format is different to run-tests.php. If a single test is run a short summary is printed to stdout. If one or more directories of tests are run the output is printed after each group (directory) of tests has been run. Again, a summary is printed to stdout but details are written to a file.
		+
		+	Run all the tests under path_to_php/ext in parallel on 4 processors
		+
		+	<code>
		+	runtests path_to_php/ext -z 4
		+	</code>
		+
		+	Generate XML formatted output to a file:
		+
		+	<code>
		+	runtests -o xml -s /tmp/somefile path_to_php/tests
		+	</code>
		+
		+	Get more verbose results to the screen:
		+	<code>
		+	runtests -vvv path_to_php/tests
		+	</code>
		+
		+	Note: there are three levels of verbosity, -v, -vv and -vvv. But default all you will see is a '.' for each test.
		+

	<code>		<code>
Line 43:		Line 63:

	will give you all of the possible command line options.		will give you all of the possible command line options.
-

qa

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2012/05/22 08:03		current
Line 1:		Line 1:
	====== Test differences between the old and new versions of run-tests ======		====== Test differences between the old and new versions of run-tests ======

-	All differences are reported for the standard PHPT QA set - see [[http://wiki.php.net/qa/runtests/howtorun\|here]] for a description of the test set and instructions on how to run.	+	All differences are reported for the standard PHPT QA set - see [[http://wiki.php.net/qa/runtests/development\|here]] for a description of the test set and instructions on how to run.

	===== Linux sequential running =====		===== Linux sequential running =====

requirements

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2009/07/25 07:23		current
Line 31:		Line 31:
	* Provide the same functionality as REDEIRECTTEST, not necessarily using the current design		* Provide the same functionality as REDEIRECTTEST, not necessarily using the current design
	* Provide an API so thatthe code can be used by other applications (from Greg Beaver).		* Provide an API so thatthe code can be used by other applications (from Greg Beaver).
		+	* An option to specify arguments to valgrind

todos

Anonymous (anonymous@undisclosed.example.com) — 2025-04-03T13:08:43+00:00

2012/05/21 21:08		current
Line 15:		Line 15:
	* Package as a single file (like run-tests.php)		* Package as a single file (like run-tests.php)
	* Add a test using --disable-all and check that it runs (not parallel, which will always need pcntl()...DONE		* Add a test using --disable-all and check that it runs (not parallel, which will always need pcntl()...DONE
		+	* Code review
		+	* Should rtTestTaskGroup and rtPhpTestGroup be merged?
		+	* Check memory usage

2009/07/25 11:02		current
Line 4:		Line 4:
	* [[http://wiki.php.net/qa/runtests/decisions/codingstandards\|Coding Standards]]		* [[http://wiki.php.net/qa/runtests/decisions/codingstandards\|Coding Standards]]
	* [[http://wiki.php.net/qa/runtests/decisions/notimplemented\|Decided not to re-implement]]		* [[http://wiki.php.net/qa/runtests/decisions/notimplemented\|Decided not to re-implement]]
		+	* [[http://wiki.php.net/qa/runtests/decisions/design\|Design decisions]]

2009/07/19 16:08		current
Line 1:		Line 1:
-	^ Summary ^ Test name ^ Reason for difference ^	+	^ Summary ^ Test name ^Reason for difference ^
	\|1 tests fail in phpruntests and do not fail in run-tests \| \| \|		\|1 tests fail in phpruntests and do not fail in run-tests \| \| \|
-	\| \|ext/standard/tests/general_functions/phpinfo.phpt \| Occasional fail – can't explain \|	+	\| \|ext/standard/tests/general_functions/phpinfo.phpt \|Occasional fail – can't explain \|
	\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|		\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|
-	\| \|ext/phar/tests/zip/phar_stub.phpt \| Occasional fail - can't explain \|	+	\| \|ext/standard/tests/mail/mail_variation2.phpt \|Occasional fail - can't explain \|
-	\|39 tests bork in phpruntests and do not bork in run-tests \| \| \|	+	\|4 tests bork in phpruntests and do not bork in run-tests \| \| \|
-	\| \| Zend/tests/function_exists_error.phpt \| empty section \|	+	\| \|ext/pdo_sqlite/tests/common.phpt \|Requires REDIRECTTEST \|
-	\| \| ext/pcre/tests/preg_split_basic.phpt \| empty section \|	+	\| \|ext/sqlite/tests/pdo/common.phpt \|Requires REDIRECTTEST \|
-	\| \|ext/pdo_sqlite/tests/common.phpt \| REDIRECTTEST \|	+	\| \|tests/lang/bug35382.phpt \|Requires FILEEOF, will not be implemented\|
-	\| \|ext/posix/tests/posix_access.phpt \| DESCRIPTION \|	+	\| \|tests/lang/comments2.phpt\|Requires FILEEOF, will not be implemented\|
-	\| \|ext/posix/tests/posix_access_error_modes.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_access_error_wrongparams.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_ctermid.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getcwd.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getgrnam.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getpwnam.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getrlimit.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getsid.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_getsid_error.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_initgroups.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_isatty.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_mkfifo_safemode.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_mknod.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_times.phpt \| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_ttyname.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_ttyname_error_wrongparams.phpt\| DESCRIPTION \|	+
-	\| \|ext/posix/tests/posix_uname.phpt \| DESCRIPTION \|	+
-	\| \|ext/sqlite/tests/pdo/common.phpt \| REDIRECTTEST \|	+
-	\| \|ext/standard/tests/array/bug40709.phpt \| empty section \|	+
-	\| \|ext/standard/tests/file/mkdir_variation5-win32.phpt \| empty section \|	+
-	\| \|ext/standard/tests/file/touch_basic-win32.phpt \| empty section \|	+
-	\| \|ext/standard/tests/strings/addslashes_basic.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_error.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_variation1.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_variation2.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/addslashes_variation3.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/join_variation6.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/stripcslashes_variation1.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/ucwords_basic.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/ucwords_error.phpt \| empty section\|	+
-	\| \|ext/standard/tests/strings/wordwrap_variation3.phpt \| empty section\|	+
-	\| \| tests/classes/arrayobject_001.phpt \| empty section\|	+
-	\| \|tests/lang/bug35382.phpt \| FILEEOF\|	+
-	\| \|tests/lang/comments2.phpt\| FILEEOF\|	+
-	\| \|tests/run-test/test010.phpt \| STDIN \|	+
	\|0 tests bork in run-tests and do not bork in phpruntests \| \| \|		\|0 tests bork in run-tests and do not bork in phpruntests \| \| \|
	\|0 tests skip in phpruntests and do not skip in run-tests \| \| \|		\|0 tests skip in phpruntests and do not skip in run-tests \| \| \|
-	\| 3 tests skip in run-tests and do not skip in phpruntests \| \| \|	+	\|0 tests skip in run-tests and do not skip in phpruntests \| \| \|
-	\| \|ext/posix/tests/posix_ttyname_error_wrongparams.phpt \|BORKS instead, could fix by deleting empty sects \|	+
-	\| \|ext/standard/tests/file/mkdir_variation5-win32.phpt \|BORKS instead, could fix by deleting empty sects \|	+
-	\| \|ext/standard/tests/file/touch_basic-win32.phpt \| BORKS instead, could fix by deleting empty sects\|	+

2009/08/05 20:43		current
Line 2:		Line 2:
	\|4 tests fail in phpruntests and do not fail in run-tests \| \| \|		\|4 tests fail in phpruntests and do not fail in run-tests \| \| \|
	\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|		\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|
-	\| \| ext/standard/tests/strings/htmlentities02.phpt \| not sure, but to me it looks like an encoding-problem of the test-files (?) \|	+	\| \| ext/standard/tests/strings/htmlentities02.phpt \| This test fails when mbstring is configd. It fails on both new and old code, its just that the status is reported as WARN&FAIL on the old version. The new one does not support mixed status flags \|
	\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|
	\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|

2009/08/05 20:44		current
Line 2:		Line 2:
	\|5 tests fail in phpruntests and do not fail in run-tests \| \| \|		\|5 tests fail in phpruntests and do not fail in run-tests \| \| \|
	\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|		\| \| ext/standard/tests/general_functions/phpinfo.phpt \| ? \|
-	\| \| ext/standard/tests/strings/htmlentities02.phpt \| not sure, but to me it looks like an encoding-problem of the test-files (?) \|	+	\| \| ext/standard/tests/strings/htmlentities02.phpt \| This test fails when mbstring is configd. It fails on both new and old code, its just that the status is reported as WARN&FAIL on the old version. The new one does not support mixed status flags \|
	\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities04.phpt \| --"-- \|
	\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|		\| \| ext/standard/tests/strings/htmlentities15.phpt \| --"-- \|

2009/08/06 08:17		current
Line 1:		Line 1:
	^ Summary ^ Test name ^Reason for difference ^		^ Summary ^ Test name ^Reason for difference ^
-	\|3 tests fail in phpruntests and do not fail in run-tests \| \| \|	+	\|6 tests fail in phpruntests and do not fail in run-tests \| \| \|
	\| \| ext\standard\tests\general_functions\phpinfo.phpt\|Occasional fail – can't explain \|		\| \| ext\standard\tests\general_functions\phpinfo.phpt\|Occasional fail – can't explain \|
	\| \| tests\basic\bug20539.phpt \|This warns and skips in the old version, we are missing the warn and skip. Needs a fix? \|		\| \| tests\basic\bug20539.phpt \|This warns and skips in the old version, we are missing the warn and skip. Needs a fix? \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt1-win32.phpt \| -"- \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt2-win32.phpt \| -"- \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt3-win32.phpt \| -"- \|
		+	\| \| ext\standard\tests\mail\mail_basic_alt4-win32.phpt \| -"- \|
	\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|		\|1 tests fail in run-tests and do not fail in phpruntests \| \| \|
	\| \|ext\standard\tests\strings\bug37244.phpt \| \|		\| \|ext\standard\tests\strings\bug37244.phpt \| \|