rfc:better_benchmarks
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
rfc:better_benchmarks [2009/04/21 09:54] – Add 'features' section pbiggar | rfc:better_benchmarks [2017/09/22 13:28] (current) – external edit 127.0.0.1 | ||
---|---|---|---|
Line 92: | Line 92: | ||
* [[http:// | * [[http:// | ||
* Short, doesnt take command line parameters, is varied, but simple. | * Short, doesnt take command line parameters, is varied, but simple. | ||
- | * Many benchmarks are copied from the language shootout | + | * Many benchmarks are copied from the language shootout |
- | * This seems to be the only test with data that needs to be run-through. This makes it a somewhat better test than the others, it seems. | + | * Some tests come with input data |
==== Large benchmarks | ==== Large benchmarks | ||
Line 144: | Line 144: | ||
* Not very useful if it is IO bound | * Not very useful if it is IO bound | ||
* Lots of data sets: can use any PHP package | * Lots of data sets: can use any PHP package | ||
+ | * NOTE: Seems to require graphviz | ||
* [[http:// | * [[http:// | ||
Line 168: | Line 169: | ||
* [[http:// | * [[http:// | ||
* [[http:// | * [[http:// | ||
+ | |||
+ | ===== Benchmarking in other languages ===== | ||
+ | |||
+ | * Python: http:// | ||
+ | |||
+ | * Ruby: http:// | ||
===== Desired Benchmark Features ===== | ===== Desired Benchmark Features ===== | ||
Line 179: | Line 186: | ||
* Ability to compare all of these over two runs | * Ability to compare all of these over two runs | ||
* Support for other PHP implementations | * Support for other PHP implementations | ||
+ | * Benchmark characterisation: | ||
+ | * This is hard to do properly, so best to do it badly and give coarse grained information. | ||
*TODO* | *TODO* | ||
Line 189: | Line 198: | ||
* Total time for request | * Total time for request | ||
- | *TODO* | + | ====== Status ====== |
+ | ===== Completed Tests ===== | ||
- | ====== Status ====== | + | * raytracer (28.04.2009) |
+ | * deltablue (04.05.2009) | ||
+ | * crypto | ||
+ | * whirl & j4p5 | ||
+ | * crypto-md5 (29.06.2009) | ||
+ | * richards (29.06.2009) | ||
+ | * Crypto-AES | ||
+ | |||
+ | ===== Still unfinished | ||
- | * Richards test has been ported but has an error that is yet to be resolved - Ólafur W (07.04.2009) | ||
- | * Currently working on porting DeltaBlue - Ólafur W (07.04.2009) | ||
====== Collaboration ====== | ====== Collaboration ====== | ||
Line 223: | Line 239: | ||
* Ólafur Waage - olafurw [at] gmail.com | * Ólafur Waage - olafurw [at] gmail.com | ||
* Michiaki Tatsubori - mich [at] acm.org | * Michiaki Tatsubori - mich [at] acm.org | ||
+ | * Alexander Hjalmarsson - hjalle [at] sgh.se | ||
+ | * Davide Mendolia - idaf1er [at] gmail.com | ||
rfc/better_benchmarks.1240307699.txt.gz · Last modified: 2017/09/22 13:28 (external edit)