See https://www.mediawiki.org/wiki/Requests_for_comment/HTML_templating_library#Performance
Apart from a checkout of this repository, you need nodejs, php5-cli and HHVM. After adding the appropriate HHVM nightly repo, this should get you these dependencies on Debian / Ubuntu:
apt-get install nodejs php5-cli hhvm-nightlyAfter this preparation, you should be able to run all benchmarks with:
./runall.shThis will produce output as in results.txt:
Set: Knockoff (node.js) (knockoff-node)
Test: test1 [050] Avg: 0.0815 Min: 0.0530 Max: 0.1050
Test: test1b [050] Avg: 0.1334 Min: 0.0760 Max: 0.1510
Test: test2 [050] Avg: 0.8882 Min: 0.6440 Max: 1.1260
Test: test2 lambda [050] Avg: 0.6492 Min: 0.4730 Max: 0.7880
Test: test3 [050] Avg: 0.3166 Min: 0.1960 Max: 0.5110
Set: Handlebars (node.js) (handlebars-node)
Test: test1 [050] Avg: 0.2093 Min: 0.1270 Max: 0.2750
Test: test1b [050] Avg: 0.2911 Min: 0.1660 Max: 0.3850
Test: test2 [050] Avg: 0.8271 Min: 0.6050 Max: 1.0400
Test: test2 lambda [050] Avg: 1.4567 Min: 1.1430 Max: 2.0150
Test: test3 [050] Avg: 0.2920 Min: 0.1870 Max: 0.3680
...
Each test is repeated 50 times for stable results, so this will take quite a while to finish for all libraries, runtimes & tests.
Also see the on-wiki version.
| Library / runtime | Test 1 (attr/text interpolation) | Test1b (same with random attr) | Test2 (iterate obj array) | Test2 (iterate obj array, lambda) | Test3 (iterate item array) |
|---|---|---|---|---|---|
| TAssembly (node.js) | 0.0420 | 0.0630 | 0.6190 | 0.5010 | 0.1860 |
| Knockoff (node.js) | 0.0530 | 0.0750 | 0.6370 | 0.4690 | 0.1970 |
| Handlebars (node.js) | 0.1300 | 0.1750 | 0.6060 | 1.1450 | 0.1870 |
| Hogan (node.js) | 0.1110 | 0.1370 | 0.6690 | 4.8780 | 0.6770 |
| Spacebars/TAssembly (node.js) | 0.0650 | n/a | 0.6430 | n/a | n/a |
| Mustache (node.js) | 0.3570 | 0.3900 | 2.5200 | 3.8260 | 0.8830 |
| TAssembly (PHP) | 1.7434 | 1.7654 | 18.6634 | 81.8341 | 12.3270 |
| TAssembly (HHVM) | 0.5199 | 0.5317 | 3.3146 | 16.7471 | 2.1257 |
| Handlebars lightncandy (PHP) | 0.5395 | 0.6025 | 7.0456 | 133.2025 | 3.9837 |
| Handlebars lightncandy (HHVM) | 0.1919 | 0.1991 | 0.8164 | 1.3319 | 0.5254 |
| Mustache (PHP) | 1.7991 | 1.8606 | 11.3725 | 24.0264 | 3.6850 |
| Mustache (HHVM) | 0.4783 | 0.5016 | 1.2869 | 3.9279 | 0.6229 |
| MediaWiki Templates (PHP) | 1.6926 | 1.7354 | 17.0633 | n/a | 7.4075 |
| MediaWiki Templates (HHVM) | 0.5305 | 0.5147 | 4.0606 | n/a | 1.9745 |
| Twig String (No Cache) (PHP) | 1.3954 | 1.4701 | 6.0498 | n/a | 3.6746 |
| Twig String (No Cache) (HHVM) | 0.5631 | 0.5137 | 0.9394 | n/a | 0.6560 |
| Twig File (No Cache) (PHP) | 1.7074 | 1.7649 | 6.0364 | n/a | 3.6477 |
| Twig File (No Cache) (HHVM) | 0.6085 | 0.6324 | 0.9831 | n/a | 0.8150 |
| Twig File (Cached) (PHP) | 1.7352 | 1.7783 | 6.0423 | n/a | 3.6068 |
| Twig File (Cached) (HHVM) | 0.4170 | 0.4460 | 0.7116 | n/a | 0.4475 |
| Handlebars HTMLJS (node.js) | 0.5610 | 0.6540 | 7.1110 | n/a | 2.9330 |
| Spacebars/HTMLJS (node.js) | 1.1450 | 1.3080 | 59.0910 | 143.3680 | 42.2020 |