Giter Club home page Giter Club logo

f3-factory / frameworkbenchmarks Goto Github PK

View Code? Open in Web Editor NEW

This project forked from techempower/frameworkbenchmarks

3.0 3.0 1.0 243.66 MB

Source code for the framework benchmarking project

Home Page: http://www.techempower.com/benchmarks/

License: BSD 3-Clause "New" or "Revised" License

Python 12.73% C 1.79% JavaScript 19.61% Shell 10.65% PowerShell 1.59% C# 5.94% ASP 0.04% CSS 8.97% C++ 1.94% Clojure 2.06% Dart 1.66% Elixir 0.55% Erlang 1.23% Go 3.14% Groovy 0.81% Java 21.01% Haskell 1.00% Scala 4.74% Lua 0.42% MoonScript 0.11%

frameworkbenchmarks's People

Contributors

aschneider-techempower avatar blee-techempower avatar ebramanti-techempower avatar fernandoacorreia avatar hamiltont avatar huntc avatar jyentechempower avatar knewmante avatar kppullin avatar ladymozzarella avatar lgratrix-techempower avatar lhotari avatar ludovic-gasc avatar malcolmevershed avatar marko-asplund avatar martin-g avatar mcocciate avatar methane avatar michaelhixson avatar msmith-techempower avatar natebrady23 avatar oberhamsi avatar pdonald avatar pfalls-techempower avatar pfalls1 avatar raphaelbauer avatar robfig avatar ssmith-techempower avatar valyala avatar zane-techempower avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Forkers

rayne

frameworkbenchmarks's Issues

Travis job error

Hi there,
there's a message on the FrameworkBenchmark Google Group saying that's the F3 travis job is failing.
I could fetch the job log although I didn't have time to look in details. Hope it helps:

================================================================================
  Running Tests...
================================================================================
--------------------------------------------------------------------------------
  Running Test: fat-free
--------------------------------------------------------------------------------
INFO:root:Running setup module start (cwd=/home/travis/build/TechEmpower/FrameworkBenchmarks/frameworks/PHP)
INFO:root:Start completed, running verify
INFO:root:Running setup module stop (cwd=/home/travis/build/TechEmpower/FrameworkBenchmarks/frameworks/PHP)
--------------------------------------------------------------------------------
  Running Test: fat-free-raw
--------------------------------------------------------------------------------
INFO:root:Running setup module start (cwd=/home/travis/build/TechEmpower/FrameworkBenchmarks/frameworks/PHP)
INFO:root:Start completed, running verify
INFO:root:Running setup module stop (cwd=/home/travis/build/TechEmpower/FrameworkBenchmarks/frameworks/PHP)
Failed verify!
Time to complete: 186 seconds
Results are saved in results/ec2/20140822185507
ERROR:run-ci:Running inside Travis-CI, so I will print err and out to console...
ERROR:run-ci:Test fat-free
ERROR:run-ci:Here is ERR:
INFO:run-ci:restart: Unknown job: mongodb
INFO:run-ci:stop: Unknown instance: 
ERROR:run-ci:Here is OUT:
INFO:run-ci:test.os.lower() = linux  test.database_os.lower() = linux
INFO:run-ci:self.results['frameworks'] != None: True
INFO:run-ci:test.name: fat-free
INFO:run-ci:self.results['completed']: {}
INFO:run-ci:================================================================================
INFO:run-ci:  Beginning fat-free
INFO:run-ci:----------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO:run-ci:  Starting fat-free
INFO:run-ci:--------------------------------------------------------------------------------mysql start/running, process 26231
INFO:run-ci:redis-server start/running, process 26293
INFO:run-ci: * Restarting PostgreSQL 9.3 database server
INFO:run-ci:   ...done.
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING JSON (/json)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:{"message":"Hello, World!"}
INFO:run-ci:
INFO:run-ci:VALIDATING JSON ... PASS
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING DB (/db-orm)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:{"id":3633,"randomNumber":9993}
INFO:run-ci:
INFO:run-ci:VALIDATING DB ... PASS
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING QUERY (/db-orm/)2
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"id":9075,"randomNumber":7770},{"id":4338,"randomNumber":425}]
INFO:run-ci:
INFO:run-ci:/db-orm/2 - PASS
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"id":5532,"randomNumber":2602}]
INFO:run-ci:
INFO:run-ci:/db-orm/0 - PASS
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"id":6521,"randomNumber":4498}]
INFO:run-ci:
INFO:run-ci:/db-orm/foo - PASS
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"id":9824,"randomNumber":9792},{"id":269,"randomNumber":3240},{"id":9482,"randomNumber":3163},{"id":8393,"randomNumber":8636},{"id":5037,"randomNumber":3880},{"id":2424,"randomNumber":7558},{"id":5167,"randomNumber":2813},{"id":5394,"randomNumber":3488},{"id":7331,"randomNumber":702},{"id":8132,"randomNumber":466},{"id":1309,"randomNumber":5709},{"id":548,"randomNumber":5533},{"id":5160,"randomNumber":9855},{"id":1714,"randomNumber":5132},{"id":8505,"randomNumber":2942},{"id":4967,"randomNumber":8137},{"id":6933,"randomNumber":297},{"id":6475,"randomNumber":5072},{"id":9509,"randomNumber":3472},{"id":3513,"randomNumber":7744},{"id":9828,"randomNumber":6858},{"id":5751,"randomNumber":1088},{"id":5984,"randomNumber":769},{"id":119,"randomNumber":5007},{"id":2121,"randomNumber":7657},{"id":1662,"randomNumber":533},{"id":7801,"randomNumber":5991},{"id":4035,"randomNumber":3081},{"id":1959,"randomNumber":7450},{"id":4970,"randomNumber":2520},{"id":1127,"randomNumber":774},{"id":4005,"randomNumber":9006},{"id":8793,"randomNumber":5147},{"id":6713,"randomNumber":4184},{"id":1096,"randomNumber":7233},{"id":8780,"randomNumber":7434},{"id":1876,"randomNumber":9809},{"id":7608,"randomNumber":5667},{"id":299,"randomNumber":4081},{"id":966,"randomNumber":1588},{"id":9351,"randomNumber":6515},{"id":6187,"randomNumber":67},{"id":3540,"randomNumber":4940},{"id":2194,"randomNumber":278},{"id":1600,"randomNumber":5926},{"id":6668,"randomNumber":9415},{"id":8600,"randomNumber":6336},{"id":5553,"randomNumber":8122},{"id":9455,"randomNumber":7345},{"id":517,"randomNumber":1012},{"id":5166,"randomNumber":2430},{"id":2606,"randomNumber":7886},{"id":9523,"randomNumber":5526},{"id":8868,"randomNumber":2840},{"id":4909,"randomNumber":3934},{"id":5024,"randomNumber":2149},{"id":7660,"randomNumber":6574},{"id":1950,"randomNumber":2799},{"id":8487,"randomNumber":1836},{"id":4046,"randomNumber":848},{"id":5281,"randomNumber":4106},{"id":1880,"randomNumber":3655},{"id":9495,"randomNumber":9968},{"id":7867,"randomNumber":2110},{"id":2259,"randomNumber":9215},{"id":2356,"randomNumber":2538},{"id":9892,"randomNumber":7095},{"id":6517,"randomNumber":7766},{"id":5253,"randomNumber":3457},{"id":1398,"randomNumber":8800},{"id":7768,"randomNumber":266},{"id":3356,"randomNumber":6614},{"id":6389,"randomNumber":8885},{"id":2549,"randomNumber":1862},{"id":1796,"randomNumber":8779},{"id":8291,"randomNumber":9305},{"id":8842,"randomNumber":681},{"id":2196,"randomNumber":2542},{"id":9193,"randomNumber":6241},{"id":5796,"randomNumber":5264},{"id":5466,"randomNumber":9542},{"id":283,"randomNumber":3603},{"id":6191,"randomNumber":5812},{"id":6239,"randomNumber":8109},{"id":4130,"randomNumber":5124},{"id":6562,"randomNumber":4108},{"id":362,"randomNumber":1107},{"id":7404,"randomNumber":317},{"id":5121,"randomNumber":7004},{"id":2833,"randomNumber":4549},{"id":5971,"randomNumber":8624},{"id":3111,"randomNumber":5680},{"id":931,"randomNumber":5573},{"id":9731,"randomNumber":6539},{"id":3134,"randomNumber":7503},{"id":8690,"randomNumber":1796},{"id":4366,"randomNumber":350},{"id":4476,"randomNumber":8383},{"id":5600,"randomNumber":7668},{"id":5611,"randomNumber":3764},{"id":1614,"randomNumber":3964},{"id":5652,"randomNumber":7687},{"id":4306,"randomNumber":8939},{"id":1772,"randomNumber":9005},{"id":6764,"randomNumber":1793},{"id":7506,"randomNumber":8769},{"id":6368,"randomNumber":5955},{"id":4997,"randomNumber":7327},{"id":6012,"randomNumber":7457},{"id":1497,"randomNumber":3835},{"id":5712,"randomNumber":4784},{"id":9233,"randomNumber":8260},{"id":4543,"randomNumber":4882},{"id":6677,"randomNumber":1111},{"id":1902,"randomNumber":8950},{"id":8454,"randomNumber":7745},{"id":9291,"randomNumber":8393},{"id":3863,"randomNumber":1630},{"id":2059,"randomNumber":6792},{"id":8752,"randomNumber":1082},{"id":3369,"randomNumber":6986},{"id":9530,"randomNumber":5335},{"id":5194,"randomNumber":6568},{"id":9777,"randomNumber":8052},{"id":5350,"randomNumber":8698},{"id":4125,"randomNumber":4513},{"id":4861,"randomNumber":8748},{"id":3107,"randomNumber":4154},{"id":4250,"randomNumber":8890},{"id":4450,"randomNumber":1641},{"id":515,"randomNumber":2032},{"id":1168,"randomNumber":4994},{"id":1422,"randomNumber":8739},{"id":4671,"randomNumber":1243},{"id":2449,"randomNumber":5306},{"id":5079,"randomNumber":8068},{"id":5881,"randomNumber":7735},{"id":3053,"randomNumber":6326},{"id":9023,"randomNumber":7284},{"id":5832,"randomNumber":6801},{"id":6594,"randomNumber":4337},{"id":5573,"randomNumber":6782},{"id":3149,"randomNumber":3511},{"id":2253,"randomNumber":1423},{"id":7367,"randomNumber":3949},{"id":7657,"randomNumber":6819},{"id":6238,"randomNumber":480},{"id":2911,"randomNumber":5586},{"id":936,"randomNumber":5187},{"id":7905,"randomNumber":8950},{"id":8981,"randomNumber":7894},{"id":7682,"randomNumber":4395},{"id":503,"randomNumber":6874},{"id":8310,"randomNumber":8942},{"id":3989,"randomNumber":9133},{"id":5010,"randomNumber":4294},{"id":6232,"randomNumber":8183},{"id":2229,"randomNumber":2846},{"id":59,"randomNumber":7107},{"id":944,"randomNumber":1809},{"id":7421,"randomNumber":357},{"id":4669,"randomNumber":8008},{"id":8739,"randomNumber":5288},{"id":258,"randomNumber":5796},{"id":7398,"randomNumber":1655},{"id":9780,"randomNumber":8531},{"id":7583,"randomNumber":5973},{"id":7461,"randomNumber":4122},{"id":6223,"randomNumber":5184},{"id":2272,"randomNumber":7970},{"id":405,"randomNumber":8785},{"id":8839,"randomNumber":249},{"id":7576,"randomNumber":1688},{"id":7379,"randomNumber":1145},{"id":5429,"randomNumber":4449},{"id":3635,"randomNumber":1722},{"id":3693,"randomNumber":2791},{"id":6597,"randomNumber":1126},{"id":4365,"randomNumber":460},{"id":4745,"randomNumber":2710},{"id":2629,"randomNumber":9159},{"id":8100,"randomNumber":330},{"id":8851,"randomNumber":1846},{"id":5471,"randomNumber":4347},{"id":2343,"randomNumber":5496},{"id":1403,"randomNumber":4358},{"id":9550,"randomNumber":6050},{"id":7228,"randomNumber":7293},{"id":1262,"randomNumber":3371},{"id":860,"randomNumber":7678},{"id":4553,"randomNumber":2137},{"id":9502,"randomNumber":5004},{"id":6162,"randomNumber":3384},{"id":9084,"randomNumber":5130},{"id":8089,"randomNumber":3762},{"id":520,"randomNumber":2303},{"id":4762,"randomNumber":4875},{"id":991,"randomNumber":3624},{"id":5187,"randomNumber":2981},{"id":1079,"randomNumber":4946},{"id":3732,"randomNumber":4144},{"id":9498,"randomNumber":4920},{"id":5562,"randomNumber":1684},{"id":7010,"randomNumber":3173},{"id":936,"randomNumber":5187},{"id":6620,"randomNumber":2215},{"id":9251,"randomNumber":5456},{"id":4863,"randomNumber":5673},{"id":8014,"randomNumber":8403},{"id":9061,"randomNumber":4682},{"id":7911,"randomNumber":3969},{"id":4457,"randomNumber":9688},{"id":1697,"randomNumber":5575},{"id":7990,"randomNumber":819},{"id":3624,"randomNumber":3540},{"id":4528,"randomNumber":7438},{"id":3662,"randomNumber":3217},{"id":2702,"randomNumber":8683},{"id":4137,"randomNumber":1571},{"id":5433,"randomNumber":8573},{"id":5495,"randomNumber":3056},{"id":2061,"randomNumber":2294},{"id":635,"randomNumber":5629},{"id":4513,"randomNumber":5684},{"id":6059,"randomNumber":8518},{"id":2191,"randomNumber":8872},{"id":2282,"randomNumber":1100},{"id":5455,"randomNumber":2054},{"id":4621,"randomNumber":819},{"id":4614,"randomNumber":2887},{"id":4963,"randomNumber":714},{"id":7056,"randomNumber":3011},{"id":113,"randomNumber":1699},{"id":6128,"randomNumber":9718},{"id":3088,"randomNumber":6822},{"id":5762,"randomNumber":3294},{"id":3231,"randomNumber":108},{"id":4308,"randomNumber":4196},{"id":455,"randomNumber":7120},{"id":752,"randomNumber":7810},{"id":1628,"randomNumber":6327},{"id":931,"randomNumber":5573},{"id":2663,"randomNumber":1928},{"id":4908,"randomNumber":8331},{"id":9460,"randomNumber":9533},{"id":3588,"randomNumber":5355},{"id":6009,"randomNumber":4769},{"id":8748,"randomNumber":1425},{"id":6343,"randomNumber":4309},{"id":2326,"randomNumber":5568},{"id":6897,"randomNumber":5401},{"id":9826,"randomNumber":4999},{"id":4549,"randomNumber":7334},{"id":7473,"randomNumber":8360},{"id":4691,"randomNumber":4351},{"id":5467,"randomNumber":2112},{"id":5811,"randomNumber":5875},{"id":2303,"randomNumber":7099},{"id":954,"randomNumber":4369},{"id":666,"randomNumber":6179},{"id":3995,"randomNumber":5364},{"id":4997,"randomNumber":7327},{"id":9100,"randomNumber":767},{"id":3630,"randomNumber":5107},{"id":3811,"randomNumber":1296},{"id":4093,"randomNumber":451},{"id":9349,"randomNumber":3073},{"id":1766,"randomNumber":5708},{"id":2837,"randomNumber":4848},{"id":6536,"randomNumber":9257},{"id":1910,"randomNumber":5612},{"id":5450,"randomNumber":8959},{"id":1161,"randomNumber":4260},{"id":8199,"randomNumber":1453},{"id":4538,"randomNumber":8926},{"id":7607,"randomNumber":5713},{"id":6567,"randomNumber":9559},{"id":2168,"randomNumber":6191},{"id":4483,"randomNumber":7397},{"id":5420,"randomNumber":503},{"id":5655,"randomNumber":7007},{"id":8744,"randomNumber":3552},{"id":2297,"randomNumber":8225},{"id":4970,"randomNumber":2520},{"id":2526,"randomNumber":7439},{"id":5632,"randomNumber":4696},{"id":6204,"randomNumber":4195},{"id":1988,"randomNumber":6715},{"id":5275,"randomNumber":6303},{"id":1187,"randomNumber":2283},{"id":3835,"randomNumber":3610},{"id":3825,"randomNumber":369},{"id":3477,"randomNumber":8024},{"id":770,"randomNumber":9228},{"id":5798,"randomNumber":5553},{"id":2077,"randomNumber":3459},{"id":8138,"randomNumber":869},{"id":7115,"randomNumber":4804},{"id":1487,"randomNumber":2879},{"id":2434,"randomNumber":9386},{"id":5537,"randomNumber":8223},{"id":3565,"randomNumber":6919},{"id":6237,"randomNumber":4764},{"id":1176,"randomNumber":4986},{"id":6099,"randomNumber":2258},{"id":1461,"randomNumber":8377},{"id":6996,"randomNumber":3021},{"id":6635,"randomNumber":1578},{"id":3689,"randomNumber":4347},{"id":9026,"randomNumber":8063},{"id":9444,"randomNumber":4222},{"id":1853,"randomNumber":1513},{"id":6635,"randomNumber":1578},{"id":431,"randomNumber":1270},{"id":5511,"randomNumber":1164},{"id":8124,"randomNumber":5925},{"id":1953,"randomNumber":4810},{"id":5829,"randomNumber":7367},{"id":3672,"randomNumber":912},{"id":1398,"randomNumber":8800},{"id":6841,"randomNumber":9423},{"id":4840,"randomNumber":7821},{"id":1860,"randomNumber":6546},{"id":7614,"randomNumber":7009},{"id":4390,"randomNumber":3406},{"id":9612,"randomNumber":2902},{"id":6339,"randomNumber":2615},{"id":2061,"randomNumber":2294},{"id":5529,"randomNumber":4695},{"id":520,"randomNumber":2303},{"id":4250,"randomNumber":8890},{"id":2862,"randomNumber":7923},{"id":7046,"randomNumber":1636},{"id":8595,"randomNumber":5301},{"id":7310,"randomNumber":7228},{"id":7418,"randomNumber":2702},{"id":4383,"randomNumber":5007},{"id":612,"randomNumber":2861},{"id":9815,"randomNumber":5685},{"id":4185,"randomNumber":5331},{"id":7948,"randomNumber":8922},{"id":5357,"randomNumber":8178},{"id":6319,"randomNumber":4676},{"id":5710,"randomNumber":5162},{"id":8955,"randomNumber":4873},{"id":8748,"randomNumber":1425},{"id":2191,"randomNumber":8872},{"id":689,"randomNumber":9548},{"id":8044,"randomNumber":6080},{"id":6563,"randomNumber":4866},{"id":7922,"randomNumber":425},{"id":751,"randomNumber":4276},{"id":4265,"randomNumber":6841},{"id":2849,"randomNumber":3405},{"id":7911,"randomNumber":3969},{"id":6451,"randomNumber":2489},{"id":9145,"randomNumber":8238},{"id":4011,"randomNumber":14},{"id":1328,"randomNumber":9406},{"id":7615,"randomNumber":6007},{"id":2704,"randomNumber":7310},{"id":2397,"randomNumber":5605},{"id":2908,"randomNumber":7590},{"id":2354,"randomNumber":2353},{"id":8892,"randomNumber":4249},{"id":3399,"randomNumber":200},{"id":6217,"randomNumber":9710},{"id":4058,"randomNumber":8647},{"id":397,"randomNumber":5172},{"id":4069,"randomNumber":7668},{"id":2473,"randomNumber":9511},{"id":2230,"randomNumber":449},{"id":9731,"randomNumber":6539},{"id":9908,"randomNumber":2113},{"id":3863,"randomNumber":1630},{"id":2547,"randomNumber":7436},{"id":7226,"randomNumber":9065},{"id":2538,"randomNumber":3792},{"id":5891,"randomNumber":7894},{"id":9193,"randomNumber":6241},{"id":2127,"randomNumber":9265},{"id":5252,"randomNumber":5209},{"id":9941,"randomNumber":6958},{"id":3204,"randomNumber":9487},{"id":6087,"randomNumber":2143},{"id":5720,"randomNumber":6859},{"id":4429,"randomNumber":2442},{"id":4931,"randomNumber":2373},{"id":6187,"randomNumber":67},{"id":5470,"randomNumber":870},{"id":3892,"randomNumber":7933},{"id":1977,"randomNumber":8208},{"id":3968,"randomNumber":1863},{"id":6766,"randomNumber":9907},{"id":826,"randomNumber":7472},{"id":8292,"randomNumber":89},{"id":8010,"randomNumber":3989},{"id":5579,"randomNumber":4626},{"id":7883,"randomNumber":2331},{"id":5687,"randomNumber":242},{"id":7740,"randomNumber":2380},{"id":8050,"randomNumber":2279},{"id":1864,"randomNumber":1196},{"id":3034,"randomNumber":6344},{"id":5438,"randomNumber":406},{"id":5380,"randomNumber":4037},{"id":8531,"randomNumber":9909},{"id":9328,"randomNumber":1296},{"id":4839,"randomNumber":3005},{"id":9120,"randomNumber":1131},{"id":469,"randomNumber":2452},{"id":452,"randomNumber":184},{"id":2909,"randomNumber":7701},{"id":6677,"randomNumber":1111},{"id":6997,"randomNumber":3186},{"id":5653,"randomNumber":3741},{"id":3331,"randomNumber":6810},{"id":8,"randomNumber":3386},{"id":2520,"randomNumber":8434},{"id":7670,"randomNumber":3051},{"id":2145,"randomNumber":8545},{"id":1193,"randomNumber":3341},{"id":6152,"randomNumber":5076},{"id":6294,"randomNumber":8009},{"id":8600,"randomNumber":6336},{"id":1228,"randomNumber":9706},{"id":3983,"randomNumber":9023},{"id":9246,"randomNumber":1010},{"id":584,"randomNumber":4477},{"id":8184,"randomNumber":4654},{"id":4081,"randomNumber":6120},{"id":5377,"randomNumber":9911},{"id":1872,"randomNumber":7543},{"id":6932,"randomNumber":3997},{"id":22,"randomNumber":5822},{"id":5107,"randomNumber":624},{"id":678,"randomNumber":7730},{"id":8196,"randomNumber":1997},{"id":9597,"randomNumber":3209},{"id":5128,"randomNumber":1130},{"id":4067,"randomNumber":6280},{"id":942,"randomNumber":2649},{"id":5776,"randomNumber":2764},{"id":82,"randomNumber":1528},{"id":7153,"randomNumber":8762},{"id":9998,"randomNumber":9737},{"id":9578,"randomNumber":7234},{"id":3247,"randomNumber":8943},{"id":5449,"randomNumber":4398},{"id":8072,"randomNumber":9361},{"id":891,"randomNumber":658},{"id":9456,"randomNumber":1058},{"id":2854,"randomNumber":9773},{"id":4554,"randomNumber":8109},{"id":3942,"randomNumber":2608},{"id":3665,"randomNumber":9932},{"id":5441,"randomNumber":1970},{"id":9708,"randomNumber":3306},{"id":3944,"randomNumber":8301},{"id":468,"randomNumber":9319},{"id":4068,"randomNumber":1302},{"id":1201,"randomNumber":8741},{"id":459,"randomNumber":7854},{"id":5647,"randomNumber":7362},{"id":8127,"randomNumber":6589},{"id":7441,"randomNumber":1951},{"id":5616,"randomNumber":6621},{"id":1003,"randomNumber":4851},{"id":6886,"randomNumber":5023},{"id":9969,"randomNumber":8085},{"id":2374,"randomNumber":8146},{"id":7340,"randomNumber":9977},{"id":7177,"randomNumber":1098},{"id":6656,"randomNumber":3784},{"id":2517,"randomNumber":9661},{"id":8563,"randomNumber":3164},{"id":4198,"randomNumber":2628},{"id":1907,"randomNumber":4759},{"id":2623,"randomNumber":9274},{"id":108,"randomNumber":1940},{"id":6187,"randomNumber":67},{"id":258,"randomNumber":5796},{"id":3060,"randomNumber":9246},{"id":8799,"randomNumber":1510},{"id":1084,"randomNumber":3973},{"id":8266,"randomNumber":3270},{"id":4993,"randomNumber":7868},{"id":578,"randomNumber":8276},{"id":7888,"randomNumber":3017},{"id":3988,"randomNumber":8249},{"id":1322,"randomNumber":9660},{"id":4560,"randomNumber":1216},{"id":2719,"randomNumber":4159},{"id":3789,"randomNumber":2679},{"id":7242,"randomNumber":2491},{"id":5435,"randomNumber":390},{"id":1932,"randomNumber":7835},{"id":6125,"randomNumber":3835},{"id":7481,"randomNumber":5089},{"id":3008,"randomNumber":7059}]
INFO:run-ci:
INFO:run-ci:/db-orm/501 - PASS
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:
INFO:run-ci:VALIDATING QUERY ... PASS
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING UPDATE (/update-orm/)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"id":3577,"randomNumber":89},{"id":6485,"randomNumber":490}]
INFO:run-ci:
INFO:run-ci:VALIDATING UPDATE ... PASS
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING PLAINTEXT (/plaintext)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:56:25 GMT
INFO:run-ci:Content-Type: text/html; charset=UTF-8
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:Hello, World!
INFO:run-ci:
INFO:run-ci:VALIDATING PLAINTEXT ... PASS
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  Stopping fat-free
INFO:run-ci:----------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO:run-ci:  Stopped fat-free
INFO:run-ci:----------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO:run-ci:  Saving results through fat-free
INFO:run-ci:--------------------------------------------------------------------------------
ERROR:run-ci:Test fat-free-raw
ERROR:run-ci:Here is ERR:
INFO:run-ci:restart: Unknown job: mongodb
ERROR:run-ci:Here is OUT:
INFO:run-ci:test.os.lower() = linux  test.database_os.lower() = linux
INFO:run-ci:self.results['frameworks'] != None: True
INFO:run-ci:test.name: fat-free-raw
INFO:run-ci:self.results['completed']: {u'fat-free': u'20140822185640'}
INFO:run-ci:================================================================================
INFO:run-ci:  Beginning fat-free-raw
INFO:run-ci:----------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO:run-ci:  Starting fat-free-raw
INFO:run-ci:--------------------------------------------------------------------------------mysql start/running, process 26854
INFO:run-ci:redis-server stop/waiting
INFO:run-ci:redis-server start/running, process 26921
INFO:run-ci: * Restarting PostgreSQL 9.3 database server
INFO:run-ci:   ...done.
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING DB (/db)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"randomNumber":"3750"}]
INFO:run-ci:
INFO:run-ci:VALIDATING DB ... 
INFO:run-ci:FAILGot exception when trying to validate the db test: Traceback (most recent call last):
INFO:run-ci:  File "/home/travis/build/TechEmpower/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 178, in validateDb
INFO:run-ci:    obj = {k.lower(): v for k,v in json.loads(jsonString).iteritems()}
INFO:run-ci:AttributeError: 'list' object has no attribute 'iteritems'
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING QUERY (/db/)2
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[[{"randomNumber":"2838"}],[{"randomNumber":"3057"}]]
INFO:run-ci:
INFO:run-ci:/db/2 - FAIL Got exception when trying to validate the query test: Traceback (most recent call last):
INFO:run-ci:  File "/home/travis/build/TechEmpower/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 257, in validateQuery
INFO:run-ci:    arr = [{k.lower(): v for k,v in d.iteritems()} for d in json.loads(jsonString)]
INFO:run-ci:AttributeError: 'list' object has no attribute 'iteritems'
INFO:run-ci:
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[[{"randomNumber":"6074"}]]
INFO:run-ci:
INFO:run-ci:/db/0 - WARNING Got exception when trying to validate the query test: Traceback (most recent call last):
INFO:run-ci:  File "/home/travis/build/TechEmpower/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 302, in validateQueryOneOrLess
INFO:run-ci:    obj = {k.lower(): v for k,v in json_load[0].iteritems()}
INFO:run-ci:AttributeError: 'list' object has no attribute 'iteritems'
INFO:run-ci: 
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[[{"randomNumber":"7709"}]]
INFO:run-ci:
INFO:run-ci:/db/foo - WARNING Got exception when trying to validate the query test: Traceback (most recent call last):
INFO:run-ci:  File "/home/travis/build/TechEmpower/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 302, in validateQueryOneOrLess
INFO:run-ci:    obj = {k.lower(): v for k,v in json_load[0].iteritems()}
INFO:run-ci:AttributeError: 'list' object has no attribute 'iteritems'
INFO:run-ci: 
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[[{"randomNumber":"308"}],[{"randomNumber":"122"}],[{"randomNumber":"8487"}],[{"randomNumber":"6647"}],[{"randomNumber":"6962"}],[{"randomNumber":"3554"}],[{"randomNumber":"3397"}],[{"randomNumber":"7262"}],[{"randomNumber":"6465"}],[{"randomNumber":"3220"}],[{"randomNumber":"7454"}],[{"randomNumber":"1794"}],[{"randomNumber":"7310"}],[{"randomNumber":"4403"}],[{"randomNumber":"5022"}],[{"randomNumber":"5948"}],[{"randomNumber":"6904"}],[{"randomNumber":"9518"}],[{"randomNumber":"6958"}],[{"randomNumber":"4793"}],[{"randomNumber":"9718"}],[{"randomNumber":"9761"}],[{"randomNumber":"652"}],[{"randomNumber":"4938"}],[{"randomNumber":"4067"}],[{"randomNumber":"3807"}],[{"randomNumber":"7613"}],[{"randomNumber":"4070"}],[{"randomNumber":"190"}],[{"randomNumber":"8977"}],[{"randomNumber":"108"}],[{"randomNumber":"3178"}],[{"randomNumber":"6161"}],[{"randomNumber":"4016"}],[{"randomNumber":"5944"}],[{"randomNumber":"4298"}],[{"randomNumber":"7650"}],[{"randomNumber":"713"}],[{"randomNumber":"4910"}],[{"randomNumber":"449"}],[{"randomNumber":"7538"}],[{"randomNumber":"7125"}],[{"randomNumber":"7370"}],[{"randomNumber":"5029"}],[{"randomNumber":"732"}],[{"randomNumber":"6248"}],[{"randomNumber":"2063"}],[{"randomNumber":"7676"}],[{"randomNumber":"5612"}],[{"randomNumber":"1358"}],[{"randomNumber":"2697"}],[{"randomNumber":"894"}],[{"randomNumber":"1704"}],[{"randomNumber":"5908"}],[{"randomNumber":"622"}],[{"randomNumber":"622"}],[{"randomNumber":"1665"}],[{"randomNumber":"8263"}],[{"randomNumber":"7740"}],[{"randomNumber":"7375"}],[{"randomNumber":"1964"}],[{"randomNumber":"7856"}],[{"randomNumber":"4696"}],[{"randomNumber":"3119"}],[{"randomNumber":"4406"}],[{"randomNumber":"9979"}],[{"randomNumber":"8664"}],[{"randomNumber":"8631"}],[{"randomNumber":"7242"}],[{"randomNumber":"9043"}],[{"randomNumber":"2853"}],[{"randomNumber":"7406"}],[{"randomNumber":"9991"}],[{"randomNumber":"86"}],[{"randomNumber":"9086"}],[{"randomNumber":"5950"}],[{"randomNumber":"1591"}],[{"randomNumber":"8832"}],[{"randomNumber":"7162"}],[{"randomNumber":"6087"}],[{"randomNumber":"2031"}],[{"randomNumber":"2143"}],[{"randomNumber":"7468"}],[{"randomNumber":"9493"}],[{"randomNumber":"4820"}],[{"randomNumber":"6588"}],[{"randomNumber":"3858"}],[{"randomNumber":"5869"}],[{"randomNumber":"2737"}],[{"randomNumber":"8402"}],[{"randomNumber":"7361"}],[{"randomNumber":"7537"}],[{"randomNumber":"7424"}],[{"randomNumber":"1542"}],[{"randomNumber":"2255"}],[{"randomNumber":"8540"}],[{"randomNumber":"3931"}],[{"randomNumber":"6867"}],[{"randomNumber":"1216"}],[{"randomNumber":"919"}],[{"randomNumber":"7153"}],[{"randomNumber":"4800"}],[{"randomNumber":"7948"}],[{"randomNumber":"2231"}],[{"randomNumber":"206"}],[{"randomNumber":"3010"}],[{"randomNumber":"7835"}],[{"randomNumber":"4840"}],[{"randomNumber":"9788"}],[{"randomNumber":"8008"}],[{"randomNumber":"3653"}],[{"randomNumber":"6562"}],[{"randomNumber":"4306"}],[{"randomNumber":"845"}],[{"randomNumber":"6616"}],[{"randomNumber":"6493"}],[{"randomNumber":"1909"}],[{"randomNumber":"6656"}],[{"randomNumber":"793"}],[{"randomNumber":"7317"}],[{"randomNumber":"6228"}],[{"randomNumber":"4359"}],[{"randomNumber":"4044"}],[{"randomNumber":"2030"}],[{"randomNumber":"7440"}],[{"randomNumber":"8169"}],[{"randomNumber":"5902"}],[{"randomNumber":"8189"}],[{"randomNumber":"5326"}],[{"randomNumber":"2923"}],[{"randomNumber":"6164"}],[{"randomNumber":"7666"}],[{"randomNumber":"7434"}],[{"randomNumber":"7907"}],[{"randomNumber":"3875"}],[{"randomNumber":"6574"}],[{"randomNumber":"9649"}],[{"randomNumber":"7275"}],[{"randomNumber":"6114"}],[{"randomNumber":"8597"}],[{"randomNumber":"4242"}],[{"randomNumber":"4134"}],[{"randomNumber":"4649"}],[{"randomNumber":"7776"}],[{"randomNumber":"5802"}],[{"randomNumber":"8596"}],[{"randomNumber":"2575"}],[{"randomNumber":"924"}],[{"randomNumber":"2398"}],[{"randomNumber":"7257"}],[{"randomNumber":"5877"}],[{"randomNumber":"3304"}],[{"randomNumber":"9543"}],[{"randomNumber":"1750"}],[{"randomNumber":"9393"}],[{"randomNumber":"9528"}],[{"randomNumber":"1283"}],[{"randomNumber":"2163"}],[{"randomNumber":"2516"}],[{"randomNumber":"6966"}],[{"randomNumber":"9986"}],[{"randomNumber":"2635"}],[{"randomNumber":"846"}],[{"randomNumber":"9422"}],[{"randomNumber":"6052"}],[{"randomNumber":"6760"}],[{"randomNumber":"4459"}],[{"randomNumber":"9378"}],[{"randomNumber":"7395"}],[{"randomNumber":"8364"}],[{"randomNumber":"946"}],[{"randomNumber":"6324"}],[{"randomNumber":"6129"}],[{"randomNumber":"6039"}],[{"randomNumber":"6096"}],[{"randomNumber":"8204"}],[{"randomNumber":"2137"}],[{"randomNumber":"1715"}],[{"randomNumber":"9191"}],[{"randomNumber":"6679"}],[{"randomNumber":"7446"}],[{"randomNumber":"1882"}],[{"randomNumber":"3437"}],[{"randomNumber":"5961"}],[{"randomNumber":"8165"}],[{"randomNumber":"7479"}],[{"randomNumber":"1184"}],[{"randomNumber":"5526"}],[{"randomNumber":"9725"}],[{"randomNumber":"1303"}],[{"randomNumber":"4535"}],[{"randomNumber":"6471"}],[{"randomNumber":"8272"}],[{"randomNumber":"3341"}],[{"randomNumber":"7801"}],[{"randomNumber":"4801"}],[{"randomNumber":"5796"}],[{"randomNumber":"175"}],[{"randomNumber":"4951"}],[{"randomNumber":"3445"}],[{"randomNumber":"8614"}],[{"randomNumber":"4856"}],[{"randomNumber":"4618"}],[{"randomNumber":"8315"}],[{"randomNumber":"995"}],[{"randomNumber":"6966"}],[{"randomNumber":"3547"}],[{"randomNumber":"8579"}],[{"randomNumber":"494"}],[{"randomNumber":"687"}],[{"randomNumber":"6292"}],[{"randomNumber":"4982"}],[{"randomNumber":"8775"}],[{"randomNumber":"9140"}],[{"randomNumber":"7262"}],[{"randomNumber":"5345"}],[{"randomNumber":"9070"}],[{"randomNumber":"5768"}],[{"randomNumber":"9267"}],[{"randomNumber":"3617"}],[{"randomNumber":"7594"}],[{"randomNumber":"7731"}],[{"randomNumber":"1113"}],[{"randomNumber":"356"}],[{"randomNumber":"4605"}],[{"randomNumber":"2812"}],[{"randomNumber":"8936"}],[{"randomNumber":"6791"}],[{"randomNumber":"3605"}],[{"randomNumber":"9863"}],[{"randomNumber":"1859"}],[{"randomNumber":"5807"}],[{"randomNumber":"5937"}],[{"randomNumber":"6881"}],[{"randomNumber":"4749"}],[{"randomNumber":"9776"}],[{"randomNumber":"8145"}],[{"randomNumber":"2993"}],[{"randomNumber":"4314"}],[{"randomNumber":"9692"}],[{"randomNumber":"1034"}],[{"randomNumber":"6966"}],[{"randomNumber":"4454"}],[{"randomNumber":"1349"}],[{"randomNumber":"8322"}],[{"randomNumber":"7542"}],[{"randomNumber":"5839"}],[{"randomNumber":"5342"}],[{"randomNumber":"3527"}],[{"randomNumber":"8129"}],[{"randomNumber":"652"}],[{"randomNumber":"8941"}],[{"randomNumber":"617"}],[{"randomNumber":"9722"}],[{"randomNumber":"5295"}],[{"randomNumber":"1491"}],[{"randomNumber":"5573"}],[{"randomNumber":"2490"}],[{"randomNumber":"8790"}],[{"randomNumber":"7291"}],[{"randomNumber":"7114"}],[{"randomNumber":"3798"}],[{"randomNumber":"9681"}],[{"randomNumber":"2347"}],[{"randomNumber":"6381"}],[{"randomNumber":"1067"}],[{"randomNumber":"3090"}],[{"randomNumber":"6100"}],[{"randomNumber":"1757"}],[{"randomNumber":"2058"}],[{"randomNumber":"1083"}],[{"randomNumber":"4517"}],[{"randomNumber":"2619"}],[{"randomNumber":"8940"}],[{"randomNumber":"2959"}],[{"randomNumber":"9665"}],[{"randomNumber":"3274"}],[{"randomNumber":"9415"}],[{"randomNumber":"3790"}],[{"randomNumber":"2761"}],[{"randomNumber":"6945"}],[{"randomNumber":"818"}],[{"randomNumber":"8926"}],[{"randomNumber":"4013"}],[{"randomNumber":"1240"}],[{"randomNumber":"574"}],[{"randomNumber":"7769"}],[{"randomNumber":"9826"}],[{"randomNumber":"9484"}],[{"randomNumber":"1065"}],[{"randomNumber":"1491"}],[{"randomNumber":"1570"}],[{"randomNumber":"2474"}],[{"randomNumber":"757"}],[{"randomNumber":"4612"}],[{"randomNumber":"9052"}],[{"randomNumber":"2505"}],[{"randomNumber":"9723"}],[{"randomNumber":"933"}],[{"randomNumber":"5361"}],[{"randomNumber":"9088"}],[{"randomNumber":"4699"}],[{"randomNumber":"8381"}],[{"randomNumber":"6212"}],[{"randomNumber":"72"}],[{"randomNumber":"2122"}],[{"randomNumber":"9"}],[{"randomNumber":"5130"}],[{"randomNumber":"759"}],[{"randomNumber":"4613"}],[{"randomNumber":"1324"}],[{"randomNumber":"7386"}],[{"randomNumber":"8812"}],[{"randomNumber":"9192"}],[{"randomNumber":"6172"}],[{"randomNumber":"8543"}],[{"randomNumber":"6753"}],[{"randomNumber":"2727"}],[{"randomNumber":"1590"}],[{"randomNumber":"7196"}],[{"randomNumber":"7395"}],[{"randomNumber":"6406"}],[{"randomNumber":"5723"}],[{"randomNumber":"6954"}],[{"randomNumber":"7981"}],[{"randomNumber":"6088"}],[{"randomNumber":"7241"}],[{"randomNumber":"1746"}],[{"randomNumber":"573"}],[{"randomNumber":"3446"}],[{"randomNumber":"5491"}],[{"randomNumber":"4862"}],[{"randomNumber":"2571"}],[{"randomNumber":"3090"}],[{"randomNumber":"9989"}],[{"randomNumber":"6880"}],[{"randomNumber":"1797"}],[{"randomNumber":"5509"}],[{"randomNumber":"8522"}],[{"randomNumber":"6706"}],[{"randomNumber":"5944"}],[{"randomNumber":"9983"}],[{"randomNumber":"9446"}],[{"randomNumber":"2294"}],[{"randomNumber":"446"}],[{"randomNumber":"92"}],[{"randomNumber":"4389"}],[{"randomNumber":"2065"}],[{"randomNumber":"8402"}],[{"randomNumber":"266"}],[{"randomNumber":"6151"}],[{"randomNumber":"3795"}],[{"randomNumber":"4582"}],[{"randomNumber":"1193"}],[{"randomNumber":"246"}],[{"randomNumber":"7486"}],[{"randomNumber":"4382"}],[{"randomNumber":"6975"}],[{"randomNumber":"2926"}],[{"randomNumber":"6853"}],[{"randomNumber":"1606"}],[{"randomNumber":"388"}],[{"randomNumber":"2054"}],[{"randomNumber":"7247"}],[{"randomNumber":"8470"}],[{"randomNumber":"480"}],[{"randomNumber":"5710"}],[{"randomNumber":"4858"}],[{"randomNumber":"699"}],[{"randomNumber":"5174"}],[{"randomNumber":"1680"}],[{"randomNumber":"4776"}],[{"randomNumber":"5072"}],[{"randomNumber":"8238"}],[{"randomNumber":"2708"}],[{"randomNumber":"4765"}],[{"randomNumber":"7747"}],[{"randomNumber":"6839"}],[{"randomNumber":"3161"}],[{"randomNumber":"6962"}],[{"randomNumber":"1454"}],[{"randomNumber":"6720"}],[{"randomNumber":"2080"}],[{"randomNumber":"6770"}],[{"randomNumber":"3683"}],[{"randomNumber":"6446"}],[{"randomNumber":"5216"}],[{"randomNumber":"8361"}],[{"randomNumber":"7234"}],[{"randomNumber":"2914"}],[{"randomNumber":"8786"}],[{"randomNumber":"4898"}],[{"randomNumber":"9756"}],[{"randomNumber":"9877"}],[{"randomNumber":"8484"}],[{"randomNumber":"655"}],[{"randomNumber":"1313"}],[{"randomNumber":"6809"}],[{"randomNumber":"2853"}],[{"randomNumber":"7464"}],[{"randomNumber":"2776"}],[{"randomNumber":"6333"}],[{"randomNumber":"4793"}],[{"randomNumber":"2795"}],[{"randomNumber":"5591"}],[{"randomNumber":"3728"}],[{"randomNumber":"8744"}],[{"randomNumber":"4778"}],[{"randomNumber":"255"}],[{"randomNumber":"8911"}],[{"randomNumber":"4693"}],[{"randomNumber":"9463"}],[{"randomNumber":"5556"}],[{"randomNumber":"1940"}],[{"randomNumber":"8673"}],[{"randomNumber":"2671"}],[{"randomNumber":"8713"}],[{"randomNumber":"4527"}],[{"randomNumber":"8024"}],[{"randomNumber":"3663"}],[{"randomNumber":"3429"}],[{"randomNumber":"4088"}],[{"randomNumber":"7573"}],[{"randomNumber":"7888"}],[{"randomNumber":"3786"}],[{"randomNumber":"1193"}],[{"randomNumber":"3646"}],[{"randomNumber":"9514"}],[{"randomNumber":"8505"}],[{"randomNumber":"1578"}],[{"randomNumber":"5585"}],[{"randomNumber":"1088"}],[{"randomNumber":"6709"}],[{"randomNumber":"6329"}],[{"randomNumber":"3094"}],[{"randomNumber":"3215"}],[{"randomNumber":"1404"}],[{"randomNumber":"617"}],[{"randomNumber":"6303"}],[{"randomNumber":"3857"}],[{"randomNumber":"3123"}],[{"randomNumber":"2532"}],[{"randomNumber":"6361"}],[{"randomNumber":"7274"}],[{"randomNumber":"8175"}],[{"randomNumber":"4890"}],[{"randomNumber":"241"}],[{"randomNumber":"8744"}],[{"randomNumber":"514"}],[{"randomNumber":"9920"}],[{"randomNumber":"8236"}],[{"randomNumber":"2113"}],[{"randomNumber":"5986"}],[{"randomNumber":"5398"}],[{"randomNumber":"2695"}],[{"randomNumber":"3656"}],[{"randomNumber":"3688"}],[{"randomNumber":"1157"}],[{"randomNumber":"1636"}],[{"randomNumber":"7187"}],[{"randomNumber":"6471"}],[{"randomNumber":"3666"}],[{"randomNumber":"5919"}],[{"randomNumber":"8959"}],[{"randomNumber":"1414"}],[{"randomNumber":"1470"}],[{"randomNumber":"8278"}],[{"randomNumber":"8259"}],[{"randomNumber":"72"}],[{"randomNumber":"9999"}],[{"randomNumber":"4116"}],[{"randomNumber":"9330"}],[{"randomNumber":"1358"}],[{"randomNumber":"1905"}],[{"randomNumber":"6404"}],[{"randomNumber":"3159"}],[{"randomNumber":"5903"}],[{"randomNumber":"574"}],[{"randomNumber":"9675"}],[{"randomNumber":"2797"}],[{"randomNumber":"1828"}],[{"randomNumber":"6213"}],[{"randomNumber":"3583"}],[{"randomNumber":"1486"}],[{"randomNumber":"225"}],[{"randomNumber":"838"}],[{"randomNumber":"6855"}],[{"randomNumber":"3730"}],[{"randomNumber":"5118"}],[{"randomNumber":"2036"}],[{"randomNumber":"4303"}],[{"randomNumber":"5375"}],[{"randomNumber":"4312"}],[{"randomNumber":"1444"}],[{"randomNumber":"1027"}],[{"randomNumber":"4448"}],[{"randomNumber":"2033"}],[{"randomNumber":"5696"}],[{"randomNumber":"2430"}],[{"randomNumber":"4024"}]]
INFO:run-ci:
INFO:run-ci:/db/501 - WARNING Got exception when trying to validate the query test: Traceback (most recent call last):
INFO:run-ci:  File "/home/travis/build/TechEmpower/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 338, in validateQueryFiveHundredOrMore
INFO:run-ci:    arr = [{k.lower(): v for k,v in d.iteritems()} for d in json.loads(jsonString)]
INFO:run-ci:AttributeError: 'list' object has no attribute 'iteritems'
INFO:run-ci: 
INFO:run-ci:
INFO:run-ci:-----------------------------------------------------
INFO:run-ci:
INFO:run-ci:
INFO:run-ci:VALIDATING QUERY ... 
INFO:run-ci:FAIL Got exception when trying to validate the query test: Traceback (most recent call last):
INFO:run-ci:  File "/home/travis/build/TechEmpower/FrameworkBenchmarks/toolset/benchmark/framework_test.py", line 338, in validateQueryFiveHundredOrMore
INFO:run-ci:    arr = [{k.lower(): v for k,v in d.iteritems()} for d in json.loads(jsonString)]
INFO:run-ci:AttributeError: 'list' object has no attribute 'iteritems'
INFO:run-ci: 
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING FORTUNE (/fortune)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 500 Internal Server Error
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: text/html; charset=UTF-8
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:<!DOCTYPE html>
INFO:run-ci:<html>
INFO:run-ci:<head>
INFO:run-ci:    <title>Fortunes</title>
INFO:run-ci:</head>
INFO:run-ci:<body>
INFO:run-ci:    <table>
INFO:run-ci:        <tr>
INFO:run-ci:            <th>id</th>
INFO:run-ci:            <th>message</th>
INFO:run-ci:        </tr>
INFO:run-ci:                    <tr>
INFO:run-ci:                <td>12</td>
INFO:run-ci:                <td>Additional fortune added at request time.</td>
INFO:run-ci:            </tr>
INFO:run-ci:                    <tr>
INFO:run-ci:                <td>0</td>
INFO:run-ci:                <td><!DOCTYPE html>
INFO:run-ci:<html>
INFO:run-ci:<head><title>500 Internal Server Error</title><style>code{word-wrap:break-word;color:black}.comment,.doc_comment,.ml_comment{color:dimgray;font-style:italic}.variable{color:blueviolet}.const,.constant_encapsed_string,.class_c,.dir,.file,.func_c,.halt_compiler,.line,.method_c,.lnumber,.dnumber{color:crimson}.string,.and_equal,.boolean_and,.boolean_or,.concat_equal,.dec,.div_equal,.inc,.is_equal,.is_greater_or_equal,.is_identical,.is_not_equal,.is_not_identical,.is_smaller_or_equal,.logical_and,.logical_or,.logical_xor,.minus_equal,.mod_equal,.mul_equal,.ns_c,.ns_separator,.or_equal,.plus_equal,.sl,.sl_equal,.sr,.sr_equal,.xor_equal,.start_heredoc,.end_heredoc,.object_operator,.paamayim_nekudotayim{color:black}.abstract,.array,.array_cast,.as,.break,.case,.catch,.class,.clone,.continue,.declare,.default,.do,.echo,.else,.elseif,.empty.enddeclare,.endfor,.endforach,.endif,.endswitch,.endwhile,.eval,.exit,.extends,.final,.for,.foreach,.function,.global,.goto,.if,.implements,.include,.include_once,.instanceof,.interface,.isset,.list,.namespace,.new,.print,.private,.public,.protected,.require,.require_once,.return,.static,.switch,.throw,.try,.unset,.use,.var,.while{color:royalblue}.open_tag,.open_tag_with_echo,.close_tag{color:orange}.ini_section{color:black}.ini_key{color:royalblue}.ini_value{color:crimson}.xml_tag{color:dodgerblue}.xml_attr{color:blueviolet}.xml_data{color:red}.section{color:black}.directive{color:blue}.data{color:dimgray}
INFO:run-ci:</style></head>
INFO:run-ci:<body>
INFO:run-ci:<h1>Internal Server Error</h1>
INFO:run-ci:<p>Array to string conversion</p>
INFO:run-ci:<pre>• <code><span class="string">tmp</span><span>/</span><span class="lnumber">0</span><span class="string">hiq642hpez</span><span class="dnumber">.0</span><span class="string">dmdv5cfew7</span><span>.</span><span class="string">php</span><span>:</span><span class="lnumber">15</span></code> <code><span class="string">Base</span><span class="object_operator">-&gt;</span><span>{</span><span class="string">closure</span><span>}</span><span>(</span><span>)</span></code>
INFO:run-ci:• <code><span class="string">lib</span><span>/</span><span class="string">base</span><span>.</span><span class="string">php</span><span>:</span><span class="lnumber">2073</span></code> <code><span class="require">require</span><span>(</span><span>)</span></code>
INFO:run-ci:• <code><span class="string">lib</span><span>/</span><span class="string">base</span><span>.</span><span class="string">php</span><span>:</span><span class="lnumber">2208</span></code> <code><span class="string">View</span><span class="object_operator">-&gt;</span><span class="string">sandbox</span><span>(</span><span>)</span></code>
INFO:run-ci:• <code><span class="string">index</span><span>.</span><span class="string">php</span><span>:</span><span class="lnumber">91</span></code> <code><span class="string">Preview</span><span class="object_operator">-&gt;</span><span class="string">render</span><span>(</span><span>)</span></code>
INFO:run-ci:• <code><span class="string">lib</span><span>/</span><span class="string">base</span><span>.</span><span class="string">php</span><span>:</span><span class="lnumber">1304</span></code> <code><span class="string">Base</span><span class="object_operator">-&gt;</span><span class="string">call</span><span>(</span><span>)</span></code>
INFO:run-ci:• <code><span class="string">index</span><span>.</span><span class="string">php</span><span>:</span><span class="lnumber">144</span></code> <code><span class="string">Base</span><span class="object_operator">-&gt;</span><span class="string">run</span><span>(</span><span>)</span></code>
INFO:run-ci:</pre>
INFO:run-ci:</body>
INFO:run-ci:</html>
INFO:run-ci:
INFO:run-ci:VALIDATING FORTUNE ... Fortune invalid. Diff following:
INFO:run-ci:--- Valid
INFO:run-ci:+++ Response
INFO:run-ci:@@ -1,107 +1,22 @@
INFO:run-ci: <!doctype-html><html><head><title>Fortunes</title></head><body><table><tr><th>id</th><th>message</th></tr><tr><td>11</td><td>&lt;script&gt;alert(&quot;This-should-not-be-displayed-in-a-browser-alert-box.&quot;);&lt;/script&gt;</td></tr><tr><td>4</td><td>A-bad-random-number-generator:-1,-1,-1,-1,-1,-4.33e+67,-1,-1,-1</td></tr><tr><td>5</td><td>A-computer-program-does-what-you-tell-it-to-do,-not-what-you-want-it-to-do.</td></tr><tr><td>2</td><td>A-computer-scientist-is-someone-who-fixes-things-that-aren&apos;t-broken.</td></tr><tr><td>8</td><td>A-list-is-only-as-strong-as-its-weakest-link.-—-Donald-Knuth</td></tr><tr><td>0</td><td>Additional+html><html><head><title>Fortunes</title></head><body><table><tr><th>id</th><th>message</th></tr><tr><td>12</td><td>Additional fortune added at request-time.</td></tr><tr><td>3</td><td>After-enough-decimal-places,-nobody-gives-a-damn.</td></tr><tr><td>7</td><td>Any-program-that-runs-right-is-obsolete.</td></tr><tr><td>10</td><td>Computers-make-very-fast,-very-accurate-mistakes.</td></tr><tr><td>6</td><td>Emacs-is-a-nice-operating-system,-but-I-prefer-UNIX.-—-Tom-Christaensen</td></tr><tr><td>9</td><td>Feature:-A-bug-with-seniority.</td></tr><tr><td>1</td><td>fortune:-No-such-file-or-directory</td></tr><tr><td>12</td><td>フレームワークのベンチマーク</td></tr></table></body></html>+time.</td></tr><tr><td>0</td><td><!doctype+html><html><head><title>500+Internal+Server+Error</title><style>code{word-wrap:break-word;color:black}.comment,.doc_comment,.ml_comment{color:dimgray;font-style:italic}.variable{color:blueviolet}.const,.constant_encapsed_string,.class_c,.dir,.file,.func_c,.halt_compiler,.line,.method_c,.lnumber,.dnumber{color:crimson}.string,.and_equal,.boolean_and,.boolean_or,.concat_equal,.dec,.div_equal,.inc,.is_equal,.is_greater_or_equal,.is_identical,.is_not_equal,.is_not_identical,.is_smaller_or_equal,.logical_and,.logical_or,.logical_xor,.minus_equal,.mod_equal,.mul_equal,.ns_c,.ns_separator,.or_equal,.plus_equal,.sl,.sl_equal,.sr,.sr_equal,.xor_equal,.start_heredoc,.end_heredoc,.object_operator,.paamayim_nekudotayim{color:black}.abstract,.array,.array_cast,.as,.break,.case,.catch,.class,.clone,.continue,.declare,.default,.do,.echo,.else,.elseif,.empty.enddeclare,.endfor,.endforach,.endif,.endswitch,.endwhile,.eval,.exit,.extends,.final,.for,.foreach,.function,.global,.goto,.if,.implements,.include,.include_once,.instanceof,.interface,.isset,.list,.namespace,.new,.print,.private,.public,.protected,.require,.require_once,.return,.static,.switch,.throw,.try,.unset,.use,.var,.while{color:royalblue}.open_tag,.open_tag_with_echo,.close_tag{color:orange}.ini_section{color:black}.ini_key{color:royalblue}.ini_value{color:crimson}.xml_tag{color:dodgerblue}.xml_attr{color:blueviolet}.xml_data{color:red}.section{color:black}.directive{color:blue}.data{color:dimgray}
INFO:run-ci:</style></head><body><h1>Internal+Server+Error</h1><p>Array+to+string+conversion</p><pre>•+<code><span>tmp</span><span>/</span><span>0</span><span>hiq642hpez</span><span>.0</span><span>dmdv5cfew7</span><span>.</span><span>php</span><span>:</span><span>15</span></code><code><span>Base</span><span>-&gt;</span><span>{</span><span>closure</span><span>}</span><span>(</span><span>)</span></code>
INFO:run-ci:•+<code><span>lib</span><span>/</span><span>base</span><span>.</span><span>php</span><span>:</span><span>2073</span></code><code><span>require</span><span>(</span><span>)</span></code>
INFO:run-ci:•+<code><span>lib</span><span>/</span><span>base</span><span>.</span><span>php</span><span>:</span><span>2208</span></code><code><span>View</span><span>-&gt;</span><span>sandbox</span><span>(</span><span>)</span></code>
INFO:run-ci:•+<code><span>index</span><span>.</span><span>php</span><span>:</span><span>91</span></code><code><span>Preview</span><span>-&gt;</span><span>render</span><span>(</span><span>)</span></code>
INFO:run-ci:•+<code><span>lib</span><span>/</span><span>base</span><span>.</span><span>php</span><span>:</span><span>1304</span></code><code><span>Base</span><span>-&gt;</span><span>call</span><span>(</span><span>)</span></code>
INFO:run-ci:•+<code><span>index</span><span>.</span><span>php</span><span>:</span><span>144</span></code><code><span>Base</span><span>-&gt;</span><span>run</span><span>(</span><span>)</span></code></pre></body></html>
INFO:run-ci:FAIL
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  VERIFYING UPDATE (/update-raw/)
INFO:run-ci:--------------------------------------------------------------------------------HTTP/1.1 200 OK
INFO:run-ci:Server: nginx/1.4.1
INFO:run-ci:Date: Fri, 22 Aug 2014 18:57:58 GMT
INFO:run-ci:Content-Type: application/json
INFO:run-ci:Transfer-Encoding: chunked
INFO:run-ci:Connection: keep-alive
INFO:run-ci:X-Content-Type-Options: nosniff
INFO:run-ci:X-Frame-Options: SAMEORIGIN
INFO:run-ci:X-Powered-By: Fat-Free Framework
INFO:run-ci:X-XSS-Protection: 1; mode=block
INFO:run-ci:Cache-Control: no-cache, no-store, must-revalidate
INFO:run-ci:
INFO:run-ci:[{"id":9240,"randomNumber":698},{"id":8448,"randomNumber":1878}]
INFO:run-ci:
INFO:run-ci:VALIDATING UPDATE ... PASS
INFO:run-ci:
INFO:run-ci:--------------------------------------------------------------------------------
INFO:run-ci:  Stopping fat-free-raw
INFO:run-ci:----------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO:run-ci:  Stopped fat-free-raw
INFO:run-ci:----------------------------------------------------------------------------------------------------------------------------------------------------------------
INFO:run-ci:  Saving results through fat-free-raw
INFO:run-ci:--------------------------------------------------------------------------------
real    3m7.052s
user    0m1.083s
sys 0m0.686s
The command "time ./toolset/run-ci.py verify "$TESTDIR"" exited with 1.
Done. Your build exited with 1.

update benchmark tests

If we want F3 to take part at the next Round, we need to resolve this issue: TechEmpower#1734

I wasn't able to get the test suite running locally more than once in vagrant and copy,pasting setup routines from other frameworks doesn't seem to work here anymore... well I'm not that good at writing shell scripts. So if someone has some time, please help to fix this.

@sn0opy @xfra35 @Rayne @KOTRET @bcosca

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.