tarekdj / db-benchmark Goto Github PK

We've been running the benchmarks without clearing query cache between all the tests, which probably makes the results incorrect.

I added a "reset query cache" in the PDO test and the difference is that before doing that the PDO result was:

PDO | Time: 0.067 s | Memory: 0.5 MB | PHP: 5.5.9-1ubuntu4.2

and after it was:

PDO | Time: 0.891 s | Memory: 0.5 MB | PHP: 5.5.9-1ubuntu4.2

That's a factor 13 difference, which is fairly significant.

This is the caching mechanism in Mysql, when loads of duplicate queries are performed.

I've ran it quite a few times on my local machine now, with generally similar results:

NDB 2.2 | Time: 1.950 s | Memory: 14.0 MB | PHP: 5.5.3-1ubuntu2.3 | Nette: 2.2.x
NotOrm | Time: 8.290 s | Memory: 7.3 MB | PHP: 5.5.3-1ubuntu2.3
PDO | Time: 0.089 s | Memory: 0.3 MB | PHP: 5.5.3-1ubuntu2.3
FluentPDO | Time: 0.721 s | Memory: 5.4 MB | PHP: 5.5.3-1ubuntu2.3
LeanMapper | Time: 1.668 s | Memory: 15.9 MB | PHP: 5.5.3-1ubuntu2.3
Doctrine2 | Time: 10.326 s | Memory: 27.4 MB | PHP: 5.5.3-1ubuntu2.3 | Doctrine: 2.4.2

Sample query:

'SELECT DISTINCT u.id FROM %s AS listuser
CROSS JOIN %s AS u
CROSS JOIN %s AS listmessage
LEFT JOIN %s AS um
ON (um.messageid = %d AND um.userid = listuser.userid)
WHERE true
AND listmessage.messageid = %d
AND listmessage.listid = listuser.listid
AND u.id = listuser.userid
AND um.userid IS NULL
AND u.confirmed and !u.blacklisted and !u.disabled'

Sample query:

'SELECT DISTINCT u.id FROM %s AS listuser
CROSS JOIN %s AS u
CROSS JOIN %s AS listmessage
LEFT JOIN %s AS um
ON (um.messageid = %d AND um.userid = listuser.userid)
WHERE true
AND listmessage.messageid = %d
AND listmessage.listid = listuser.listid
AND u.id = listuser.userid
AND um.userid IS NULL
AND u.confirmed and !u.blacklisted and !u.disabled'

Sample query:

'SELECT DISTINCT u.id FROM %s AS listuser
CROSS JOIN %s AS u
CROSS JOIN %s AS listmessage
LEFT JOIN %s AS um
ON (um.messageid = %d AND um.userid = listuser.userid)
WHERE true
AND listmessage.messageid = %d
AND listmessage.listid = listuser.listid
AND u.id = listuser.userid
AND um.userid IS NULL
AND u.confirmed and !u.blacklisted and !u.disabled'