Comments (2)
We agree, additional metrics such as latency would be great additions. We have received a couple other comments of a similar nature via e-mail. We're not certain if we can get that kind of data out of the test tool we're using (WeigHTTP), but we'll investigate. One or two other testing tools have been recommended, so we'll look into those as well.
It won't be something we can do super quickly since Pat put effort into parsing the WeigHTTP results into JSON files that the blog entry renders. That work will need to be repeated if we change to another tool. But ultimately, if another tool gives us more and better data, we'd prefer to use that.
We do in fact capture total run time for each test and that is in the JSON data files if you look at them. We just don't render that anywhere in the blog entry. We had toyed with rendering the total "EC2 cost" for running each test on the two Large instances as an amusing factoid but passed on it in the end.
Raw WeigHTTP capture for Go (as an example):
https://github.com/TechEmpower/FrameworkBenchmarks/blob/master/results/i7/20130321085035/json/go/raw
from frameworkbenchmarks.
We're putting together the next round of numbers now, and this time we're using Wrk (https://github.com/wg/wrk) instead of WeigHTTP (https://github.com/lighttpd/weighttp), so we'll have latency numbers. We're hoping to have updated results later this week.
from frameworkbenchmarks.
Related Issues (20)
- Node & Express Thread Configuration HOT 1
- Flask five times slower in Round 21 than Round 20 HOT 1
- ASP.NET Core platform Json and Plaintext HOT 4
- Round 22 results site shows "woo" test with Racket in the language column whereas it is written in Common Lisp
- New execution mode "profiling" HOT 6
- Enhancement request: disable pg_stat_statements when running anything but validation
- PHP 8.3 update [info]
- Inconsistent composite score best score computation HOT 2
- Holiday Break HOT 8
- Where to find the exact code that was used for Round22? HOT 1
- Expired SSL `tfb-status.techempower.com` HOT 1
- Actix failing build HOT 9
- New Server Set up HOT 56
- Most of the best-performing frameworks don't survive temporary db connectivity loss HOT 25
- [IMPORTANT] To further test fairness. Please consider this for next benchmark tests. HOT 1
- gRPC Framework benchmark HOT 1
- Please upgrade hardware for extreme testings HOT 1
- Increase concurrency for future rounds to better showcase performance on large servers HOT 2
- Randomize Framework order in runs HOT 10
- Add GraalVM native build for Quarkus HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from frameworkbenchmarks.