Giter Club home page Giter Club logo

go_db_bench's Introduction

Go Database Benchmark

This tests the performance of pgx native, pgx through database/sql, pq through database/sql, go-pg, and theoretical maximum PostgreSQL performance. Unless the test specifically states otherwise it always uses prepared statements.

Interesting Results

  • Network latency and PostgreSQL server processing time dominate most real world tests.
  • A simple query executed locally via Unix domain sockets can be several times faster than over the network.
  • TLS is cheap but it is not free (~15% impact).

All the Go drivers perform similarly when performing queries that return small result sets over TCP. Larger differences are apparent with large result sets especially if one driver uses the binary format and another uses the text format for results.

In addition, using driver-specific features can yield significant performance deltas. For example:

  • Batch operations make a huge difference when network latency is a significant factor (pgx and go-pg support in various ways).
  • pgx automatically prepares and caches SQL. This can make a large difference for code that does not explicitly prepare statements, but has no advantage if it does.
  • go-pg is an ORM as well as a driver. Idiomatic usage is different and does more work than other drivers. This makes direct comparison difficult.

The raw results analyzed above are in the results directory. You can also run the benchmarks for yourself in your own environment.

Configuration

go_db_bench reads its configuration from the standard PostgreSQL environment variables such as PGHOST, PGPORT, PGUSER, PGPASSWORD, PGDATABASE, and PGSSLMODE.

Core Benchmarks

go_db_bench includes tests selecting one value, one row, and multiple rows.

Example execution:

PGHOST=/private/tmp go test -test.bench=. -test.benchmem

HTTP Benchmarks

go_db_bench includes a simple HTTP server that serves JSON directly from PostgreSQL. This allows testing the performance of database drivers in a more real-world environment.

Example execution:

go build && PGHOST=/private/tmp ./go_db_bench

It exposes the following endpoints:

  • /people/pgx-native - pgx through its native interface
  • /people/pgx-stdlib - pgx through database/sql
  • /people/pq - pq through database/sql

Start the server and use your favorite HTTP load tester to benchmark (I recommend siege or overload).

Theoretical Max PostgreSQL Performance

This benchmark includes a minimum PostgreSQL driver sufficient to establish a connection and prepare statements. Query execution is benchmarked by sending a []byte filled with the query command and reading until the ready for query message is received. This should be the theoretical best performance a Go PostgreSQL driver could achieve.

Caveat: The returned data is not checked or parsed. It is only read until the ready for query message is received. If an error occurs it may not be apparent which could cause the timing to be misleading.

go_db_bench's People

Contributors

jackc avatar hashrocketeer avatar vmihailenco avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.