The gosercomp's intro from gz-c

Golang Serialization Benchmark

Serializers

This project test the below go serializers, which compares with go standard json and xml.

Excluded Serializers

Given existed benchmark by alecthomas，the below serializers are excluded from this test because of their poor performance.

Test Environment

go version: 1.11

You'll need to install some tools. On OS X:

brew install thrift flatbuffers

For skyencoder, you need to install the tool and get go generate to generate code:
```
go get github.com/skycoin/skyencoder/cmd/skyencoder
go generate
```
For MessagePack，you need install the tool and use go generate to generate code:
```
go get github.com/tinylib/msgp
go generate
```
For ProtoBuf, you need to install protoc，protobuf lib and generate code：
```
go get github.com/golang/protobuf
go generate
```

For gogo/protobuf, use the below commands：

go get github.com/gogo/protobuf/gogoproto
go get -u github.com/gogo/protobuf/protoc-gen-gogofaster
go generate

For flatbuffers, you need to install [flatbuffers compiler](https://github.com/google/flatbuffers/releases, and flatbuffers lib：
```
go get github.com/google/flatbuffers/go
go generate
```
For thrift, you need to install thrift compiler, and thrift lib：
```
go get git.apache.org/thrift.git/lib/go/thrift
go generate
```

For Avro, you need to install goavro and checkout v1.0.5：

go get github.com/linkedin/goavro
cd $GOPATH/src/github.com/linkedin/goavro
git checkout v1.0.5
cd -
go generate

For gencode, you need to install gencode, and geneate code by gencode：

go get github.com/andyleap/gencode
gencode go -schema=gencode.schema -package gosercomp

For easyjson, you need to install easyjson:

go get github.com/mailru/easyjson
go generate

For zebraPack , you need to install zebraPack, and generate code：

go get github.com/glycerine/zebrapack
go generate zebrapack_data.go

For ugorji/go/codec you need to install codecgen and codec lib:

  go get -tags=unsafe  -u github.com/ugorji/go/codec/codecgen
  go get -tags=unsafe -u github.com/ugorji/go/codec

  codecgen -o data_codec.go data.go

For niubaoshu/gotiny you need to checkout v0.0.2:

	go get github.com/niubaoshu/gotiny
	cd $GOPATH/src/github.com/niubaoshu/gotiny
	git checkout v0.0.2

ugorji/go/codec supports msgpack、cbor、binc、json, and this project test its cbor and msgpack.

Actually，you can use go generate to generate code.

Test:

go test -bench=. -benchmem

Test Data Model

All tests are using the same data model as below:

type ColorGroup struct {
    ID     int `json:"id" xml:"id,attr""`
    Name   string `json:"name" xml:"name"`
    Colors []string `json:"colors" xml:"colors"`
}
`

Benchmark

Results generated on Mid-2015 Macbook Pro base model:

goos: darwin
goarch: amd64
pkg: github.com/smallnest/gosercomp
BenchmarkMarshalByJson-8                       	 2000000	       693 ns/op	     128 B/op	       2 allocs/op
BenchmarkUnmarshalByJson-8                     	 1000000	      2168 ns/op	     216 B/op	       8 allocs/op
BenchmarkMarshalByXml-8                        	  500000	      3584 ns/op	    4800 B/op	      11 allocs/op
BenchmarkUnmarshalByXml-8                      	  200000	     12458 ns/op	    3018 B/op	      73 allocs/op
BenchmarkMarshalByMsgp-8                       	20000000	       116 ns/op	      80 B/op	       1 allocs/op
BenchmarkUnmarshalByMsgp-8                     	 5000000	       235 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByProtoBuf-8                   	10000000	       200 ns/op	      48 B/op	       1 allocs/op
BenchmarkUnmarshalByProtoBuf-8                 	 3000000	       494 ns/op	     160 B/op	      10 allocs/op
BenchmarkMarshalByGogoProtoBuf-8               	10000000	       118 ns/op	      48 B/op	       1 allocs/op
BenchmarkUnmarshalByGogoProtoBuf-8             	 3000000	       415 ns/op	     144 B/op	       8 allocs/op
BenchmarkMarshalByFlatBuffers-8                	 5000000	       381 ns/op	      16 B/op	       1 allocs/op
BenchmarkUnmarshalByFlatBuffers-8              	2000000000	         0.35 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByFlatBuffers_withFields-8   	10000000	       140 ns/op	       0 B/op	       0 allocs/op
BenchmarkMarshalByThrift-8                     	 3000000	       458 ns/op	      64 B/op	       1 allocs/op
BenchmarkUnmarshalByThrift-8                   	 1000000	      1269 ns/op	     656 B/op	      11 allocs/op
BenchmarkMarshalByAvro-8                       	 3000000	       513 ns/op	      48 B/op	       6 allocs/op
BenchmarkUnmarshalByAvro-8                     	  500000	      3168 ns/op	    1672 B/op	      62 allocs/op
BenchmarkMarshalByGencode-8                    	30000000	        42.4 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByGencode-8                  	10000000	       125 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByUgorjiCodecAndCbor-8         	 2000000	       713 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndCbor-8       	 2000000	       618 ns/op	      48 B/op	       6 allocs/op
BenchmarkMarshalByUgorjiCodecAndMsgp-8         	 2000000	       669 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndMsgp-8       	 2000000	       644 ns/op	      48 B/op	       6 allocs/op
BenchmarkMarshalByUgorjiCodecAndBinc-8         	 2000000	       703 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndBinc-8       	 1000000	      1062 ns/op	     824 B/op	      10 allocs/op
BenchmarkMarshalByUgorjiCodecAndJson-8         	 2000000	       847 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndJson-8       	 2000000	       788 ns/op	      48 B/op	       6 allocs/op
BenchmarkMarshalByEasyjson-8                   	 5000000	       302 ns/op	     128 B/op	       1 allocs/op
BenchmarkUnmarshalByEasyjson-8                 	 3000000	       452 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByFfjson-8                     	 1000000	      1031 ns/op	     424 B/op	       9 allocs/op
BenchmarkUnmarshalByFfjson-8                   	 1000000	      1479 ns/op	     480 B/op	      13 allocs/op
BenchmarkMarshalByJsoniter-8                   	 3000000	       529 ns/op	      96 B/op	       2 allocs/op
BenchmarkUnmarshalByJsoniter-8                 	 3000000	       589 ns/op	      32 B/op	       5 allocs/op
BenchmarkUnmarshalByGJSON-8                    	 1000000	      1680 ns/op	     624 B/op	       7 allocs/op
BenchmarkMarshalByGoMemdump-8                  	  300000	      4686 ns/op	    1032 B/op	      30 allocs/op
BenchmarkUnmarshalByGoMemdump-8                	 1000000	      1348 ns/op	    2400 B/op	      12 allocs/op
BenchmarkMarshalBySky-8                        	 2000000	       761 ns/op	     112 B/op	       7 allocs/op
BenchmarkUnmarshalBySky-8                      	 2000000	       701 ns/op	     216 B/op	      11 allocs/op
BenchmarkMarshalBySkyencoder-8                 	20000000	        75.3 ns/op	       0 B/op	       0 allocs/op
BenchmarkMarshalBySkyencoderWithAlloc-8        	20000000	       112 ns/op	      64 B/op	       1 allocs/op
BenchmarkUnmarshalBySkyencoder-8               	10000000	       206 ns/op	      96 B/op	       6 allocs/op
BenchmarkMarshalByColfer-8                     	50000000	        33.7 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByColfer-8                   	10000000	       213 ns/op	      96 B/op	       6 allocs/op
BenchmarkMarshalByZebrapack-8                  	10000000	       262 ns/op	     182 B/op	       0 allocs/op
BenchmarkUnmarshalByZebrapack-8                	 5000000	       291 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByGotiny-8                     	20000000	        86.9 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByGotiny-8                   	10000000	       176 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByHprose-8                     	 3000000	       455 ns/op	     210 B/op	       1 allocs/op
BenchmarkUnmarshalByHprose-8                   	 2000000	       654 ns/op	     288 B/op	       9 allocs/op
BenchmarkMarshalBySereal-8                     	 1000000	      2202 ns/op	     792 B/op	      22 allocs/op
BenchmarkUnmarshalBySereal-8                   	 2000000	       696 ns/op	      80 B/op	       6 allocs/op
BenchmarkMarshalByMsgpackV2-8                  	 1000000	      2008 ns/op	     192 B/op	       4 allocs/op
BenchmarkUnmarshalByMsgpackv2-8                	 1000000	      1585 ns/op	     232 B/op	      11 allocs/op
BenchmarkMarshalMsgZColorGroup-8               	20000000	        77.3 ns/op	      80 B/op	       1 allocs/op
BenchmarkAppendMsgZColorGroup-8                	30000000	        39.3 ns/op	 356.08 MB/s	       0 B/op	       0 allocs/op
BenchmarkUnmarshalZColorGroup-8                	20000000	        80.6 ns/op	 173.66 MB/s	       0 B/op	       0 allocs/op
BenchmarkEncodeZColorGroup-8                   	20000000	        66.2 ns/op	 211.60 MB/s	      16 B/op	       1 allocs/op
BenchmarkDecodeZColorGroup-8                   	10000000	       129 ns/op	 108.12 MB/s	       0 B/op	       0 allocs/op

Size of marshalled results

    gosercomp_test.go:99: json:				 65 bytes
    gosercomp_test.go:102: xml:				 137 bytes
    gosercomp_test.go:105: msgp:				 47 bytes
    gosercomp_test.go:108: protobuf:				 36 bytes
    gosercomp_test.go:111: gogoprotobuf:			 36 bytes
    gosercomp_test.go:115: flatbuffers:			 108 bytes
    gosercomp_test.go:121: thrift:				 63 bytes
    gosercomp_test.go:135: avro:				 32 bytes
    gosercomp_test.go:144: gencode:				 34 bytes
    gosercomp_test.go:150: UgorjiCodec_Cbor:		 47 bytes
    gosercomp_test.go:156: UgorjiCodec_Msgp:		 47 bytes
    gosercomp_test.go:162: UgorjiCodec_Bin:			 53 bytes
    gosercomp_test.go:164: UgorjiCodec_Json:		 91 bytes
    gosercomp_test.go:167: easyjson:			 65 bytes
    gosercomp_test.go:170: ffjson:				 65 bytes
    gosercomp_test.go:173: jsoniter:			 65 bytes
    gosercomp_test.go:177: memdump:				 200 bytes
    gosercomp_test.go:180: colfer:				 35 bytes
    gosercomp_test.go:183: sky:				 52 bytes
    gosercomp_test.go:186: skyencoder:				 52 bytes
    gosercomp_test.go:189: zebrapack:			 48 bytes
    gosercomp_test.go:193: gotiny:				 32 bytes
    gosercomp_test.go:198: hprose:				 32 bytes
    gosercomp_test.go:202: sereal:				 76 bytes
    gosercomp_test.go:205: msgpackv2:			 47 bytes

gz-c / gosercomp Goto Github PK

gosercomp's Introduction

Golang Serialization Benchmark

Serializers

Excluded Serializers

Test Environment

Test Data Model

Benchmark

Size of marshalled results

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent