datadog / datadog-trace-agent Goto Github PK

Datadog Trace Agent archive (pre-6.10.0)

Home Page: https://docs.datadoghq.com/tracing/

datadog datadog-agent trace-agent apm apm-agent tracing

datadog-trace-agent's Introduction

⚠️ Repository locked

The trace agent code has been merged into the main datadog-agent repository. Installation instructions and documentation are now located here.

This repository only contains code and commits prior to (and including) release 6.9.0 and 5.31.0 of the trace agent, on the archive branch.

Please forward any issues or pull requests regarding the trace agent to the datadog-agent repository.

datadog-trace-agent's People

Contributors

Stargazers

Watchers

datadog-trace-agent's Issues

cmd/trace-agent: resource replace rules get applied to "sql.query" tag too

Moved from DataDog/dd-trace-go#274.

I work on a service that has to use complicated and varying WHERE expressions in its queries. There is no way to avoid this because, among other reasons, we have to use IN expressions with a varying number of arguments, and we can not convert the IN expressions into JOINs for performance reasons. This makes the Datadog APM UI harder to use because it results in a very high cardinality of resource names. The docs also indicate there is a hard limit to the allowed cardinality of a resource, and we don't want to lose data.

There are some things you could do automatically to try and group queries. But I think it might be better if you just let users customize it as an option, since there isn't really a way to cover every use case for every database. So, can you provide a hook so we can set our own function that normalizes resource names in queries? (And maybe you could provide a few examples that people can use if it fits their use case.)

Eg. I'd like to be able to write a function that automatically turns a query like this:

SELECT col1, col2, col3
FROM tablea JOIN tableb on tablea.col52 = tableb.col3
WHERE (tablea.col5 in (?, ?, ?, ?) AND tableb.col4 in (?, ?)) AND tablea.col76 = 5 AND tableb.col33 in (?, ?, ?, ?, ?, ?, ?, ?, ?, ?)

into a query like SELECT col1, col2, col3 FROM tablea JOIN tableb ON tablea.col52 = tableb.col3 using a regular expression. Then the original query could be added as a tag so it can still be viewed for debugging.

Issue with building trace agent for mac

Sharads-MacBook-Pro:datadog-trace-agent holani$ make install

# prepares all dependencies by running the 'deps' task, generating
# versioning information and installing the binary.
go generate ./info
go install ./cmd/trace-agent
# github.com/datadog-trace-agent/cmd/trace-agent
cmd/trace-agent/receiver.go:274:44: cannot use &servicesMeta (type *model.ServicesMetadata) as type "github.com/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Decodable in argument to decodeReceiverPayload:
        *model.ServicesMetadata does not implement "github.com/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Decodable (wrong type for DecodeMsg method)
                have DecodeMsg(*"github.com/DataDog/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Reader) error
                want DecodeMsg(*"github.com/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Reader) error
cmd/trace-agent/receiver.go:386:45: cannot use &traces (type *model.Traces) as type "github.com/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Decodable in argument to decodeReceiverPayload:
        *model.Traces does not implement "github.com/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Decodable (wrong type for DecodeMsg method)
                have DecodeMsg(*"github.com/DataDog/datadog-trace-agent/vendor/github.com/tinylib/msgp/msgp".Reader) error
                want DecodeMsg

foobar

Traces whose names contain no alphabetic characters are dropped

I noticed a few dropped traces in the agent logs that looked like this:
[ TRACE ] 2018-10-31 11:36:15 ERROR (api.go:249) - dropping trace reason: invalid span (SpanID:<removed> span.normalize: invalid 'Name': / (debug for more info)
We're using java-jaxrs to trace requests, and it sets the path as operation name, so when a request is towards the root path, such as in this case, the name is /.

The relevant piece of code:

datadog-trace-agent/model/normalizer.go

Lines 195 to 202 in 5c6958a

 // skip non-alphabetic characters 

 for ; i < len(name) && !isAlpha(name[i]); i++ { 

 } 

 // if there were no alphabetic characters it wasn't valid 

 if i == len(name) { 

 return "", false 

 }

As far as I know, there's nothing in the opentracing specification specifically saying that the name must contain alphabetic characters, but I suppose it could be argued that its not 'human-readable'.

This isn't a huge issue, I could just manually give it another operation name, but then it wouldn't be consistent with the rest of the request names.

What are your thoughts?

Filter `LIMIT` ranges in sql query resources

Including a LIMIT x, y in a query resource, for example when paging over results, can drastically increase the cardinality of traced resources. I would prefer if LIMIT ranges were filtered out of the query, or replaced with placeholders, by the agent. I could still set the original query on metadata if I wanted to identify the actual values when inspecting traces.

It appears that single LIMIT x is replaced with a LIMIT ? placeholder already. But a range LIMIT x, y is not.

environment tag should be normalized as a tag

normalize in the agent the "env" config value + env coming from span metadata values as a Datadog tag
add to documentation that the env value will be normalized like a Datadog tag
fix current values in backend to fix UI for customers that use such tags

Add yaml config for log location

Currently

Currently the trace agent allows a yaml config for log level, but not for log location. This means that users without write access to /var/log will constantly get errors.

seelog internal error: mkdir /var/log/datadog/: read-only file system
Heroku users see this message thousands of times.

Expected

Users should be able to specify a log location in the datadog.yaml, similar to the log_file config on the main Agent.

Concurrent map access crash

The trace agent was crashing on one of my nodes:

sudo /opt/datadog-agent/bin/trace-agent -ddconfig /etc/dd-agent/datadog.conf
2017-05-22 20:21:54 INFO (main.go:167) - using configuration from /etc/dd-agent/datadog.conf
2017-05-22 20:21:54 INFO (receiver.go:130) - listening for traces at http://localhost:8126




fatal error: concurrent map read and map write

goroutine 10385 [running]:
runtime.throw(0x92f164, 0x21)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/panic.go:596 +0x95 fp=0xc4201fd7f0 sp=0xc4201fd7d0
runtime.mapaccess1_faststr(0x895580, 0xc4202f0900, 0x921ee4, 0xa, 0xc420a1a401)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/hashmap_fast.go:217 +0x4cf fp=0xc4201fd850 sp=0xc4201fd7f0
github.com/DataDog/datadog-trace-agent/model.(*StatsRawBucket).add(0xc4200b2090, 0xc42055dae0, 0xc, 0xc4208e9d40, 0x13, 0xc420c933d0, 0x10, 0x25af0c242b5404e2, 0x4c07bfb931eaf815, 0x14c1073e75166278, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/model/statsraw.go:212 +0x118 fp=0xc4201fd9d8 sp=0xc4201fd850
github.com/DataDog/datadog-trace-agent/model.(*StatsRawBucket).HandleSpan(0xc4200b2090, 0xc42055dae0, 0xc, 0xc4208e9d40, 0x13, 0xc420c933d0, 0x10, 0x25af0c242b5404e2, 0x4c07bfb931eaf815, 0x14c1073e75166278, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/model/statsraw.go:193 +0x47a fp=0xc4201fdd20 sp=0xc4201fd9d8
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5900, 0x2, 0x2, 0xc4207a5980, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:50 +0x32c fp=0xc4201fdf48 sp=0xc4201fdd20
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d fp=0xc4201fdfb8 sp=0xc4201fdf48
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900e60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43 fp=0xc4201fdfd8 sp=0xc4201fdfb8
runtime.goexit()
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/asm_amd64.s:2197 +0x1 fp=0xc4201fdfe0 sp=0xc4201fdfd8
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 1 [runnable]:
main.(*Agent).Process(0xc42019d580, 0xc4204f2c00, 0x4, 0x4)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:147 +0xfc
main.(*Agent).Run(0xc42019d580)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:95 +0x250
main.main()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/main.go:232 +0x8d3

goroutine 17 [syscall, locked to thread]:
runtime.goexit()
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/asm_amd64.s:2197 +0x1

goroutine 5 [semacquire]:
sync.runtime_notifyListWait(0xc420056950, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:297 +0x10b
sync.(*Cond).Wait(0xc420056940)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/cond.go:57 +0x89
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc4200b2120, 0x0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xb3
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc4200b2120)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x44
created by github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.NewAsyncLoopLogger
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x9f

goroutine 6 [semacquire]:
sync.runtime_notifyListWait(0xc420056ad0, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:297 +0x10b
sync.(*Cond).Wait(0xc420056ac0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/cond.go:57 +0x89
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc4200b2240, 0x0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xb3
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc4200b2240)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x44
created by github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.NewAsyncLoopLogger
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x9f

goroutine 10 [syscall]:
os/signal.signal_recv(0xc42002bfb0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sigqueue.go:116 +0x104
os/signal.loop()
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/os/signal/signal_unix.go:22 +0x22
created by os/signal.init.1
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/os/signal/signal_unix.go:28 +0x41

goroutine 34 [semacquire]:
sync.runtime_notifyListWait(0xc42019cd50, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:297 +0x10b
sync.(*Cond).Wait(0xc42019cd40)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/cond.go:57 +0x89
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc4200b27e0, 0x93d300)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xb3
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc4200b27e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x44
created by github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.NewAsyncLoopLogger
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x9f

goroutine 35 [semacquire]:
sync.runtime_notifyListWait(0xc42019d350, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:297 +0x10b
sync.(*Cond).Wait(0xc42019d340)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/cond.go:57 +0x89
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc4200b2900, 0x0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xb3
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc4200b2900)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x44
created by github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.NewAsyncLoopLogger
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x9f

goroutine 36 [select]:
main.(*ThrottledReceiver).AfterParse.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/log.go:153 +0x108
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012b650)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 37 [semacquire]:
sync.runtime_notifyListWait(0xc42019d4d0, 0x1)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:297 +0x10b
sync.(*Cond).Wait(0xc42019d4c0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/cond.go:57 +0x89
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc4200b2a20, 0x0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xb3
github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc4200b2a20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x44
created by github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog.NewAsyncLoopLogger
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x9f

goroutine 39 [chan receive]:
main.(*APIEndpoint).logStats(0xc420139f80)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/endpoint.go:206 +0xaf
main.NewAPIEndpoint.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/endpoint.go:68 +0x2a
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012b9c0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 40 [chan receive]:
main.handleSignal(0xc4201a0180)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/main.go:28 +0x126
main.main.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/main.go:228 +0x2e
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012b9e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 42 [chan receive]:
main.(*StoppableListener).Refresh(0xc4201ce1c0, 0x7d0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/listener.go:34 +0x77
main.(*HTTPReceiver).Listen.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/receiver.go:133 +0x3e
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4201ce200)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 43 [IO wait]:
net.runtime_pollWait(0x7f8edaf20110, 0x72, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/netpoll.go:164 +0x59
net.(*pollDesc).wait(0xc4201ca0d8, 0x72, 0x0, 0xc42029e040)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/fd_poll_runtime.go:75 +0x38
net.(*pollDesc).waitRead(0xc4201ca0d8, 0xffffffffffffffff, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/fd_poll_runtime.go:80 +0x34
net.(*netFD).accept(0xc4201ca070, 0x0, 0xb43740, 0xc42029e040)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/fd_unix.go:430 +0x1e5
net.(*TCPListener).accept(0xc42000e420, 0xb7cd20, 0x0, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/tcpsock_posix.go:136 +0x2e
net.(*TCPListener).Accept(0xc42000e420, 0xed0b53f66, 0x27c8c2e2, 0xb7cd20, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/tcpsock.go:228 +0x49
main.(*StoppableListener).Accept(0xc4201ce1c0, 0x93ce98, 0xc4200b0e60, 0xb48e00, 0xc42019bef0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/listener.go:64 +0xd5
net/http.(*Server).Serve(0xc4200ab3f0, 0xb48280, 0xc4201ce1c0, 0x0, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/http/server.go:2643 +0x228
main.(*HTTPReceiver).Listen.func2()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/receiver.go:136 +0x3f
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4201ce220)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 44 [select]:
github.com/DataDog/datadog-trace-agent/sampler.(*PreSampler).Run(0xc4201a0300)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/presampler.go:68 +0x159
main.(*HTTPReceiver).Run.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/receiver.go:100 +0x2e
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012bb40)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 45 [chan receive]:
main.(*HTTPReceiver).logStats(0xc420139f10)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/receiver.go:278 +0xd0
main.(*HTTPReceiver).Run.func2()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/receiver.go:103 +0x2a
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012bb50)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 46 [select]:
main.(*Writer).main(0xc4201a0540)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/writer.go:122 +0x513
main.(*Writer).Run.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/writer.go:107 +0x2a
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012bb60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 47 [select]:
github.com/DataDog/datadog-trace-agent/sampler.(*Sampler).RunAdjustScoring(0xc42019d540)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/sampler.go:108 +0x157
github.com/DataDog/datadog-trace-agent/sampler.(*Sampler).Run(0xc42019d540)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/sampler.go:93 +0x75
main.(*Sampler).Run.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/sampler.go:59 +0x33
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012bb70)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 48 [select]:
github.com/DataDog/datadog-trace-agent/sampler.(*Backend).Run(0xc42019d500)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/backend.go:59 +0x159
github.com/DataDog/datadog-trace-agent/sampler.(*Sampler).Run.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/sampler.go:91 +0x2d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc42012bb80)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 19 [select, locked to thread]:
runtime.gopark(0x93d4e8, 0x0, 0x91eb3c, 0x6, 0x18, 0x2)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/proc.go:271 +0x13a
runtime.selectgoImpl(0xc4201f8f50, 0x0, 0x18)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/select.go:423 +0x1364
runtime.selectgo(0xc4201f8f50)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/select.go:238 +0x1c
runtime.ensureSigM.func1()
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/signal_unix.go:434 +0x2dd
runtime.goexit()
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/asm_amd64.s:2197 +0x1

goroutine 10249 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2200, 0x2, 0x2, 0xc4207b2280, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721d60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10365 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4f00, 0x2, 0x2, 0xc4207a4f80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900be0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10351 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c3400, 0x4, 0x4, 0xc4207c3480, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900a20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10381 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5700, 0x2, 0x2, 0xc4207a5780, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900de0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10419 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209012a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10412 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209011c0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10361 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4e00, 0x2, 0x2, 0xc4207a4e80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900b60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10369 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5100, 0x2, 0x2, 0xc4207a5180, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900c60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10315 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3a00, 0x2, 0x2, 0xc4207b3a80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209005a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10355 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c3600, 0x4, 0x4, 0xc4207c3680, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900aa0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10377 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5500, 0x2, 0x2, 0xc4207a5580, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900d60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10417 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901260)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10359 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4d00, 0x2, 0x2, 0xc4207a4d80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900b20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10279 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2c00, 0x2, 0x2, 0xc4207b2c80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900120)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10329 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4000, 0x2, 0x2, 0xc4207a4080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900760)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10273 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2800, 0x4, 0x4, 0xc4207c2880, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900060)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10410 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901180)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10291 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3000, 0x2, 0x2, 0xc4207b3080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209002a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10405 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209010e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10371 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5200, 0x2, 0x2, 0xc4207a5280, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900ca0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10281 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2a00, 0x4, 0x4, 0xc4207c2a80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900160)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10389 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900ee0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10323 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3e00, 0x2, 0x2, 0xc4207b3e80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209006a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10421 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209012e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10422 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901300)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10253 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2400, 0x2, 0x2, 0xc4207b2480, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721de0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10414 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901200)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10175 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207ce300, 0x2, 0x2, 0xc4207ce380, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721420)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10295 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3200, 0x2, 0x2, 0xc4207b3280, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900320)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10259 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2500, 0x2, 0x2, 0xc4207b2580, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721ea0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10396 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900fc0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10347 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4a00, 0x2, 0x2, 0xc4207a4a80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209009a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10271 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2900, 0x2, 0x2, 0xc4207b2980, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900020)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10263 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2700, 0x2, 0x2, 0xc4207b2780, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721f20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10420 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209012c0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10388 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900ec0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10413 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209011e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10303 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3500, 0x2, 0x2, 0xc4207b3580, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900420)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10394 [runnable]:
github.com/DataDog/datadog-trace-agent/sampler.computeSpanHash(0xc42055db80, 0xc, 0xc4208fa180, 0x13, 0xc420c93640, 0x10, 0xfd6a3d8ab6a7ba7, 0x2ea00481fd2eb8b3, 0x14c1073ebf61a4e4, 0xb3010, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/signature.go:49 +0x68
github.com/DataDog/datadog-trace-agent/sampler.ComputeSignatureWithRootAndEnv(0xc4207a5c00, 0x2, 0x2, 0xc4207a5c80, 0x91cdb0, 0x4, 0x0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/signature.go:21 +0x135
github.com/DataDog/datadog-trace-agent/sampler.(*Sampler).Sample(0xc42019d540, 0xc4207a5c00, 0x2, 0x2, 0xc4207a5c80, 0x91cdb0, 0x4, 0xc420e31a00)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/sampler/sampler.go:124 +0x7c
main.(*Sampler).Add(0xc42005b8b0, 0xc4207a5c00, 0x2, 0x2, 0xc4207a5c80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/sampler.go:67 +0xa1
main.(*Agent).Process.func2()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:175 +0x56
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900f80)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10339 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4600, 0x2, 0x2, 0xc4207a4680, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209008a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10179 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207ce500, 0x2, 0x2, 0xc4207ce580, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4207214a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10406 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901100)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10307 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3700, 0x2, 0x2, 0xc4207b3780, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209004a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10325 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3f00, 0x2, 0x2, 0xc4207b3f80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209006e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10235 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207cfc00, 0x2, 0x2, 0xc4207cfc80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721ba0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10341 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4700, 0x2, 0x2, 0xc4207a4780, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209008e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10397 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900fe0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10205 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207cee00, 0x2, 0x2, 0xc4207cee80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4207217e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10289 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2f00, 0x2, 0x2, 0xc4207b2f80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900260)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10379 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5600, 0x2, 0x2, 0xc4207a5680, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900da0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10233 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207cfb00, 0x2, 0x2, 0xc4207cfb80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721b60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10215 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207f4a00, 0x4, 0x4, 0xc4207f4a80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721920)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10309 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3800, 0x2, 0x2, 0xc4207b3880, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209004e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10399 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901020)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10407 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901120)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10415 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901220)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10317 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3b00, 0x2, 0x2, 0xc4207b3b80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209005e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10393 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5c00, 0x2, 0x2, 0xc4207a5c80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900f60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10287 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2c00, 0x4, 0x4, 0xc4207c2c80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900220)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10313 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3900, 0x2, 0x2, 0xc4207b3980, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900560)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10367 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5000, 0x2, 0x2, 0xc4207a5080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900c20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10335 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4400, 0x2, 0x2, 0xc4207a4480, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900820)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10387 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5a00, 0x2, 0x2, 0xc4207a5a80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900ea0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10337 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4500, 0x2, 0x2, 0xc4207a4580, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900860)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10411 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209011a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10267 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2800, 0x2, 0x2, 0xc4207b2880, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721fa0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10283 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2d00, 0x2, 0x2, 0xc4207b2d80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209001a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10245 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2000, 0x2, 0x2, 0xc4207b2080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721ce0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10299 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2e00, 0x4, 0x4, 0xc4207c2e80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209003a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10345 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4900, 0x2, 0x2, 0xc4207a4980, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900960)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 4456 [runnable]:
net.runtime_pollWait(0x7f8edaf20050, 0x72, 0x7)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/netpoll.go:164 +0x59
net.(*pollDesc).wait(0xc420b9a0d8, 0x72, 0xb44f40, 0xb40698)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/fd_poll_runtime.go:75 +0x38
net.(*pollDesc).waitRead(0xc420b9a0d8, 0xc420191000, 0x1000)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/fd_poll_runtime.go:80 +0x34
net.(*netFD).Read(0xc420b9a070, 0xc420191000, 0x1000, 0x1000, 0x0, 0xb44f40, 0xb40698)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/fd_unix.go:250 +0x1b7
net.(*conn).Read(0xc42018c008, 0xc420191000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/net.go:181 +0x70
net/http.(*connReader).Read(0xc4203c61c0, 0xc420191000, 0x1000, 0x1000, 0x0, 0xc420049d48, 0x5946b8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/http/server.go:754 +0x140
bufio.(*Reader).fill(0xc4203bdec0)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/bufio/bufio.go:97 +0x117
bufio.(*Reader).Peek(0xc4203bdec0, 0x4, 0x2ba1f4ca, 0xb7cd20, 0x0, 0x0, 0xc420564b40)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/bufio/bufio.go:129 +0x67
net/http.(*conn).serve(0xc4200b0e60, 0xb48d40, 0xc4203c6180)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/http/server.go:1850 +0x7f1
created by net/http.(*Server).Serve
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/net/http/server.go:2668 +0x2ce

goroutine 10333 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4200, 0x2, 0x2, 0xc4207a4280, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209007e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10373 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5300, 0x2, 0x2, 0xc4207a5380, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900ce0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10199 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207cec00, 0x2, 0x2, 0xc4207cec80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721720)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10319 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3c00, 0x2, 0x2, 0xc4207b3c80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900620)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10349 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4b00, 0x2, 0x2, 0xc4207a4b80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209009e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10285 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2e00, 0x2, 0x2, 0xc4207b2e80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209001e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10402 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901080)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10301 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3400, 0x2, 0x2, 0xc4207b3480, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209003e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10401 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901060)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10391 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5b00, 0x2, 0x2, 0xc4207a5b80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900f20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10395 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900fa0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10383 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a5800, 0x2, 0x2, 0xc4207a5880, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900e20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10261 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2200, 0x4, 0x4, 0xc4207c2280, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721ee0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10117 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207dea00, 0x2, 0x2, 0xc4207dea80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420720ce0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10189 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207f4200, 0x4, 0x4, 0xc4207f4280, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4207215e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10311 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c3000, 0x4, 0x4, 0xc4207c3080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900520)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10403 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209010a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10255 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207f5000, 0x4, 0x4, 0xc4207f5080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721e20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10398 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901000)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10331 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4100, 0x2, 0x2, 0xc4207a4180, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209007a0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10321 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b3d00, 0x2, 0x2, 0xc4207b3d80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900660)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10408 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901140)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10239 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207cfe00, 0x2, 0x2, 0xc4207cfe80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721c20)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10277 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207b2b00, 0x2, 0x2, 0xc4207b2b80, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209000e0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10404 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc4209010c0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10257 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2000, 0x4, 0x4, 0xc4207c2080, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721e60)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10418 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901280)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10357 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c3800, 0x4, 0x4, 0xc4207c3880, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900ae0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10409 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901160)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10416 [runnable]:
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420901240)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:47
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10343 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207a4800, 0x2, 0x2, 0xc4207a4880, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420900920)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

goroutine 10269 [semacquire]:
sync.runtime_SemacquireMutex(0xc42019bacc)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/runtime/sema.go:62 +0x34
sync.(*Mutex).Lock(0xc42019bac8)
	/home/jenkins/.gimme/versions/go1.8.linux.amd64/src/sync/mutex.go:87 +0x9d
main.(*Concentrator).Add(0xc42019baa0, 0xc4207c2600, 0x4, 0x4, 0xc4207c2680, 0x91cdb0, 0x4, 0xb99620, 0x0, 0x0, ...)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/concentrator.go:38 +0x6f
main.(*Agent).Process.func1()
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/agent/agent.go:172 +0x6d
github.com/DataDog/datadog-trace-agent/watchdog.Go.func1(0xc420721fe0)
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:49 +0x43
created by github.com/DataDog/datadog-trace-agent/watchdog.Go
	/home/jenkins/workspace/raclette-prod/src/github.com/DataDog/datadog-trace-agent/watchdog/logonpanic.go:50 +0x3f

[DOCS] Possible document drift on integration instructions

I noticed i've ended up with a configuration that might be related to document drift. I just recently looked at my config and realized there are different instructions.

Here is one of my current configurations

datadog_config:
  tags:
    - env:prod
    - role:worker
  apm_config:
    analyzed_spans:
      grape|grape.endpoint_run: 1
      sparcore|rack.request: 1
      net/http|http.request: 1
      aws|aws.command: 1
  apm_enabled: "true"
  logs_enabled: true

On https://docs.datadoghq.com/tracing/setup/#agent-configuration i see that to enable apm it's

apm_config:
  enabled: true

but I have the apm_enabled: "true" at root level with the strange "true", i remember reading somewhere it was required, but i cant remember what doc I was reading. I also noticed i have analyzed_spans which is completely missing on https://docs.datadoghq.com/tracing/setup/#agent-configuration I found them on https://app.datadoghq.com/apm/docs/trace-search

Slack link in guidelines isn't available to the public

The guidelines mention that we can join your trace-help channel, but it appears that guest accounts are invite-only (and there's no mention of how to become one)

obfuscate: "query not parsed" for a legitimate looking MySQL query

We're getting the agent.parse.error of Query not parsed for the following SQL query, which I think the SQL parser should be able to handle:

/* ADB: /sample-path correlation_id:08a3cb269f3211e793b90e80c6e864fc */
select id,field1,field2,field3 from OTable where evnt = %s 
and OTable.status = %s
and ((OTable.survey = "direct" and OTable.payment in ("scramble", "eggs")) 
    or (OTable.email is not null and OTable.email != "")) 
and OTable.status != 350 order by %s

(I added newlines to the above to make it more readable - the query in question does not have newlines in it)

proposal: have DD_MAX_MEMORY env var for Docker based

#559

No pre-compiled binaries are available for 6.x release line

The installation instructions tell to download the OSX binary from the releases page, but the releases page does not have a pre-compiled binary for OSX for 6.x release line.

obfuscate: MSSQL-style bracketed parameters to AS result in odd behaviour

The sql quantizer is doing this to MSSQL queries:
(note that [Blogs] AS [b] becomes [ Blogs ] b ], so now the left brackets don't match the right brackets)

SELECT [b].[BlogId], [b].[Name]
FROM [Blogs] AS [b]
ORDER BY [b].[Name]

into

SELECT [ b ] . [ BlogId ], [ b ] . [ Name ]
FROM [ Blogs ] b ]
ORDER BY [ b ] . [ Name ]

Square brackets are used to delimit or escape identifiers in Microsoft SQL Server. It's required if a column name is a SQL keyword or has spaces, for example, but some developers use them even when not required. IIRC, it's equivalent to the backtick ` in MySQL or double quotes " in ANSI SQL.

These specific queries were created by Entity Framework, the most popular ORM for .NET.

https://docs.microsoft.com/en-us/sql/relational-databases/databases/database-identifiers?view=sql-server-2017

User should be allowed NOT to listen on legacy port

I was looking for a way to configure that, but noticed port 7777 is hard coded.
I need that port, and right now the only way I can get around it is not running the agent. Please consider making it configurable.

APM Trace agent doesn't use http proxy configuration for reporting

I'm attempting to use APM in an environment that restricts outbound http unless through an http proxy, and from what I can tell this agent is not supporting the http proxy config (or I'm missing the correct place to put it).

I do have at present (proxy_host, proxy_port, proxy_user, proxy_password) set inside /etc/dd-agent/datadog.conf and have restarted the datadog-agent.

I see the following in my logs:

tail -f /var/log/datadog/trace-agent.log
2017-03-16 14:21:50 ERROR (endpoint.go:119) - error when requesting to endpoint https://trace.agent.datadoghq.com/api/v0.1/collector: Post https://trace.agent.datadoghq.com/api/v0.1/collector?api_key=[redacted]: dial tcp 23.23.189.219:443: i/o timeout
2017-03-16 14:21:52 INFO (receiver.go:329) - receiver handled 51 spans, dropped 0 ; handled 51 traces, dropped 0
2017-03-16 14:22:06 ERROR (endpoint.go:119) - error when requesting to endpoint https://trace.agent.datadoghq.com/api/v0.1/collector: Post https://trace.agent.datadoghq.com/api/v0.1/collector?api_key=[redacted]: dial tcp 50.16.188.192:443: i/o timeout

Missing information in trace agent build

Dont we need to do a go get -d ./... before running make build to install trace agent for installing the dependencies in our go path ?
Also the make install needs to be run with the $GOPATH only right?

This is for mac

Error when run in mac osx

./trace-agent-osx -config /opt/datadog-agent/etc/datadog.yaml

2018-03-09 19:33:06 INFO (main.go:142) - using legacy configuration from /opt/datadog-agent/etc/datadog.yaml
2018-03-09 19:33:06 INFO (agent.go:142) - error retrieving dd-agent hostname, falling back to os.Hostname(): exit status 1
2018-03-09 19:33:06 DEBUG (agent.go:315) - No aggregator configuration, using defaults
2018-03-09 19:33:06 ERROR (main.go:46) - you must specify an API Key, either via a configuration file or the DD_API_KEY env var

Remove 'models' package.

As per the guidelines provided by the Go authors, as well as by the community, packages are generally named based on behaviour, and not contents. Grouping many (or all) types and models of an application into the same package and calling it "models" will continuously accumulate dependencies, slow down compilation and complicate builds. For this reason I'd like to propose removing this package and moving each type (model) into their own respective packages. In many cases these will have to be new packages.

Here are some documents outlining package naming guidelines in Go:

Package names from the official blog, section "Bad package names"
Style guidelines for Go packages, section "Organize by responsibility". This one specifically provides the example "models" as a bad name.

I am happy to start working on this by submitting small PRs which will alleviate the size of this folder, unless people have any arguments against.

Question asked in the #apm room

I know this question is not meant to be asked here but I think people that work on this project can answer this question. It was also asked in the #APM datadog public slack room:

thomas91310 [4:07 PM]

hello! Let’s say, I span.SetTag("fruit", "apple") and on another request I span.SetTag("fruit", "orange"). Now let’s say I want to build a custom graph in a dashboard that shows % of requests when the fruit passed was an apple (similarly I also want to graph the % of requests where fruit was an orange)
My understanding is that it’s easy to graph trace.spanName.hits (which include all apple and orange requests) but that you currently can’t graph things like trace.spanName.hits by fruit=apple or fruit=orange?
I know it’s easy to do that using a statsd client but don’t want to miss something straightforward in case I can do that strictly using APM

Thanks!

test issue

cannot decode v0.3 traces payload: read limit reached

I receive such an error:

[ TRACE ] 2018-10-17 22:00:12 ERROR (receiver.go:386) - cannot decode v0.3 traces payload: read limit reached

I guess its related to huge number of spans that are sent within the trace.
If so, where is this limit configurable? Whats the default value?

proposal: allow setting APM env. via environment variable

I'm trying to get APM working on ECS fargate, but I can't get the traces to get tagged with the environment properly. Adding host tags on Fargate doesn't seem to work either.

Is there any way to set the apm_config.env key using an environment variable?

proposal: contrib/google.golang.org/grpc: add streaming grpc interceptor

It seems odd that only the unary interceptor was implemented instead of unary and streaming. Also, the GRPC team is considering only having streaming interceptors (since unary is actually just a special case of streaming). So it might end up being the only one you need anyway.

trace-agent is not using the configured log_level

In my /etc/datadog-agent/datadog.yml I am setting the log_level like this:
log_level: warning

This is correctly working for datadog-agent, but trace-agent is not using it and still outputs INFO level logs, even if reading the config file:

Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (main.go:89) - pid '21161' written to pid file '/opt/datadog-agent/run/trace-agent.pid'
Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (agent.go:225) - Loaded configuration: /etc/datadog-agent/datadog.yaml
Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (trace_writer.go:49) - Trace writer initializing with config: {MaxSpansPerPayload:1000 FlushPeriod:5s Upda
Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (stats_writer.go:42) - Stats writer initializing with config: {MaxEntriesPerPayload:12000 UpdateInfoPeriod
Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (service_writer.go:31) - Service writer initializing with config: {FlushPeriod:5s UpdateInfoPeriod:1m0s Se
Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (main.go:156) - trace-agent running on host tg-staging2.ovh.talegraph.net
Nov 06 22:25:55 tg-staging2 trace-agent[21161]: 2018-11-06 22:25:55 INFO (api.go:140) - listening for traces at http://localhost:8126
Nov 06 22:26:01 tg-staging2 trace-agent[21161]: 2018-11-06 22:26:01 INFO (service_writer.go:76) - flushed service payload to the API, time:483.180167ms, size:77 bytes
Nov 06 22:26:01 tg-staging2 trace-agent[21161]: 2018-11-06 22:26:01 INFO (trace_writer.go:97) - flushed trace payload to the API, time:484.055105ms, size:6557 bytes
Nov 06 22:26:05 tg-staging2 trace-agent[21161]: 2018-11-06 22:26:05 INFO (api.go:324) - [lang:ruby lang_version:2.5.1 interpreter:ruby-x86_64-linux tracer_version:0.16.1] -> trace
Nov 06 22:26:05 tg-staging2 trace-agent[21161]: 2018-11-06 22:26:05 INFO (trace_writer.go:97) - flushed trace payload to the API, time:358.4442ms, size:4855 bytes
Nov 06 22:26:10 tg-staging2 trace-agent[21161]: 2018-11-06 22:26:10 INFO (trace_writer.go:97) - flushed trace payload to the API, time:326.552803ms, size:4736 bytes

Environment

I am using the Chef cookbook to install Datadog on Debian.

# /opt/datadog-agent/embedded/bin/trace-agent --version
Version: 6.6.0
Git hash: 24d4c76
Git branch: HEAD
Build date: 2018-10-25 15:27:32.839833398 +0000 UTC m=+0.002630095
Go Version: 1.10.2

error install on ubuntu 16.04

DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.1 LTS"
NAME="Ubuntu"
VERSION="16.04.1 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.1 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
VERSION_CODENAME=xenial
UBUNTU_CODENAME=xenial

cwd: ~/code/apartment_therapy/atcms (rjspotter/datadog_apm) 
$ bash -c "$(curl -L https://gist.githubusercontent.com/talwai/6ff07d85a480b4b27744bdf1b633111e/raw/install_agent.sh)"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  5804  100  5804    0     0  29011      0 --:--:-- --:--:-- --:--:-- 29165

* Installing APT package sources for Datadog Tracing

Executing: /tmp/tmp.Qp2NRBjH50/gpg.1.sh --recv-keys
--keyserver
hkp://keyserver.ubuntu.com:80
382E94DE
gpg: requesting key 382E94DE from hkp server keyserver.ubuntu.com
gpg: key 382E94DE: "Datadog, Inc <[email protected]>" not changed
gpg: Total number processed: 1
gpg:              unchanged: 1

* Installing the Datadog Trace Agent package

Ign:1 http://apt-trace.datad0g.com.s3.amazonaws.com stable InRelease
Hit:2 http://apt-trace.datad0g.com.s3.amazonaws.com stable Release
Reading package lists...
W: http://apt-trace.datad0g.com.s3.amazonaws.com/dists/stable/Release.gpg: Signature by key FB3E017DBD6C2FDDEFDC27824B4593018387EEAF uses weak digest algorithm (SHA1)
Reading package lists...
Building dependency tree...
Reading state information...
dd-trace-agent is already the newest version (0.99.156).
The following packages were automatically installed and are no longer required:
  java-wrappers libelasticsearch1.7-java libhyperic-sigar-java libjts-java
  liblog4j-extras1.2-java liblucene4.10-java libspatial4j-0.4-java
  linux-image-extra-4.4.0-42-generic linux-signed-image-4.4.0-42-generic
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded.
                                                               1 not fully installed or removed.
                                                                                                After this operation, 0 B of additional disk space will be used.
                                                                                                                                                                Setting up dd-trace-agent (0.99.156) ...
Running dd-trace-agent post-install with arguments: configure  ...
Registering service dd-trace-agent
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
dpkg: error processing package dd-trace-agent (--configure):
 subprocess installed post-installation script returned error exit status 1
Errors were encountered while processing:
 dd-trace-agent
W: --force-yes is deprecated, use one of the options starting with --allow instead.
E: Sub-process /usr/bin/dpkg returned an error code (1)
ERROR
Failed to install the Datadog Trace Agent package, sometimes it may be
due to another APT source failing. See the logs above to
determine the cause.
If the cause is unclear, please contact [email protected].
*****

It looks like you hit an issue when trying to install the Trace Agent.

Please send an email to [email protected]
with the contents of dd-trace-agent-install.log and we'll do our very best to help you
solve your problem.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

	// skip non-alphabetic characters
	for ; i < len(name) && !isAlpha(name[i]); i++ {
	}

	// if there were no alphabetic characters it wasn't valid
	if i == len(name) {
	return "", false
	}