Comments (13)
@r-michal-ah Can you increase the Netty HTTP Client with a longer max idle time?
Azure/azure-sdk-for-java#37773 (comment)
from applicationinsights-java.
@r-michal-ah Do you observe other failures after the first attempt to send?
2024-01-13 00:06:16.621+01:00 WARN c.a.m.o.e.i.p.TelemetryPipeline - In the last 5 minutes, the following operation has failed 1 times (out of 10): Sending telemetry to the ingestion service:
from applicationinsights-java.
@r-michal-ah Can you increase the Netty HTTP Client with a longer max idle time? Azure/azure-sdk-for-java#37773 (comment)
let me try it but one question, i am not explicitly using Netty HTTP Client in the code, is there any property/env variable i should set to change default value?
from applicationinsights-java.
@r-michal-ah Do you observe other failures after the first attempt to send?
2024-01-13 00:06:16.621+01:00 WARN c.a.m.o.e.i.p.TelemetryPipeline - In the last 5 minutes, the following operation has failed 1 times (out of 10): Sending telemetry to the ingestion service:
no but
for some pods i can see log ingestion is resumed (some logs are lost but its fine), but for other i can see this exception
java.util.concurrent.TimeoutException: Channel response timed out after 60000 milliseconds.
at com.azure.core.http.netty.implementation.AzureSdkHandler.responseTimedOut(AzureSdkHandler.java:200)
at com.azure.core.http.netty.implementation.AzureSdkHandler.lambda$startResponseTracking$2(AzureSdkHandler.java:18)
at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98)
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:153)
at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:173)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:166)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:416)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:829)
as last one and then nothing is ingested (pods need to be restarted)
from applicationinsights-java.
hello @heyams do you have any suggestions?
from applicationinsights-java.
hello @heyams do you have any suggestions?
I will reach out to Azure SDK to see if there is an env var they support for this case.
from applicationinsights-java.
@r-michal-ah you can change the idle time use this env var called DEFAULT_CONNECTION_IDLE_TIMEOUT
(source)
However, timeouts are expected and will get retried. It's better to use a shorter timeout and let it retry sooner.
If you concern about the log, you can change the logging level to ERROR. Hope that helps.
from applicationinsights-java.
@r-michal-ah additionally, can you share applicationinsights.log with me? It's worthy of looking at the full log instead of just that single stack trace. The exception above might not be the actual cause of the failure. Thanks.
from applicationinsights-java.
@r-michal-ah additionally, can you share applicationinsights.log with me? It's worthy of looking at the full log instead of just that single stack trace. The exception above might not be the actual cause of the failure. Thanks.
of course @heyams:
{
"role": {
"name": "service-name"
},
"sampling": {
"percentage": 100
},
"preview": {
"processors": [
{
"type": "metric-filter",
"exclude": {
"matchType": "regexp",
"metricNames": [
".*"
]
}
}
],
"sampling": {
"overrides": [
{
"telemetryType": "dependency",
"percentage": 0
},
{
"telemetryType": "request",
"percentage": 30
}
]
}
}
}
from applicationinsights-java.
@r-michal-ah this is applicationinsights.json. I meant the applicationinsights.log.
from applicationinsights-java.
This issue has been automatically marked as stale because it has been marked as requiring author feedback but has not had any activity for 7 days. It will be closed if no further activity occurs within 7 days of this comment.
from applicationinsights-java.
This issue has been automatically marked as stale because it has been marked as requiring author feedback but has not had any activity for 7 days. It will be closed if no further activity occurs within 7 days of this comment.
from applicationinsights-java.
This issue has been automatically marked as stale because it has been marked as requiring author feedback but has not had any activity for 7 days. It will be closed if no further activity occurs within 7 days of this comment.
from applicationinsights-java.
Related Issues (20)
- Classic SDK TelemetryClient not capturing any data HOT 4
- Add ability to disable reactor instrumentation HOT 3
- Allow connectionString to be overridden multiple times without restarting the AppInsights Agent HOT 5
- 3.4.19 + Ktor OpenTelemetry - ClassCastException HOT 5
- Possibly incorrect mapping of Trace ID and Span ID HOT 8
- Unable to suppress dependencies using java agent HOT 12
- Java log4j2: Log messages go missing sporadically, especially in multi-threaded scenarios HOT 1
- how to turn off customMetrics, performanceCounters and metrics HOT 8
- Help to ignore InProc sampling dependencies HOT 5
- Problem to configure sampling override HOT 6
- Auto-instrumentation support for Pekko 1.0.0 in Java agent HOT 2
- Q: regarding agent not being able to attach. HOT 5
- TRACE log level causes an application to fail HOT 13
- [Question] Why relocate logback packages and configuration files HOT 2
- How to add a Prefix to the names of the default captured metrics HOT 4
- Azure function app integration to Dynatrace in Linux with Open telemetry HOT 2
- HTTP dependencies are not reported in latest Spring Boot 3.2. HOT 2
- Download URL format changed in 3.5.0 HOT 3
- Operation name/ Operation id missing for manual created threads HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from applicationinsights-java.