Comments (11)
Hi @nredhefferprovidertrust #4893 is created to add the same config for BlockingInputStreamAsyncRequestBody
from aws-sdk-java-v2.
Hi @ramakrishna-g1 apologies for the silence.
We identified an issue with multipart uploads using BlockingInputStream where the client enters a bad state and doesn't recover from it. We are working on a fix.
We'll also consider creating a timeout configuration so this default value can be customized.
Will keep this updated with progress of the fix.
from aws-sdk-java-v2.
Would this apply when using S3AsyncClient
? ex. S3AsyncClient.crtBuilder().build()
I am running into a similar issue
Also any eta on a fix? Thx
from aws-sdk-java-v2.
Running into this issue with BlockingInputStreamAsyncRequestBody instead of the Output body.
Default S3Async setup and creds.
BlockingInputStreamAsyncRequestBody body =
AsyncRequestBody.forBlockingInputStream(null); // 'null' indicates a stream will be provided later.
CompletableFuture<PutObjectResponse> responseFuture =
_s3AsyncClient.putObject(r -> r.bucket(bucketName).key(key), body);
body.writeInputStream(inputStream); <- fails here
return responseFuture.get();
from aws-sdk-java-v2.
Hey all, we've exposed an option to allow users to configure subscribeTimeout
via #5000, could you try with it?
BlockingOutputStreamAsyncRequestBody.builder()
.contentLength(1024L)
.subscribeTimeout(Duration.ofSeconds(30))
.build();
from aws-sdk-java-v2.
In which version fix is available?
from aws-sdk-java-v2.
In which version fix is available?
2.25.8
from aws-sdk-java-v2.
This issue describes the timeout problem in the BlockingInputStreamAsyncRequestBody, but the change made by #5000 adds the configuration option to BlockingOutputStreamAsyncRequestBody. Is a similar configuration option going to be exposed for the BlockingInputStreamAsyncRequestBody as well?
from aws-sdk-java-v2.
What is the best fail-safe value for .subscribeTimeout() in the PROD environment. where we have uploading thousands of messages per minute.
from aws-sdk-java-v2.
Hi @zoewangg, I see that you have provided an option to extend the timeout which is good. But it still doesn't solve the original issue of the client going into an unhealthy state.
So is there going to be a fix for that?
from aws-sdk-java-v2.
Yes, we have a task in our backlog to fix the issue. No ETA to share at the moment.
from aws-sdk-java-v2.
Related Issues (20)
- Version 2.25.26 Could not parse POM HOT 1
- S3 Transfer Manager created using S3Aysnc Client with CRT Builder holding significant memory even after downloads are completed
- Setting metadata and retention with UploadDirectoryRequest
- Don't download 200MB of JS for a JavaDoc search feature that most people don't use HOT 1
- Unshaded dependencies in AWS SDK HOT 9
- S3 Presign Head method HOT 2
- S3 CRT Client GetObject Request with Invalid Range crashes JVM with SIGSEGV HOT 1
- ApiName does not implement equals HOT 2
- assumeRoleWithWebIdentity doesn't work from java API but does work from the cli interface HOT 2
- Allow RetryStrategy to use information from RetryPolicyContext in BackoffStrategy HOT 3
- Unclosed pipe/a_inode file descriptors when using AWS SDK V2 HOT 2
- UrlConnectionHttpClient returns null messages when S3.putObject returns 403 in some cases HOT 1
- S3 Clients are leaving behind open PIPE file descriptors HOT 3
- Failure to log with SLF4J HOT 4
- @DynamoDbVersionAttribute Annotation Does not work if used in conjunction with @DynamoDbSortKey for subsequent PUT operations.
- Unable to execute HTTP request: Unrecognized SSL message, plaintext connection HOT 6
- How to pass AWSSessionCredentialsProvider in aws-sdk-java-v2 HOT 1
- [put-object] when set readlimit, error raised: java.io.IOException: No position has been marked HOT 2
- `S3TransferManager` / `S3AsyncClient` does not seem to use `SdkAdvancedAsyncClientOption.FUTURE_COMPLETION_EXECUTOR`'s `Executor`. HOT 1
- S3TransferManager - Support download / upload resume in the event of host machine power loss HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aws-sdk-java-v2.