Comments (3)
The problem here is due to the fact that we try to write a test file at the root of the bucket to validate the credentials when we start logstash.
Bad credentials are really the major problem we encounter when we debug stuff with users, I think we could allow people to disable the check when they have special permission on their bucket.
from logstash-output-s3.
For others: You can add the resource "arn:aws:s3:::{bucket_name}/logstash-programmatic-access-test-object-*"
to your policy as this is the path that it tries to write to, rather than granting full bucket access.
from logstash-output-s3.
@ph I think all it would take to solve this issue is to write the test file to the prefix
specified in the config rather than the root of the bucket.
Would you merge a PR that would do this?
from logstash-output-s3.
Related Issues (20)
- Logstash-client failed uploading to S3 HOT 1
- During initializing : syntax error, unexpected tLABEL HOT 1
- S3 Storage Tiers Missing
- Please update to AWS SDK v3 HOT 4
- Add trusted CA cert setting
- Too many open files in syste HOT 1
- Impact of LetsEncrypt certificate expiry HOT 5
- Logstash sometimes ignore the Prefix and creates UUID folders
- After the file is uploaded to s3, the content is wrong, is it an encoding problem? HOT 2
- [Docs] Document workaround when using private link endpoints with us-east-1
- Filename option HOT 2
- Allow the use of the Intelligent-Tiering storage class
- Seems GzipUtil.compress output a broken gzip file sometimes
- May I know in which version of Logstash was the #249 issue fixed? HOT 1
- Is there a way to count the number of events packaged into an s3 object?
- Add zstd support
- validate_credentials_on_root_bucket is ignored
- Gzip compression not working HOT 1
- Plugin S3 output- (EMFILE) Too many open files
- Logstash S3 Output plugin requires both access_key_id and secret_access_key (if both not provided throws errors) HOT 11
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from logstash-output-s3.