Comments (4)
As there is no "delimiter" parameter in the query string, I do not see what's wrong in the answer here. Is seems expected that we'd list SM/*
since no delimiter was specified.
Did we misunderstand something ?
Anyhow, Michael found a sample request on the amazon doc that does not seem to work with our implementation. He'll be fixing that first.
from arsenal.
Just to be sure, I'll take an example straight from the documentation:
For this example, we assume that we have the following keys in our bucket:
sample.jpg
photos/2006/January/sample.jpg
photos/2006/February/sample2.jpg
photos/2006/February/sample3.jpg
photos/2006/February/sample4.jpg
The following GET request specifies the delimiter
parameter with the value /
, and the prefix
parameter with the value photos/2006/
.
GET /?prefix=photos/2006/&delimiter=/ HTTP/1.1
Host: example-bucket.s3.amazonaws.com
Date: Wed, 01 Mar 2006 12:00:00 GMT
Authorization: authorization string
In response, Amazon S3 returns only the keys that start with the specified prefix. Further, it uses the delimiter character to group keys that contain the same substring until the first occurrence of the delimiter character after the specified prefix. For each such key group Amazon S3 returns one <CommonPrefixes>
element in the response. The keys grouped under this CommonPrefixes element are not returned elsewhere in the response. The value returned in the CommonPrefixes element is a substring from the beginning of the key to the first occurrence of the specified delimiter after the prefix. Which means we should get that:
<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
<Name>example-bucket</Name>
<Prefix>photos/2006/</Prefix>
<Marker></Marker>
<MaxKeys>1000</MaxKeys>
<Delimiter>/</Delimiter>
<IsTruncated>false</IsTruncated>
<CommonPrefixes>
<Prefix>photos/2006/February/</Prefix>
</CommonPrefixes>
<CommonPrefixes>
<Prefix>photos/2006/January/</Prefix>
</CommonPrefixes>
</ListBucketResult>
It is not the case at the moment (at least when using the memory backend).
from arsenal.
Note that we observed that the S3 memory backend does not seem to make use
of the listing algorithms, meaning an increased risk of missing mistakes,
and creating out-of-sync situations between S3 and Arsenal.
On Tue, Aug 30, 2016 at 3:54 PM, Michael Zapata [email protected]
wrote:
Just to be sure, I'll take an example straight from the documentation:
For this example, we assume that we have the following keys in our bucket:
- sample.jpg
- photos/2006/January/sample.jpg
- photos/2006/February/sample2.jpg
- photos/2006/February/sample3.jpg
- photos/2006/February/sample4.jpg
The following GET request specifies the delimiter parameter with the
value /, and the prefix parameter with the value photos/2006/.GET /?prefix=photos/2006/&delimiter=/ HTTP/1.1Host: example-bucket.s3.amazonaws.comDate: Wed, 01 Mar 2006 12:00:00 GMTAuthorization: authorization string
In response, Amazon S3 returns only the keys that start with the specified
example-bucket photos/2006/ 1000 / false photos/2006/February/ photos/2006/January/
prefix. Further, it uses the delimiter character to group keys that
contain the same substring until the first occurrence of the delimiter
character after the specified prefix. For each such key group Amazon S3
returns one element in the response. The keys grouped
under this CommonPrefixes element are not returned elsewhere in the
response. The value returned in the CommonPrefixes element is a
substring from the beginning of the key to the first occurrence of the
specified delimiter after the prefix. Which means we should get that:It is not the case at the moment.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
#147 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANpZZ9lwR2ZajGQ_Dxdr3wBG7xfaxuqpks5qlDYqgaJpZM4JwAzC
.
David Pineau
Scality R&D Engineer
from arsenal.
There is a preliminary PR taking care of one bug, could we have more context about the issue at hand if this one doesn't handle that issue?
from arsenal.
Related Issues (20)
- multiple high and critical issues in `yarn audit` HOT 1
- auth v4 canonical request
- invalid Authorization header: errors incompatible with AWS
- empty/invalid/unredable/none Date header: errors incompatible with AWS
- invalid amz-date header: errors incompatible with AWS
- incorrect authorization header: errors incompatible with AWS
- authv4 sort query params HOT 1
- COMPAT: Increase Signature V2 Expires param
- COMPAT: return AccessDenied if Date before epochTime (01/01/1970) HOT 4
- callApiMethod in routes is not defined
- Error messages should not have periods
- Policy evaluation, action should be case insensitive
- Tests for #240 HOT 1
- delimiter.js maxKeys==0 param issue HOT 4
- Logs are broken HOT 6
- Exception occurs when using v4 authentication with certain query parameters
- Unbalanced log
- non monotonic clock used in version ID generation
- Action required: Greenkeeper could not be activated 🚨
- Invalid Greenkeeper configuration file
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arsenal.