emcecs / ecs-samples Goto Github PK
View Code? Open in Web Editor NEWCode samples for working with ECS
License: Apache License 2.0
Code samples for working with ECS
License: Apache License 2.0
Below issues are getting when used multipart upload feature testcase
largeFileUploader.doMultipartUpload();
SEVERE: Not able to connect S3 javax.xml.bind.UnmarshalException: unexpected element (uri:"", local:"InitiateMultipartUploadResult"). Expected elements are <{http://s3.amazonaws.com/doc/2006-03-01/}InitiateMultipartUploadResult>
Exception in thread "main" com.dell.ecs.cloud.exception.ApiException
Hello,
We see examples of few things we can do with Boto on ECS. Do you guys have any examples on how one can modify the ACLs for a bucket
or an object
?
Any python sample code
on ACLs would be greatly appreciated.
Thank you
Hi,
We are trying to access file stored on ECS in Python using Boto3. It is very slow and taking more time then normal file read. Is Boto3 supported by ECS? We are using Python 3.6.
Also What is the fastest way of accessing files from ECS in Python? We want to read file size of 3 to 5 gb into panda data frame.
Thanks a lot in advance
Parag
Getting below exception while uploading large file
com.sun.jersey.api.client.ClientHandlerException: java.net.UnknownHostException:
at com.sun.jersey.client.apache4.ApacheHttpClient4Handler.handle(ApacheHttpClient4Handler.java:187)
at com.emc.object.s3.jersey.ErrorFilter.handle(ErrorFilter.java:51)
at com.emc.object.s3.jersey.RetryFilter.handle(RetryFilter.java:65)
at com.emc.object.s3.jersey.AuthorizationFilter.handle(AuthorizationFilter.java:72)
at com.emc.object.s3.jersey.BucketFilter.handle(BucketFilter.java:80)
at com.emc.object.s3.jersey.NamespaceFilter.handle(NamespaceFilter.java:78)
at com.sun.jersey.api.client.Client.handle(Client.java:652)
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634)
at com.emc.object.AbstractJerseyClient.executeRequest(AbstractJerseyClient.java:98)
at com.emc.object.s3.jersey.S3JerseyClient.executeRequest(S3JerseyClient.java:824)
at com.emc.object.s3.jersey.S3JerseyClient.initiateMultipartUpload(S3JerseyClient.java:718)
at com.emc.object.s3.LargeFileUploader.initMpu(LargeFileUploader.java:197)
at com.emc.object.s3.LargeFileUploader.doMultipartUpload(LargeFileUploader.java:389)
at com.emc.object.s3.LargeFileUploaderTest.testLargeFileUploader(LargeFileUploaderTest.java:118)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.UnknownHostException:
at java.net.InetAddress.getAllByName0(InetAddress.java:1280)
at java.net.InetAddress.getAllByName(InetAddress.java:1192)
at java.net.InetAddress.getAllByName(InetAddress.java:1126)
at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:263)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:162)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:835)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:118)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at com.sun.jersey.client.apache4.ApacheHttpClient4Handler.handle(ApacheHttpClient4Handler.java:173)
... 34 more
Hi, does ECS also support creating temporary security credentials with AWS STS and Assume Role?
What i want to do is address the storage from a web app running in the browser on the client side. But i don't want to share the longterm credentials for that. Instead i want to use AWS STS to create temporary credentials on server side and pass those to the client. And since it is not so easy to do a multipart upload using presigned urls i think using STS is the best way. Or do you reccomend another way to do so without sharing longterm credentials?
Loading the project into IntelliJ 2017.2 fails with the error:
Error: Could not determine the class-path for interface com.android.builder.model.NativeAndroidProject.
This isn't even an Android project. Appears to be a conflict with an old version of Gradle.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.