Comments (6)
torte
commented on August 16, 2024
1
@pfifer Thank you for the reply.
It does not look like that it failed to download the jars. They slighly (very slightly) differ in size though, which would explain the diff as well to a degree.
Non-working jars
FIle sizes
-rw-rw-r-- 1 torsten torsten 352256 Oct 22 10:35 amazon-kinesis-client-1.9.0.jar
-rw-rw-r-- 1 torsten torsten 212992 Oct 22 10:35 aws-java-sdk-cloudwatch-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 851968 Oct 22 10:35 aws-java-sdk-core-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 1368064 Oct 22 10:35 aws-java-sdk-dynamodb-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 1073152 Oct 22 10:35 aws-java-sdk-kinesis-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 401408 Oct 22 10:35 aws-java-sdk-kms-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 835584 Oct 22 10:35 aws-java-sdk-s3-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 262144 Oct 22 10:35 commons-codec-1.9.jar
-rw-rw-r-- 1 torsten torsten 278528 Oct 22 10:35 commons-lang-2.6.jar
-rw-rw-r-- 1 torsten torsten 57344 Oct 22 10:35 commons-logging-1.1.3.jar
-rw-rw-r-- 1 torsten torsten 2252800 Oct 22 10:35 guava-18.0.jar
-rw-rw-r-- 1 torsten torsten 729088 Oct 22 10:35 httpclient-4.5.2.jar
-rw-rw-r-- 1 torsten torsten 319488 Oct 22 10:35 httpcore-4.4.4.jar
-rw-rw-r-- 1 torsten torsten 0 Oct 22 10:35 __init__.py
-rw-rw-r-- 1 torsten torsten 557056 Oct 22 10:35 ion-java-1.0.2.jar
-rw-rw-r-- 1 torsten torsten 40960 Oct 22 10:35 jackson-annotations-2.6.0.jar
-rw-rw-r-- 1 torsten torsten 253952 Oct 22 10:35 jackson-core-2.6.7.jar
-rw-rw-r-- 1 torsten torsten 1163264 Oct 22 10:35 jackson-databind-2.6.7.1.jar
-rw-rw-r-- 1 torsten torsten 40960 Oct 22 10:35 jackson-dataformat-cbor-2.6.7.jar
-rw-rw-r-- 1 torsten torsten 16384 Oct 22 10:35 jmespath-java-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 614400 Oct 22 10:35 joda-time-2.8.1.jar
-rw-rw-r-- 1 torsten torsten 589824 Oct 22 10:35 protobuf-java-2.6.1.jar
SHA 1 checksums
b12c824fb0a40bdb1d63cf322887a06c6b9bbf02 amazon-kinesis-client-1.9.0.jar
53c47dce1b262b6d34cbb0512f32bbde95b17b86 aws-java-sdk-cloudwatch-1.11.272.jar
9e6124d5e5a3ca8b89e569dc06148c980023da34 aws-java-sdk-core-1.11.272.jar
2c1e9e083861c6ade861b2b75514a63bbdf3c459 aws-java-sdk-dynamodb-1.11.272.jar
52839de0f266aa5ee6e543ab161db4d7b8d3a8a0 aws-java-sdk-kinesis-1.11.272.jar
636541eb4f90e1c34665c9f191ae16c56c52272a aws-java-sdk-kms-1.11.272.jar
d398d3484570ae440e16c186d75c2447a60f0ba8 aws-java-sdk-s3-1.11.272.jar
7a6b0290a6663fe90964bfdd8b8951d9b47b8c73 commons-codec-1.9.jar
502ac58c5e9bb223d56780dabf097773c1a47b48 commons-lang-2.6.jar
1f1c20d654d4c4ce6f6c53cb906f598e0917aad3 commons-logging-1.1.3.jar
42eb5e3972d606e264ab3743f14ce0964efa2931 guava-18.0.jar
8657355efa3fa21c3ec583e47238e2ebf61fd5ec httpclient-4.5.2.jar
ee1d7ee8c2d0bda94252f11fc0420a45484b7485 httpcore-4.4.4.jar
570c8cb16d9213fea9a1a5630ae896cee53e8826 ion-java-1.0.2.jar
b0004446f5a2606e8e274ea1a6e68b3b48a6d89d jackson-annotations-2.6.0.jar
a2b777e50b4d612afcc2e1bc641377b4918fbe84 jackson-core-2.6.7.jar
cec81ce3d9125f7cf4bedb848a6aebfe6b5eecf8 jackson-databind-2.6.7.1.jar
a1b5335add909be4a0c0e5c2044ba10b4078a9b9 jackson-dataformat-cbor-2.6.7.jar
63eb76f62751d037dc9ba8cbda5628061be054dd jmespath-java-1.11.272.jar
e7e4bbff3e8a206afeb4c3b804d4e90b716947b2 joda-time-2.8.1.jar
5f1f7c73773d10f2a74de9a845cf311a708091ef protobuf-java-2.6.1.jar
Working jars
File sizes
-rw-rw-r-- 1 torsten torsten 355784 Oct 22 10:29 amazon-kinesis-client-1.9.0.jar
-rw-rw-r-- 1 torsten torsten 214427 Oct 22 10:29 aws-java-sdk-cloudwatch-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 859171 Oct 22 10:29 aws-java-sdk-core-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 1376513 Oct 22 10:29 aws-java-sdk-dynamodb-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 1080377 Oct 22 10:29 aws-java-sdk-kinesis-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 404149 Oct 22 10:29 aws-java-sdk-kms-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 837121 Oct 22 10:29 aws-java-sdk-s3-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 263965 Oct 22 10:29 commons-codec-1.9.jar
-rw-rw-r-- 1 torsten torsten 284220 Oct 22 10:29 commons-lang-2.6.jar
-rw-rw-r-- 1 torsten torsten 62050 Oct 22 10:29 commons-logging-1.1.3.jar
-rw-rw-r-- 1 torsten torsten 2256213 Oct 22 10:29 guava-18.0.jar
-rw-rw-r-- 1 torsten torsten 736658 Oct 22 10:29 httpclient-4.5.2.jar
-rw-rw-r-- 1 torsten torsten 326724 Oct 22 10:29 httpcore-4.4.4.jar
-rw-rw-r-- 1 torsten torsten 0 Oct 22 10:29 __init__.py
-rw-rw-r-- 1 torsten torsten 565410 Oct 22 10:29 ion-java-1.0.2.jar
-rw-rw-r-- 1 torsten torsten 46968 Oct 22 10:29 jackson-annotations-2.6.0.jar
-rw-rw-r-- 1 torsten torsten 258919 Oct 22 10:29 jackson-core-2.6.7.jar
-rw-rw-r-- 1 torsten torsten 1165323 Oct 22 10:29 jackson-databind-2.6.7.1.jar
-rw-rw-r-- 1 torsten torsten 48468 Oct 22 10:29 jackson-dataformat-cbor-2.6.7.jar
-rw-rw-r-- 1 torsten torsten 26880 Oct 22 10:29 jmespath-java-1.11.272.jar
-rw-rw-r-- 1 torsten torsten 621931 Oct 22 10:29 joda-time-2.8.1.jar
-rw-rw-r-- 1 torsten torsten 596642 Oct 22 10:29 protobuf-java-2.6.1.jar
SHA 1 checksums
3fb2c3020fa205a0a813b3d48120c6630a1a08b9 amazon-kinesis-client-1.9.0.jar
307356a6f507062872f65865029b8dc2e12b3ec5 aws-java-sdk-cloudwatch-1.11.272.jar
3a769581c8f19a3d4a0a4ee1a150fc9c4c036668 aws-java-sdk-core-1.11.272.jar
69a7928269861039598e3dd52b69088f7ba2629e aws-java-sdk-dynamodb-1.11.272.jar
61ffd3b4144f89701526907e79cf91e9103ed574 aws-java-sdk-kinesis-1.11.272.jar
ca8a42a9a3948a425588aa976d8e123e51c3ab63 aws-java-sdk-kms-1.11.272.jar
53238778bc5ecf92f8205aafb7903f5e7dcc1205 aws-java-sdk-s3-1.11.272.jar
9ce04e34240f674bc72680f8b843b1457383161a commons-codec-1.9.jar
0ce1edb914c94ebc388f086c6827e8bdeec71ac2 commons-lang-2.6.jar
f6f66e966c70a83ffbdb6f17a0919eaf7c8aca7f commons-logging-1.1.3.jar
cce0823396aa693798f8882e64213b1772032b09 guava-18.0.jar
733db77aa8d9b2d68015189df76ab06304406e50 httpclient-4.5.2.jar
b31526a230871fbe285fbcbe2813f9c0839ae9b0 httpcore-4.4.4.jar
ee9dacea7726e495f8352b81c12c23834ffbc564 ion-java-1.0.2.jar
a0990e2e812ac6639b6ce955c91b13228500476e jackson-annotations-2.6.0.jar
81838e08d5e10e33cdee7299f9682d836b78c63e jackson-core-2.6.7.jar
306775aeb5164835a1dcbdf3f945587045cfb3b5 jackson-databind-2.6.7.1.jar
ba9e74b11135b18248e960df657a2b86ae77a079 jackson-dataformat-cbor-2.6.7.jar
ae8b490ff2f8c4cecb9a098a6252cd6f7162a4ce jmespath-java-1.11.272.jar
f5bfc718c95a7b1d3c371bb02a188a4df18361a9 joda-time-2.8.1.jar
d9521f2aecb909835746b7a5facf612af5e890e8 protobuf-java-2.6.1.jar
Hope that is what you mean by hash. If not please let me know how I should retrieve the hash of the jar files.
Additionally we went through that process on multiple machines and have the same issues. Could it be that the jars were recompiled/rereleased somehow (e.g. with different Java version, etc.)?
from amazon-kinesis-client-python.
torte
commented on August 16, 2024
1
@sayboras In my case we are still on KCL 1.9, so I am not sure there is the fix in the latest KCL and relating bindings here. What we ended up doing is using the old JARs and copying them over during library installation (pretty much overwriting what the python kcl client is downloading). Unfortunately there was no comment on this issue anymore, so no idea if somebody looked into it again.
from amazon-kinesis-client-python.
torte
commented on August 16, 2024
Small update on the issue:
I have an instance running with the same application which was deployed 7 days ago. This instance is still working. After copying the jars from that instance and replacing them on my local development machine I was able to run the KCL worker again. Seems like something has changed in the jar files, even the versions are exactly the same. When running a diff on them they all differ.
from amazon-kinesis-client-python.
pfifer
commented on August 16, 2024
It's possible the download of the jars failed. If you see it again can you check the size of the jars, and if possible get a hash of them.
If it did fail to download the jars, we can investigate adding verification of the jars in the future.
from amazon-kinesis-client-python.
sayboras
commented on August 16, 2024
I am facing the same issue, any update ?
from amazon-kinesis-client-python.
sayboras
commented on August 16, 2024
I also think so, thanks for your approach. I followed the same and it's working fine @torte 💯
from amazon-kinesis-client-python.
Related Issues (20)
- Is cross account/cross region possible
- How to get metadata from Amazon Kinesis Video Streams?
- Need new release > 2.0.6 to solve vulnerabilities in dependencies HOT 6
- Kinesis Python going to sleep HOT 1
- Using Python KCL library for mutli-stream processing HOT 1
- Support STSAssumeRoleWithWebIdentitySessionCredentialsProvider? HOT 1
- MultiLang Daemon for KCL 2.0 for python - how to increase the SDK timeouts? HOT 1
- AWSCredentialsProvider issue when using named profile
- The security token included in the request is invalid HOT 1
- No such file or directory: 'pom.xml' Error when installing 2.1.0 HOT 2
- Is calling checkpoint() with no args on shutdown correct behaviour?
- Make Maven repository configurable in download_jars HOT 1
- CreateProcess error=193, %1 is not a valid Win32 application
- CheckpointInput has no attribute action HOT 1
- Is it possible to run applications utilizing amazon_kclpy in debug mode?
- Can cloudwatch metrics be disabled?
- Upgrade Java SDK minor version to allow use of EKS Pod Identities
- NoSuchMethodError on DynamoDB integration with 2.1.4 HOT 3
- Don't depend on argparse from pip for python >= 3.2 HOT 1
- Jars no longer downloading on install HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from amazon-kinesis-client-python.