Comments (8)
I think there will be some resistance to this. You are asking that if the OVA is uploaded, EKS-A should just assume it the correct OS and k8s type? I'm not sure how it can make that assumption.
An image upload command might be handy though that creates the tags.
from eks-anywhere.
Sorry if I didn't manage to be clear enough. I'm not talking about the OVA, I'm talking about the tags and tag categories themselves. On the vSphere side, these are independent objects that are created by themselves and then associated with e.g. templates like in this case. The problem at hand is that eksctl anywhere goes into this with the assumption that the tags (and categories) don't already exist. If they do, you get something like:
Connected to server
✅ Authenticated to vSphere
✅ Datacenter validated
✅ Network validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
Creating template. This might take a while.
❌ Validation failed {"validation": "vsphere Provider setup is valid", "error": "failed creating category for tags: govc returned error when creating category eksdRelease: govc: 400 Bad Request: {"type":"com.vmware.vapi.std.errors.already_exists","value":{"error_type":"ALREADY_EXISTS","messages":[]}}\n", "remediation": ""}
Error: failed to create cluster: validations failed
And then the whole process exits out. The template itself has been imported, but it has no tags. If you run the command again, the process isn't idempotent; the next run will detect that the template is there but will fail the validation of the template since it doesn't have any tags:
✅ Connected to server
✅ Authenticated to vSphere
✅ Datacenter validated
✅ Network validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
❌ Validation failed {"validation": "vsphere Provider setup is valid", "error": "template /Homelab/vm/Templates/bottlerocket-v1.21.2-kubernetes-1-21-eks-4-amd64-a440064 is missing tag os:bottlerocket", "remediation": ""}
Error: failed to create cluster: validations failed
or
✅ Connected to server
✅ Authenticated to vSphere
✅ Datacenter validated
✅ Network validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
✅ Datastore validated
✅ Folder validated
✅ Resource pool validated
❌ Validation failed {"validation": "vsphere Provider setup is valid", "error": "template /Homelab/vm/Templates/bottlerocket-v1.21.2-kubernetes-1-21-eks-4-amd64-a440064 is missing tag eksdRelease:kubernetes-1-21-eks-4", "remediation": ""}
Error: failed to create cluster: validations failed
The only way around this seems to be that once the first template creation has failed, you go to vCenter and manually assign the two (existing) tags, and then run the create cluster again.
from eks-anywhere.
This is actually a valid issue. Thanks for reporting this. We are looking to making govc calls more robust, and ease the user experience.
from eks-anywhere.
Govc calls that eks-a makes should be more transactional, at least in sectioning them into waypoints during the auto-import/tagging process will help with users re-running if any step were to fail. For example this this case, auto-import process failed while trying to create tags, we should either rollback by deleting the template that was imported, or tag the right template referring to the manifest instead of validation failing on missing tag on subsequent runs.
from eks-anywhere.
This should be resolved when #344 merges and available shortly in the next release.
from eks-anywhere.
Ill leave this one open to represent adding a flag for power users to skip certain "preflights", similar to kubeadm.
from eks-anywhere.
❌ Validation failed {"validation": "vsphere Provider setup is valid", "error": "failed importing template into library: error importing template: govc: The import of library item ca7883df-361a-490a-bdd5-5c72b3c3ebe4 has failed. Reason: Error transferring file bottlerocket-v1.21.2-eks-d-1-21-6-eks-a-4-amd64.ova to ds:///vmfs/volumes/618a3174-5914274c-d16f-ac1f6b1048b8//contentlib-f8ba9922-cec0-402d-95fe-192510114fb7/ca7883df-361a-490a-bdd5-5c72b3c3ebe4/bottlerocket-v1.21.2-eks-d-1-21-6-eks-a-4-amd64_fbb35db4-9090-4bdc-b786-6a000830c64d.ova?serverId=9133c167-f659-49bb-beca-35bcf5c160ed. Reason: Error during transfer of ds:///vmfs/volumes/618a3174-5914274c-d16f-ac1f6b1048b8//contentlib-f8ba9922-cec0-402d-95fe-192510114fb7/ca7883df-361a-490a-bdd5-5c72b3c3ebe4/bottlerocket-v1.21.2-eks-d-1-21-6-eks-a-4-amd64_fbb35db4-9090-4bdc-b786-6a000830c64d.ova?serverId=9133c167-f659-49bb-beca-35bcf5c160ed: IO error during transfer of ds:/vmfs/volumes/618a3174-5914274c-d16f-ac1f6b1048b8/contentlib-f8ba9922-cec0-402d-95fe-192510114fb7/ca7883df-361a-490a-bdd5-5c72b3c3ebe4/bottlerocket-vmware-k8s-1.21-x86_64-1.3.0-395b459c-data_fbb35db4-9090-4bdc-b786-6a000830c64d.vmdk: Pipe closed.\n", "remediation": ""}
This error didn't pass until I manually created a VM folder named Templates
❯ eksctl anywhere version
v0.6.0
vSphere version 7.0.3
from eks-anywhere.
There has been no activity on this issue for 60 days. Labeling as stale and closing in 7 days if no further activity.
from eks-anywhere.
Related Issues (20)
- cluster create fails with WSL and Docker Desktop. Fails after docker rm command. HOT 7
- unable to add partition in tinkerbell action HOT 1
- Add instructions on performing node rollouts when trying to do kernel updates
- Investigate why cluster autoscaler is not working for v0.18.4 HOT 1
- Fix panic when there is a datacenterRef mismatch
- Allow to use hostname in TinkerbellTemplateConfig templating HOT 1
- fail to scale EKS anywhere cluster for bare metal HOT 2
- Backslashes in Vsphere passwords are interpreted as escape characters in generated YAML
- vSphere Bottlerocket EKSA unable to pass CIS Benchmark at 4.2.13 - Ensure that a limit is set on pod PIDs
- Controller panic when SSH key not specified
- reboot doesn't honor disk encryption setting in earlier tinkerbell action during EKS anywhere cluster creation for bare metal HOT 2
- support podman instead of docker
- IPv6-only cluster HOT 1
- Make Kubelet Configuration customizable
- Handle Baremetal registrymirror upgrade validation
- EKSA Baremetal tinkerbell support custom actions in TinkerbellTemplateConfig HOT 1
- Inject IAM Roles Anywhere credentials into pod running on EKSA Cluster
- Adding or removing external etcd during an upgrade.
- add an option to download the latest kubernetes version only for artifacts and images
- Bottlerocket bare metal images for EKS Anywhere
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from eks-anywhere.