Comments (4)
Since Karpenter is metrics based, the scaling behavior is all about the metric. The easiest way to debug is to observe the metric is to go look at prometheus and search karpenter_
and your metric should show up.
There's also a 5 minute scale down delay window, which should prevent the "flapping" behavior you're talking about.
With respect to "spreading", Karpenter isn't a scheduler, so it has no control over whether or not the pods get scheduled to the same node. All it's doing is looking at how many resources are requested by pods that were assigned to the node (by the scheduler) and then scaling up once it passes a threshhold.
Can you share your configs?
from karpenter-provider-aws.
Reading a bit more into your custom scheduler. Does it set pod.spec.nodeName at some point? Assuming you're using reserved capacity, we rely on that for making calculations: https://github.com/awslabs/karpenter/blob/main/pkg/metrics/producers/reservedcapacity/producer.go#L51
from karpenter-provider-aws.
Thanks for the help. This is due to a minor bug in the config files. After fixing it, Karpenter is able to scale fine. We can close the issue.
from karpenter-provider-aws.
This is fixed after fixing a bug in the application config files
from karpenter-provider-aws.
Related Issues (20)
- karpenter.k8s.aws/instance-size will not work with `xlarge` HOT 3
- v1beta1 Migration a node tag need to be added to provisioner nodes to allow termination HOT 4
- Nodes are created but are not being registered to the cluster HOT 6
- Persistent Issue with Karpenter v0.36.0: Node Creation and Scheduling Failure Despite Resource Adjustments HOT 2
- Karpenter 0.16.3 helm chart unable to consolidate cluster HOT 5
- Allow the AMI Selector Terms to select based off of release_version
- add "maintenance windows" for expiring nodes HOT 2
- Karpenter nodes are not coming up HOT 1
- When spot is not available, karpenter fails to create an on-demand (within the 45 seconds documented time) HOT 4
- Karpenter always change all node at 11:50 PM (UTC) HOT 1
- Validation errors occur due to CRD changes in the Karpenter 0.37 upgrade HOT 4
- ta3.small instance type seems to be missing HOT 1
- Provide user warning when CPU limits can't be evenly filled by the node requirements HOT 5
- SpotToSpotConsolidation featureGate enabled, but logs say disabled and doesn't work HOT 1
- Optimizing Karpenter Provisioning for GPU-Based EKS Node Groups HOT 1
- karpenter unable to launch windows instances with custom AMI gives no instance type satisfied resources HOT 2
- Keda scaled job pods are prematurely terminated by Karpenter HOT 1
- Release tags don't include updated images HOT 1
- Not clear where the helm stable versions are HOT 6
- Can not update settings.kubernetes.pod-pids-limit by userData in Bottlerocket HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from karpenter-provider-aws.