intro-to-ml-with-kubeflow / intro-to-ml-with-kubeflow-examples Goto Github PK

serve
simple-sci-kit-kf-pipeline-8jgpg-992827095
This step is in Failed state with this message: Error from server (Forbidden): error when creating "/tmp/manifest.yaml": seldondeployments.machinelearning.seldon.io is forbidden: User "system:serviceaccount:kubeflow:pipeline-runner" cannot create resource "seldondeployments" in API group "machinelearning.seldon.io" in the namespace "kubeflow"

$ kfctl apply -V -f https://raw.githubusercontent.com/kubeflow/manifests/v1.0-branch/kfdef/kfctl_k8s_istio.v1.0.1.yaml

Warning  Failed     11m (x4 over 13m)     kubelet            Failed to pul │
│ l image "gcr.io/kfserving/kfserving-controller:0.2.2": rpc error: code = Unk │
│ nown desc = Error response from daemon: unauthorized: You don't have the nee │
│ ded permissions to perform this operation, and you may have invalid credenti │
│ als. To authenticate your request, follow the steps in: https://cloud.google │
│ .com/container-registry/docs/advanced-authentication                         │
│   Warning  Failed     11m (x4 over 13m)     kubelet            Error: ErrIma │
│ gePull                                                                       │
│   Warning  Failed     5m52s (x29 over 13m)  kubelet            Error: ImageP │
│ ullBackOff                                                                   │
│   Normal   BackOff    58s (x50 over 13m)    kubelet            Back-off pull │
│ ing image "gcr.io/kfserving/kfserving-controller:0.2.2"                      │

Please use tf.one_hot on tensors.
Extracting MNIST_data/t10k-images-idx3-ubyte.gz
Extracting MNIST_data/t10k-labels-idx1-ubyte.gz
...truncated output for readability...

/seldon/ml/mnist-classifier/api/v0.1/predictions
{
  "status": {
    "code": -1, 
    "info": "Empty json parameter in data", 
    "reason": "MICROSERVICE_BAD_DATA", 
    "status": 1
  }
}

request = {"data": {"names": features, "ndarray": data.tolist()}}

This step is in Failed state with this message: error: error when creating "/tmp/manifest.yaml": Post https://10.96.0.1:443/apis/machinelearning.seldon.io/v1alpha2/namespaces/kubeflow/seldondeployments: stream error: stream ID 123; INTERNAL_ERROR

$ export \
    PROFILE=marley-minikube \
    CPUS=8 \
    MEMORY=30G \
    HDD=80G \
    DRIVER=docker \
    KUBERNETES_VERSION=v1.16.0

Stream closed EOF for kubeflow/recommender-model-update-j7c5g-2195988956 (ma │
│ in)                                                                          │
│ main DataPublisher for model rebuild. Minio: url - http://minio-service.kube │
│ flow.svc.cluster.local:9000, key - minio, secret - minio123                  │
│ main Error reading file recommender/directory.txt from bucket data - The spe │
│ cified bucket does not exist                                                 │
│ main Error deleting file recommender/directory.txt from bucket data- The spe │
│ cified bucket does not exist                                                 │
│ main Error writing file recommender/directory.txt from bucket data- The spec │
│ ified bucket does not exist                                                  │
│ main Exception in thread "main" error occurred                               │
│ main ErrorResponse(code=NoSuchBucket, message=The specified bucket does not  │
│ exist, bucketName=null, objectName=null, resource=/models, requestId=3L137,  │
│ hostId=3L137)                                                                │
│ main request={method=GET, url=http://minio-service.kubeflow.svc.cluster.loca │
│ l:9000/models?location=, headers=Host: minio-service.kubeflow.svc.cluster.lo │
│ cal:9000                                                                     │
│ main User-Agent: MinIO (amd64; amd64) minio-java/dev