[upstream contribution] Support ormb in Seldon Core and KFServing about ormb HOT 12 CLOSED

/priority p0

from ormb.

https://docs.seldon.io/projects/seldon-core/en/v1.1.0/developer/community.html

from ormb.

Seldon Core already supports multiple storage backend here github.com/SeldonIO/seldon-core/python/seldon_core/storage.py, thus it should not be hard to support ormb.

Doc is here https://docs.seldon.io/projects/seldon-core/en/v1.1.0/reference/release-0.4.0.html?highlight=s3#prepackaged-model-servers

from ormb.

Is there any upstream tracking issue?

from ormb.

No, going to request a demo show slot in seldon core community call. Now do not have the bandwidth for it currently. I think we should have a blog post in English for it first, then the community members can know more about our project.

from ormb.

ok, SGTM

from ormb.

We decide to implement it in our fork first to provide the end-to-end prototype.

from ormb.

Ref #34

KFServing and Seldon Core download the model using Python code. Now we will implement our own initializer using Golang.

from ormb.

We have to fork the seldon-core to support auth for ormb. Ref gaocegege/seldon-core#2

from ormb.

Now we succeed to run Seldcon Core deployment with ormb in gaocegege/seldon-core#2 . But we have some modifications for it. Maybe we should try to:

• Investigate if we can use the config here to replace aws with ormb https://github.com/gaocegege/seldon-core/blob/ormb/operator/config/manager/configmap.yaml#L14

from ormb.

We do not need to modify seldon core code. Things we need to do for the issue is to present it in Seldon Core community.

from ormb.

ref #44

from ormb.