Giter Club home page Giter Club logo

autodeploy's Introduction

Hi ๐Ÿ‘‹, I'm Kartik!

Building AI Tools

kartik4949

kartik4949

  • ๐Ÿ”ญ Iโ€™m currently working on SuperDuperDB

  • ๐ŸŒฑ Iโ€™m currently learning Cuda, ARM assembly language.

  • ๐Ÿ‘จโ€๐Ÿ’ป All of my projects are available at here.

  • ๐Ÿ’ฌ Ask me about tensorflow,vim,python.

  • โšก Fun fact facts are not funny -_-

Blogs posts

Languages and Tools:

bash c git linux opencv python pytorch tensorflow

kartik4949

ย kartik4949

autodeploy's People

Contributors

kartik4949 avatar nilavghosh avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

autodeploy's Issues

Docs and Config changes

  • Documentation for

  • preprocess

  • postprocess

  • custom metrics

  • file paths

  • Verbose definition for functions to be used from preprocess/postprocess and custom metrics in config.yaml

Option to provide the base image

In order to meet any generic optimized generic docker requirement, it would be great to derive the Dockerfile based on the base image defined in config.

Things to update

  • Config files examples (input/output schema) for detection, segmentation (sklearn?)
    - ...
  • Postprocess
  • Make input_type implicit ('serialized')
  • Dockerizing locust as a separate container
  • Separate out the monitor container.

Onnx Loader

Add onnx loader into the autodeploy

import numpy as np
import onnxruntime as ort
sess = ort.InferenceSession('horse_zebra.onnx')

input_name = sess.get_inputs()[0].name
label_name = sess.get_outputs()[0].name
pred_onx = sess.run(
    [label_name], {input_name: np.zeros((1, 3, 224,224), dtype=np.float32)})[0]
print(pred_onx)

getting 500 on calling /model/

image

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/uvicorn/protocols/http/httptools_impl.py", line 390, in run_asgi
    result = await app(self.scope, self.receive, self.send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/uvicorn/middleware/proxy_headers.py", line 45, in __call__
    return await self.app(scope, receive, send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/fastapi/applications.py", line 199, in __call__
    await super().__call__(scope, receive, send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/applications.py", line 111, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/middleware/errors.py", line 181, in __call__
    raise exc from None
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/middleware/errors.py", line 159, in __call__
    await self.app(scope, receive, _send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/middleware/base.py", line 25, in __call__
    response = await self.dispatch_func(request, self.call_next)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/prometheus_fastapi_instrumentator/instrumentation.py", line 172, in dispatch_middleware
    raise e from None
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/prometheus_fastapi_instrumentator/instrumentation.py", line 169, in dispatch_middleware
    response = await call_next(request)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/middleware/base.py", line 45, in call_next
    task.result()
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/middleware/base.py", line 38, in coro
    await self.app(scope, receive, send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/exceptions.py", line 82, in __call__
    raise exc from None
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/exceptions.py", line 71, in __call__
    await self.app(scope, receive, sender)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/routing.py", line 566, in __call__
    await route.handle(scope, receive, send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/routing.py", line 227, in handle
    await self.app(scope, receive, send)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/starlette/routing.py", line 41, in app
    response = await func(request)
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/fastapi/routing.py", line 218, in app
    is_coroutine=is_coroutine,
  File "/Users/yreddy31/anaconda3/lib/python3.7/site-packages/fastapi/routing.py", line 126, in serialize_response
    raise ValidationError(errors, field.type_)
pydantic.error_wrappers.ValidationError: 3 validation errors for UserOutputSchema
response -> out
  field required (type=value_error.missing)
response -> probablity
  field required (type=value_error.missing)
response -> status
  field required (type=value_error.missing)

am i doing anything wrong?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.