Topic: model-serving Goto Github
Some thing interesting about model-serving
Some thing interesting about model-serving
model-serving,In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
User: ahkarami
model-serving,RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Organization: alibaba
model-serving,ClearML - Model-Serving Orchestration and Repository Solution
Organization: allegroai
Home Page: https://clear.ml
model-serving,Serving PyTorch models with TorchServe :fire:
User: alvarobartt
Home Page: https://pytorch.org/serve/
model-serving,Serving TensorFlow models with TensorFlow Serving :orange_book:
User: alvarobartt
Home Page: https://www.tensorflow.org/tfx/guide/serving
model-serving,A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.
User: aniketmaurya
Home Page: https://chitra.readthedocs.io/en/latest/
model-serving,๐ Stream inferences of real-time ML models in production to any data lake (Experimental)
Organization: aporia-ai
model-serving,A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
User: asprenger
model-serving,A collection of model deployment library and technique.
User: balavenkatesh3322
model-serving,The simplest way to serve AI/ML models in production
Organization: basetenlabs
Home Page: https://truss.baseten.co
model-serving,The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Organization: bentoml
Home Page: https://bentoml.com
model-serving,CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
Organization: bentoml
Home Page: https://bentoml.com
model-serving,BentoML Example Projects ๐จ
Organization: bentoml
Home Page: https://bentoml.com
model-serving,Turn any OCR models into online inference API endpoint ๐ ๐
Organization: bentoml
Home Page: https://bentoml.com
model-serving,OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease
Organization: bentoml
Home Page: https://bentoml.com
model-serving,Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
Organization: bentoml
Home Page: https://bentoml.com
model-serving,Model Deployment at Scale on Kubernetes ๐ฆ๏ธ
Organization: bentoml
Home Page: https://bentoml.com
model-serving,FastAPI Skeleton App to serve machine learning models production-ready.
User: eightbec
model-serving,A scalable, high-performance serving system for federated learning models
Organization: federatedai
model-serving,FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://fedml.ai) is your generative AI platform at scale.
Organization: fedml-ai
Home Page: https://fedml.ai
model-serving,flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Flink streaming engine
Organization: flinkml
model-serving,A tutorial on how to use kedro-mlflow plugin (https://github.com/Galileo-Galilei/kedro-mlflow) to synchronize training and inference and serve kedro pipeline
User: galileo-galilei
model-serving,A hands-on case study for demonstrating the stages involved in a machine learning project, from EDA to production.
User: hamedonline
model-serving,Find the optimal model serving solution for ๐ค Hugging Face models ๐
Organization: huggingbench
model-serving,โ Versatile Data Pipeline (VDP) console website
Organization: instill-ai
Home Page: https://www.instill.tech
model-serving,Standardized Serverless ML Inference Platform on Kubernetes
Organization: kserve
Home Page: https://kserve.github.io/website/
model-serving,Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka
Organization: lightbend
model-serving,Kubeflow example of machine learning/model serving
Organization: lightbend
model-serving,Code and presentation for Strata Model Serving tutorial
Organization: lightbend
model-serving,Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.
Organization: lightning-universe
Home Page: https://lightning.ai/muse
model-serving,Hopsworks - Data-Intensive AI platform with a Feature Store
Organization: logicalclocks
Home Page: https://hopsworks.ai
model-serving,fastText model serving service
User: messense
model-serving,AICI: Prompts as (Wasm) Programs
Organization: microsoft
model-serving,MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
Organization: mlrun
Home Page: https://mlrun.org
model-serving,LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Organization: modeltc
model-serving,Deploy, serve, and run a Hugging Face model on a Raspberry Pi with just a few lines of code
Organization: modzy
model-serving,A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
Organization: mosecorg
Home Page: https://mosec.readthedocs.io/
model-serving,The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML ๐ธ
Organization: nimbleboxai
Home Page: https://nimblebox.ai/docs/nbox/start
model-serving,Deploy DL/ ML inference pipelines with minimal extra code.
Organization: notai-tech
model-serving,A scalable inference server for models optimized with OpenVINOโข
Organization: openvinotoolkit
Home Page: https://docs.openvino.ai/2024/ovms_what_is_openvino_model_server.html
model-serving,Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Organization: predibase
Home Page: https://loraexchange.ai
model-serving,MONAI Deploy App SDK offers a framework and associated tools to design, develop and verify AI-driven applications in the healthcare imaging domain.
Organization: project-monai
model-serving,Serve pytorch / torch models using Drogon
Organization: saber-labs
model-serving,A minimalistic and pluggable machine learning platform for Kubernetes.
Organization: scaleoutsystems
Home Page: http://www.scaleoutsystems.com
model-serving,Common library for serving TensorFlow, XGBoost and scikit-learn models in production.
Organization: spotify
Home Page: https://spotify.github.io/zoltar/
model-serving,๐๏ธ Reproducible development environment
Organization: tensorchord
Home Page: https://envd.tensorchord.ai/
model-serving,An umbrella project for multiple implementations of model serving
Organization: typesafehub
model-serving,Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
Organization: underneathall
Home Page: https://pinferencia.underneathall.app
model-serving,A high-throughput and memory-efficient inference and serving engine for LLMs
Organization: vllm-project
Home Page: https://docs.vllm.ai
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.