Topic: llmops Goto Github
Some thing interesting about llmops
Some thing interesting about llmops
llmops,The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
Organization: agenta-ai
Home Page: http://www.agenta.ai
llmops,The web framework for building LLM microservices
User: ajndkr
Home Page: https://lanarky.ajndkr.com/
llmops,AI Observability & Evaluation
Organization: arize-ai
Home Page: https://docs.arize.com/phoenix
llmops,The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Organization: bentoml
Home Page: https://bentoml.com
llmops,Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Organization: bentoml
Home Page: https://bentoml.com
llmops,Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
Organization: berriai
Home Page: https://docs.litellm.ai/docs/
llmops,BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
Organization: bionic-gpt
Home Page: https://bionic-gpt.com
llmops,Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Organization: dagworks-inc
Home Page: https://hamilton.dagworks.io/en/latest/
llmops,DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
Organization: datadreamer-dev
Home Page: https://datadreamer.dev
llmops,📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
User: dillionverma
Home Page: https://llm.report
llmops,Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
Organization: explodinggradients
Home Page: https://docs.ragas.io
llmops,🧠 Motorhead is a memory and information retrieval server for LLMs.
Organization: getmetal
Home Page: https://getmetal.io
llmops,🐢 Open-Source Evaluation & Testing framework for LLMs and ML models
Organization: giskard-ai
Home Page: https://docs.giskard.ai
llmops,An open-source visual programming environment for battle-testing prompts to LLMs.
User: ianarawjo
Home Page: https://chainforge.ai
llmops,RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
Organization: infiniflow
Home Page: https://ragflow.io
llmops,🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
User: iusztinpaul
llmops,☁️ Build multimodal AI applications with cloud-native stack
Organization: jina-ai
Home Page: https://docs.jina.ai
llmops,AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
User: josh-xt
Home Page: https://AGiXT.com
llmops,🪢 Open source LLM engineering platform. Observability, metrics, evals, prompt management, testing, prompt playground, datasets, LLM evaluations -- 🍊YC W23 🤖 integrate via Typescript, Python / Decorators, OpenAI, Langchain, LlamaIndex, Litellm, Instructor, Mistral, Perplexity, Claude, Gemini, Vertex
Organization: langfuse
Home Page: https://langfuse.com/docs
llmops,本项目旨在分享大模型相关技术原理以及实战经验。
User: liguodongiot
Home Page: https://www.zhihu.com/column/c_1456193767213043713
llmops,[AI Agent Application Development Framework] - 🚀 Build AI agent native application in very few code 💬 Easy to interact with AI agent in code using structure data and chained-calls syntax 🧩 Enhance AI Agent using plugins instead of rebuild a whole new agent
User: maplemx
Home Page: http://agently.tech
llmops,AICI: Prompts as (Wasm) Programs
Organization: microsoft
llmops,A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
Organization: microsoft
Home Page: https://microsoft.github.io/autogen/
llmops,⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
User: msoedov
Home Page: https://langcorn.vercel.app/docs
llmops,Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
Organization: neumtry
Home Page: https://neum.ai
llmops,Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone
User: onlyphantom
Home Page: https://www.youtube.com/playlist?list=PLXsFtK46HZxUQERRbOmuGoqbMD-KWLkOS
llmops,Turn expensive prompts into cheap fine-tuned models
Organization: openpipe
Home Page: https://openpipe.ai
llmops,LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.
Organization: pathwaycom
Home Page: https://pathway.com/developers/showcases/llm-app-pathway/
llmops,🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
Organization: pezzolabs
Home Page: https://pezzo.ai
llmops,A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.
Organization: portkey-ai
Home Page: https://portkey.ai/features/ai-gateway
llmops,Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Organization: predibase
Home Page: https://loraexchange.ai
llmops,Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
Organization: promptfoo
Home Page: https://www.promptfoo.dev/
llmops,The Security Toolkit for LLM Interactions
Organization: protectai
Home Page: https://llm-guard.com/
llmops,LLM Prompt Injection Detector
Organization: protectai
Home Page: https://playground.rebuff.ai
llmops,RayLLM - LLMs on Ray
Organization: ray-project
Home Page: https://aviary.anyscale.com
llmops,LLMFlows - Simple, Explicit and Transparent LLM Apps
User: stoyan-stoyanov
Home Page: https://llmflows.readthedocs.io
llmops,🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
Organization: superduperdb
Home Page: https://superduperdb.com
llmops,cube studio开源云原生一站式机器学习/深度学习AI平台,支持sso登录,多租户/多项目组,大数据平台对接,notebook在线开发,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务VGPU,边缘计算,serverless,标注平台,自动化标注,数据集管理,大模型微调,vllm大模型推理,llmops,私有知识库,AI模型应用商店,支持模型一键开发/推理/微调,支持国产cpu/gpu/npu芯片,支持RDMA,支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Organization: tencentmusic
llmops,An awesome & curated list of best LLMOps tools for developers
Organization: tensorchord
llmops,🏕️ Reproducible development environment
Organization: tensorchord
Home Page: https://envd.tensorchord.ai/
llmops,A reactive runtime for building durable AI agents
Organization: thousandbirdsinc
Home Page: https://docs.thousandbirds.ai
llmops,Open-source observability for your LLM application, based on OpenTelemetry
Organization: traceloop
Home Page: https://www.traceloop.com/openllmetry
llmops,<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
User: transformeroptimus
Home Page: https://superagi.com/
llmops,Evaluation and Tracking for LLM Experiments
Organization: truera
Home Page: https://www.trulens.org/
llmops,No-code platform to build LLM Agents, workflows and applications with your data
Organization: trypromptly
Home Page: https://llmstack.trypromptly.com
llmops,UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
Organization: uptrain-ai
Home Page: https://uptrain.ai/
llmops,A high-throughput and memory-efficient inference and serving engine for LLMs
Organization: vllm-project
Home Page: https://docs.vllm.ai
llmops,ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Organization: zenml-io
Home Page: https://zenml.io
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.