Try out E2B's cloud runtime for AI agents
Welcome to our list of products for AI apps and agents. A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying of AI apps.
The list is done according to our best knowledge, although definitely not comprehensive. Discussion, corrections, and feedback are appreciated! ❤️
Do you have something to add or improve about our list? Do it via pull request.
⭐ For any new project, please also include a suggestion for a category in the visual, where it fits the most, or suggest a new category. ⭐
AutoGen is a framework by Microsoft that enables development of LLM applications using multiple agents that can converse with each other to solve task
- AutoGen agents are customizable, conversable, and seamlessly allow human participation
- They can operate in various modes that employ combinations of LLMs, human inputs, and tools
- AutoGen's design offers multiple advantages:
- it gracefully navigates the strong but imperfect generation and reasoning abilities of these LLMs
- it leverages human understanding and intelligence, while providing valuable automation through conversations between agents
- it simplifies and unifies the implementation of complex LLM workflows as automated agent chats
Context is the product analytics platform for chat interfaces
An open-source observability platform for GPT-3. Allows to track usage, costs, and latency with one line of code.
Langfuse is an open-source analytics for LLM apps. The analytics is currently in a closed alph
A unified platform for debugging, testing, evaluating, and monitoring LLM applications. LangSmith is now in closed beta.
A dynamic AI Automation Platform for Interoperability & AI Agent Management
A dynamic AI Automation Platform for Interoperability & AI Agent Management
Agents is an open-source library/framework for building autonomous language agents.
- Long-short Term Memory: Language agents in the library are equipped with both long-term memory implemented via VectorDB + Semantic Search and short-term memory (working memory) maintained and updated by an LLM.
- Tool Usage: Language agents in the library can use any external tools via function-calling and developers can add customized tools/APIs here.
- Web Navigation: Language agents in the library can use search engines to navigate the web and get useful information.
- Multi-agent Communication: In addition to single language agents, the library supports building multi-agent systems in which language agents can communicate with other language agents and the environment. Different from most existing frameworks for multi-agent systems that use pre-defined rules to control the order for agents' action, Agents includes a controller function that dynamically decides which agent will perform the next action using an LLM by considering the previous actions, the environment, and the target of the current states. This makes multi-agent communication more flexible.
- Human-Agent interaction: In addition to letting language agents communicate with each other in an environment, our framework seamlessly supports human users to play the role of the agent by himself/herself and input his/her own actions, and interact with other language agents in the environment.
- Symbolic Control: Different from existing frameworks for language agents that only use a simple task description to control the entire multi-agent system over the whole task completion process, Agents allows users to use an SOP (Standard Operation Process) that defines subgoals/subtasks for the overall task to customize fine-grained workflows for the language agents.
Axflow is a comprehensive end-to-end open-source LLM framework for TypeScript. It provides a family of modular libraries, which can be incrementally adopted, and together form an end-to-end opinionated framework for AI development. Axflow targets enterprises and allows them to develop AI applications. They provide a toolkit to orchestrate, monitor, and continuously improve AI applications in production.
ChatDev is a framework for building communicative agents for software development
- ChatDev is a cutting-edge AI NPC gaming research platform that seamlessly blends numerous advanced model interfaces, allowing for intricate manipulation of NPC interactions within meticulously crafted simulated social settings.
- ChatDev stands as a virtual software company that operates through various intelligent agents holding different roles, including Chief Executive Officer, Chief Product Officer, Chief Technology Officer, programmer, reviewer, tester, art designer .
Chidori is a reactive runtime for building AI agents. It provides a framework for building AI agents that are reactive, observable, and robust. It supports building agents with Node.js, Python, and Rust. It is currently in alpha and is not yet ready for production use.
Fixie is a platform for conversational AI that enables to build agents in any language. They have their own agent protocol.
GenWorlds is an event-based communication framework enabling developers to seamlessly blend deterministic and non-deterministic processes in building interactive multi-agent systems.
Flexibility in Process Management: GenWorlds excels in letting developers choose how to balance deterministic (predictable) and non-deterministic (AI-driven) processes. This is crucial for tailoring system reliability and intelligence to specific needs.
- Customizable Systems: GenWorlds emphasizes flexibility, allowing users to tailor systems according to their specific needs.
- Intuitive Abstraction Layer: Offers a basic interface with primitives to build agents, objects, and worlds without predefined constraints, supporting both deterministic and non-deterministic processes.
- Pre-Built Elements for Rapid Development: Comes equipped with a variety of ready-made agents, objects, and worlds, speeding up the setup process while still allowing extensive customization.
- Smooth Deployment Mechanisms: GenWorlds is built around a FastAPI web-socket server, facilitating easy dockerization and deployment, and providing versatile connectivity options suitable for various web systems.
Haystack is an open-source LLM framework for building production-ready applications.
A platform for deploying LLM agents with tools. They provide three types of agents: HfAgent uses inference endpoints for open-source models, LocalAgent uses a model of your choice locally and OpenAiAgent uses OpenAI closed models.
LangChain is a framework designed to simplify the creation of applications using large language models.
Multi-Agent framework for building LLM Applications.
Langroid is an intuitive, lightweight, extensible and principled
Python framework to easily build LLM-powered applications.
You set up Agents, equip them with optional components (LLM,
vector-store and methods), assign them tasks, and have them
collaboratively solve a problem by exchanging messages.
This Multi-Agent paradigm is inspired by the
Actor Framework
(but you do not need to know anything about this!).
Langroid is a fresh take on LLM app-development, where considerable thought has gone
into simplifying the developer experience; it does not use Langchain.
- Works with most commercial/remote and open/local LLMs.
- Set up Multi-agent, multi-LLM system: use stronger LLMs for agents requiring strong reasoning and instruction-following, and delegate simpler tasks to weaker/local LLMs.
- Supports OpenAI function-calling as well as native equivalent called
ToolMessage, which works with LLMs that do not have built-in function-calling. Simply specify structure as a (nested) Pydantic object. - Batteries-included: vector-databases for RAG (Retrieval-Augmented Generation), caching, logging/observability.
- Specialized agents available:
DocChatAgent,SQLChatAgent,TableChatAgent(for tabular data, e.g. csv/dataframes). DocChatAgenthandles text, PDF, Docx files/URLS, and has state-of-the art techniques for retrieval combining lexical and semantic search.- Documentation: https://langroid.github.io/langroid/
Rift is an AI-native language server for AI agents. It's an open-source VS Code extension that allows merging the output of code generation agents.
Steamship is a platform that allows to build, scale, and monitor AI agents with serverless cloud hosting, vector search, webhooks, callbacks, and more.
An open-source library for building AI-powered user interfaces.
An open-source library that helps you to integrate OpenAI into your existing API infrastructure. You can use it to validate user input, enhance existing APIs with AI capabilities, and build APIs on top of AI Agents.
E2b is an operating system for AI agents, that is, a set of tools, APIs, and cloud environments for agents.
- Web
- GitHub
- Twitter
- Vasek Mlejnsky (CEO, founder)
- Tomas Valenta (CEO, founder)
- Tereza Tizkova (Growth & Community)
- Jakub Novak (Software Engineer)
- Discord
Easy-to-use agent memory, powered by chromadb and postgres
Cadea is a platform that helps you create, manage, and monitor chatbots that can answer questions about your internal documents
- Cadea allows you to deploy AI tools in your organization with strict security protocols, encryption, and monitoring
- Still in waitlist version
LlamaIndex (formerly GPT Index) is a data framework for LLM applications to ingest, structure, and access private or domain-specific data.
MemGPT is teaching LLMs memory management for unbounded context
- MemGPT manages a virtual context (inspired by virtual memory in operating systems) to create unbounded LLM context
- MemGPT allows to create perpetual chatbots 🤖 with self-editing memory
About Memory management for the AI Applications and AI Agents
A truly serverless vector database
- Cheap. $1/month per million vectors. That's 10-70x cheaper than other vector databases. $4 per million queries.
- Serverless. Pay only for what you use. Don't worry about manual scaling. Reasonably
- Fast. ~100ms latency on 1m vectors. Much faster soon.
Vectara is a cloud-native, API-driven LLM-powered search app platform
- Purpose of Vectara is to serve the world’s largest sites and applications at blazing fast speeds
BondAI is an open-source framework tailored for integrating and customizing Conversational AI Agents.
The Assistants API allows you to build AI assistants within your own applications, leveraging models, tools, and knowledge to respond to user queries.
SID is a YC S23 company that creates personal data infrastructure for AI
- SID makes data infrastructure for AI easy by letting AI devs connect to all of their customers' data with a single button and API
- It is a fully-hosted retrieval pipeline that makes it easy to connect services like Google Mail, Notion, GDrive, or fully custom data. In one afternoon, you can connect to any data source you'd like and instantly scale to millions of users.
This list is made by the team behind E2B. E2b is building a Sandbox Runtime for LLM apps and agents - that is, a set of custom sandboxed cloud environments for AI-powered apps and agentic workflows. Get started here.
- Follow us on X
- Join our Discord
Feel free to reach out to us at [email protected]. Check out also our database of AI agents.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent