Langroid is an open-source Python framework designed to streamline the development of applications powered by Large Language Models (LLMs). It introduces a multi-agent programming paradigm, treating agents as first-class citizens to manage multiple LLM conversations, each responsible for different aspects of a task. This approach facilitates efficient collaboration through message exchange, enabling developers to build complex, intelligent applications with ease. Langroid supports integration with various LLMs, vector databases, and function-calling tools, offering a modular and extensible architecture for AI application development.

langroid

An open-source Python framework that simplifies LLM application development using a multi-agent programming paradigm.

Langroid

ChatArena is an open-source Python framework designed to facilitate the development of multi-agent language game environments for large language models (LLMs). It provides a flexible structure for defining multiple players, environments, and their interactions, enabling researchers and developers to explore and enhance AI communication and collaboration skills. With user-friendly interfaces, including both web UI and command-line options, ChatArena supports the creation of diverse language game scenarios, such as conversational simulations, educational settings, and social deduction games.

chatarena

An open-source framework for creating multi-agent language game environments to enhance AI communication and collaboration capabilities.

ChatArena

FloAI is an open-source Python framework designed to streamline the development of composable AI agents and workflows. It enables developers to build, launch, and scale autonomous AI applications efficiently by providing a flexible, modular approach to constructing agent-based systems. With features like YAML-based configuration, support for various agent types, and integration with tools from the LangChain community, FloAI facilitates the creation of sophisticated AI solutions tailored to specific needs.

floai

An open-source Python framework that simplifies the creation of composable AI agents and workflows for complex tasks.

FloAI

Restack is an open-source framework designed to assist engineers in creating, deploying, and scaling autonomous AI applications. It offers a comprehensive suite of tools, including the Restack AI Framework for coding multistep workflows with features like concurrency, scheduling, retries, and rate-limiting. Additionally, the Restack Desktop provides a developer environment with a user interface to visualize and debug workflows, enhancing the development process. By leveraging Restack, developers can build resilient AI products capable of running long-lived processes with persistent state, facilitating the creation of autonomous agents that self-improve over time based on feedback loops and long-term memory.

restack

An open-source framework empowering developers to build, launch, and scale autonomous AI products efficiently.

Restack

Guardrails AI is an open-source Python framework that helps developers build reliable AI applications by adding guardrails to large language models (LLMs). It performs two key functions: running input/output guards to detect and mitigate risks, and generating structured data from LLMs. Guardrails can be integrated with any LLM, providing features such as real-time hallucination detection, validation of generated text for toxicity, truthfulness, and PII compliance, and serving as a standalone service via a REST API. The framework supports streaming validation, structured data generation, and monitoring, enhancing the safety and reliability of AI applications.

guardrails-ai

An open-source Python framework designed to add guardrails to large language models, ensuring reliable and safe AI application development.

Guardrails AI

Ax is an open-source TypeScript framework designed to facilitate the development of agents and workflows powered by large language models (LLMs). Inspired by Stanford's DSPy paper, Ax provides tools for creating chat interfaces, retrieval-augmented generation (RAG) systems, streaming applications, and multi-modal interactions. It supports various LLMs and vector databases, offers automatic prompt generation from simple signatures, and includes features like output validation during streaming, multi-agent orchestration, and OpenTelemetry tracing for observability. Ax aims to streamline the creation of efficient, production-ready AI applications.

An open-source TypeScript framework for building LLM-powered agents and agentic workflows.

LiteLLM is an open-source toolkit that streamlines interactions with over 100 large language models (LLMs) by providing a unified API in the OpenAI format. It offers both a Python SDK and a proxy server (LLM Gateway) to manage authentication, load balancing, and spend tracking across various LLM providers, including OpenAI, Azure OpenAI, Vertex AI, and Amazon Bedrock. LiteLLM supports features such as retry and fallback logic, rate limiting, and logging integrations with tools like Langfuse and OpenTelemetry. It is designed to simplify the integration of multiple LLMs into applications, ensuring consistent output formats and efficient resource management.

litellm

An open-source Python SDK and proxy server for managing authentication, load balancing, and spend tracking across 100+ LLMs using a unified OpenAI format.

LiteLLM

LiveKit Agents is an open-source framework designed to facilitate the development of AI-driven server programs capable of real-time interaction through voice, video, and data channels. It enables the creation of programmable, multimodal AI agents that can process and generate audio, video, and text, integrating seamlessly with large language models (LLMs) and other AI models. The framework supports flexible integrations, including plugins for popular LLMs, speech-to-text (STT), text-to-speech (TTS), and voice activity detection (VAD) services. LiveKit Agents also offers built-in task scheduling, load balancing, and real-time media transport over WebRTC, making it suitable for applications such as AI voice assistants, call centers, transcription services, and real-time translation.

livekit-agents

An open-source framework for building real-time, multimodal AI applications that can see, hear, and speak.

LiveKit Agents

LlamaGym is an open-source Python framework designed to simplify the fine-tuning of large language model (LLM) agents through online reinforcement learning. By providing a standardized environment similar to OpenAI's Gym, LlamaGym allows developers to efficiently train LLM-based agents by managing conversation context, episode batching, reward assignment, and proximal policy optimization (PPO) setup. This framework enables rapid experimentation with agent prompting and hyperparameters across various Gym environments, facilitating the development of more capable and responsive AI agents.

llamagym

An open-source Python framework for fine-tuning large language model (LLM) agents using online reinforcement learning.

LlamaGym

Marvin is a lightweight AI engineering framework designed to facilitate the development of natural language interfaces that are reliable, scalable, and easy to trust. It provides a suite of tools for common large language model (LLM) use cases, including entity extraction, classification, and synthetic data generation. Marvin's components are simple and self-documenting, allowing developers to integrate AI functionalities into their applications with minimal effort. The framework supports multi-modal inputs, including text, images, and audio, making it versatile for various AI-powered applications.

marvin

An open-source AI engineering framework for building reliable, scalable, and trustworthy natural language interfaces.

Marvin

uAgent is an open-source Python framework developed by Fetch.ai that enables developers to create autonomous AI agents with ease. It provides simple and expressive decorators for scheduling tasks or responding to various events. Upon startup, each agent automatically joins a decentralized network by registering on the Almanac, a smart contract deployed on the Fetch.ai blockchain. This ensures that uAgent messages and wallets are cryptographically secured, protecting their identities and assets.

uagent

An open-source Python framework for creating autonomous AI agents with decentralized capabilities.

uAgent

ControlFlow is an open-source Python framework developed by Prefect for orchestrating AI-powered workflows. It enables developers to break down complex AI tasks into discrete, manageable steps, assign specialized AI agents to each task, and combine these tasks into cohesive flows. ControlFlow integrates seamlessly with large language models (LLMs) like OpenAI's GPT-4 and Anthropic's Claude, allowing for flexible and transparent AI development. Key features include structured results, multi-agent orchestration, and native observability, making it suitable for building robust, intelligent applications.

controlflow

A Python framework for building agentic AI workflows with task-centric design.

AI Agents Tagged with: open-source