Langroid is an open-source Python framework designed to streamline the development of applications powered by Large Language Models (LLMs). It introduces a multi-agent programming paradigm, treating agents as first-class citizens to manage multiple LLM conversations, each responsible for different aspects of a task. This approach facilitates efficient collaboration through message exchange, enabling developers to build complex, intelligent applications with ease. Langroid supports integration with various LLMs, vector databases, and function-calling tools, offering a modular and extensible architecture for AI application development.

langroid

An open-source Python framework that simplifies LLM application development using a multi-agent programming paradigm.

Langroid

Ax is an open-source TypeScript framework designed to facilitate the development of agents and workflows powered by large language models (LLMs). Inspired by Stanford's DSPy paper, Ax provides tools for creating chat interfaces, retrieval-augmented generation (RAG) systems, streaming applications, and multi-modal interactions. It supports various LLMs and vector databases, offers automatic prompt generation from simple signatures, and includes features like output validation during streaming, multi-agent orchestration, and OpenTelemetry tracing for observability. Ax aims to streamline the creation of efficient, production-ready AI applications.

An open-source TypeScript framework for building LLM-powered agents and agentic workflows.

LiteLLM is an open-source toolkit that streamlines interactions with over 100 large language models (LLMs) by providing a unified API in the OpenAI format. It offers both a Python SDK and a proxy server (LLM Gateway) to manage authentication, load balancing, and spend tracking across various LLM providers, including OpenAI, Azure OpenAI, Vertex AI, and Amazon Bedrock. LiteLLM supports features such as retry and fallback logic, rate limiting, and logging integrations with tools like Langfuse and OpenTelemetry. It is designed to simplify the integration of multiple LLMs into applications, ensuring consistent output formats and efficient resource management.

litellm

An open-source Python SDK and proxy server for managing authentication, load balancing, and spend tracking across 100+ LLMs using a unified OpenAI format.

LiteLLM

Marvin is a lightweight AI engineering framework designed to facilitate the development of natural language interfaces that are reliable, scalable, and easy to trust. It provides a suite of tools for common large language model (LLM) use cases, including entity extraction, classification, and synthetic data generation. Marvin's components are simple and self-documenting, allowing developers to integrate AI functionalities into their applications with minimal effort. The framework supports multi-modal inputs, including text, images, and audio, making it versatile for various AI-powered applications.

marvin

An open-source AI engineering framework for building reliable, scalable, and trustworthy natural language interfaces.

Marvin

ControlFlow is an open-source Python framework developed by Prefect for orchestrating AI-powered workflows. It enables developers to break down complex AI tasks into discrete, manageable steps, assign specialized AI agents to each task, and combine these tasks into cohesive flows. ControlFlow integrates seamlessly with large language models (LLMs) like OpenAI's GPT-4 and Anthropic's Claude, allowing for flexible and transparent AI development. Key features include structured results, multi-agent orchestration, and native observability, making it suitable for building robust, intelligent applications.

controlflow

A Python framework for building agentic AI workflows with task-centric design.

ControlFlow

Griptape is a modular open-source Python framework that enables developers to build and deploy AI-powered applications utilizing large language models (LLMs). It provides clean and clear abstractions for creating agents, pipelines, workflows, and retrieval-augmented generation (RAG) implementations without extensive prompt engineering. Griptape's composability makes it ideal for developing conversational and event-driven AI applications that can access and manipulate data securely and reliably. The framework supports integration with various data sources and APIs, facilitating the development of scalable and efficient AI solutions.

griptape

A modular open-source Python framework for building and deploying LLM-based agents, pipelines, and workflows.

Griptape

AutoGen is an open-source programming framework developed by Microsoft for constructing AI agent systems. It streamlines the development of event-driven, distributed, scalable, and resilient agentic applications, enabling the creation of systems where AI agents collaborate to perform tasks autonomously or with human oversight. AutoGen supports asynchronous message passing between agents, integration of large language models (LLMs), and advanced multi-agent design patterns, facilitating the orchestration, automation, and optimization of complex LLM workflows.

autogen

An open-source framework for building AI agent systems, simplifying the creation of event-driven, distributed, scalable, and resilient agentic applications.

AutoGen

PraisonAI is an open-source framework that integrates AutoGen and CrewAI, or similar frameworks, into a low-code solution for developing and orchestrating multi-agent large language model (LLM) systems. It focuses on ease of use, customization, and effective human-agent interaction, enabling users to create AI-powered multi-agent systems for various applications, including customer service, personalization, chatbots, automation, and analysis. PraisonAI supports features such as real-time voice interaction, internet search capabilities, and vision language model support, making it a versatile tool for AI development.

praisonai

An open-source, low-code framework for building and managing multi-agent LLM systems, emphasizing simplicity, customization, and efficient human-agent collaboration.

PraisonAI

Firecrawl is an open-source web scraping and crawling tool designed to transform websites into clean, structured data formats suitable for large language models (LLMs). It efficiently handles dynamic content, navigates through all accessible subpages without requiring a sitemap, and provides outputs in formats such as markdown, HTML, and screenshots. Built by LLM engineers, Firecrawl manages challenges like rotating proxies, rate limits, and JavaScript-rendered content, ensuring reliable data extraction for AI applications.

firecrawl

An open-source web scraping tool that converts websites into clean, LLM-ready data formats like markdown.

Firecrawl

TaskingAI is an open-source platform designed to streamline the development and deployment of AI-native applications. It offers a comprehensive suite of tools, including model integration, retrieval systems, assistant frameworks, and plugin support, enabling developers to create flexible and scalable AI solutions. With an intuitive console and robust cloud services, TaskingAI simplifies the complexities of AI application development, making it accessible for both beginners and experienced developers. The platform supports integration with leading large language models (LLMs) and provides APIs compatible with OpenAI, facilitating seamless incorporation into existing workflows.

taskingai

A developer-friendly cloud platform for building and running LLM agents for AI-native applications.

TaskingAI

Millis AI is a cutting-edge platform that empowers developers and non-technical users to create and deploy advanced voice agents with unprecedented 600ms latency. Designed to deliver seamless, human-like interactions, Millis AI supports integration with Large Language Models (LLMs) such as OpenAI's GPT-4o and open-source models like Mistral and Llama. The platform offers no-code/low-code tools, allowing users to build voice applications in minutes, connect phone numbers for inbound and outbound calls in over 100 countries, and integrate with various services through webhooks. With affordable pricing starting at $0.02 per minute, Millis AI makes advanced voice AI accessible for applications ranging from customer support to virtual assistants.

millis-ai

An AI-powered platform for building advanced voice agents with ultra-low 600ms latency, enabling seamless and natural conversational experiences.

Millis AI

Composio is an AI integration platform designed to streamline the development and deployment of AI agents and Large Language Models (LLMs). By offering out-of-the-box support for over 250 tools, including CRMs, HRMs, ticketing systems, and productivity applications, Composio allows developers to build, connect, and deploy integrations efficiently. The platform features managed authentication, ensuring secure data management, and is framework and LLM model agnostic, supporting popular agentic frameworks and major LLM providers. Composio's SOC Type II compliance underscores its commitment to data security, making it a trusted choice for engineers and businesses aiming to enhance their AI capabilities.

composio

An AI integration platform that enables seamless connection of AI agents and LLMs with over 250 tools using minimal code.

AI Agents Tagged with: LLM integration