SimplerLLM

Python library for building with LLMs. One interface across 11 providers (OpenAI, Anthropic, Gemini, DeepSeek, Ollama and more), automatic failover, Pydantic-va

What is SimplerLLM?

Python library for building with LLMs. One interface across 11 providers (OpenAI, Anthropic, Gemini, DeepSeek, Ollama and more), automatic failover, Pydantic-validated structured output, embeddings with vector search, and an AI-powered router. pip install simplerllm

Overview of SimplerLLM

What it is

SimplerLLM is an open-source Python library designed to simplify interactions with Large Language Models (LLMs). It provides a unified interface across 11 providers, including OpenAI, Anthropic, Google Gemini, Cohere, OpenRouter, CometAPI, DeepSeek, Perplexity, Moonshot, Ollama, and HuggingFace Local. The library supports automatic failover, Pydantic-validated structured output, embeddings with vector search, and an AI-powered router.

Key features

  • Unified LLM Interface: Consistent API across 11 providers, access to 500+ models via OpenRouter and CometAPI, and full async support.
  • Reliability & Failover: Automatic failover between primary and secondary providers with built-in exponential backoff retry logic and provider validation during initialization.
  • Structured Output: Pydantic integration for generating validated JSON responses with automatic retry on validation failures.
  • Vector Operations: Multiple embedding providers (OpenAI, Voyage AI, Cohere, OpenRouter, CometAPI), local vector database and Qdrant integration, and semantic search capabilities.
  • Intelligent Routing: AI-powered content routing with metadata filtering and confidence scoring.
  • Advanced Tools: Content loading from PDF, DOCX, web pages; text chunking (semantic, sentence, paragraph); search integration (Serper, Value Serp, SearchAPI, Apify); and dynamic prompt templates.

Use cases

SimplerLLM can be used for building applications that require interaction with multiple LLM providers, automatic failover for reliability, structured JSON output, embeddings for semantic search, and intelligent routing. It is suitable for researchers, developers, and AI enthusiasts who need a unified interface for diverse LLM tasks.

Getting started

Install the library: bash pip install simplerllm For optional voice features: bash pip install simplerllm[voice] Basic LLM usage: python from SimplerLLM.language.llm import LLM, LLMProvider llm = LLM.create(provider=LLMProvider.OPENAI, model_name='gpt-4o') response = llm.generate_response(prompt='Explain quantum computing in simple terms') print(response) See the repository README for full examples.

License and pricing

The library is licensed under the MIT License and is open source (free to use).

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/hassancs91simplerllm.svg)](https://yunodb.com/tools/hassancs91simplerllm?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/hassancs91simplerllm?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/hassancs91simplerllm.svg" alt="Featured on YunoDB" height="20"></a>