baibot
π€ A Matrix bot for using different capabilities (text-generation, text-to-speech, speech-to-text, image-generation, etc.) of AI / Large Language Models (OpenAI
What is baibot?
π€ A Matrix bot for using different capabilities (text-generation, text-to-speech, speech-to-text, image-generation, etc.) of AI / Large Language Models (OpenAI, Anthropic, etc.)
Overview of baibot
What it is
baibot is an AI (Large Language Model) bot for Matrix, built by etke.cc (managed Matrix servers). The name is pronounced 'bye'-bot and is a play on AI, referencing the fictional character Bai Ganyo. It is designed as a more private and featureful alternative to matrix-chatgpt-bot. It is influenced by chaz but does not use the AIChat CLI tool; instead it does everything in-process, without forking.
Key features
- Encourages provider choice (Anthropic, Groq, LocalAI, OpenAI, Venice and many more) as well as mixing and matching models - Supports different use purposes depending on the provider and model: text-generation, speech-to-text, text-to-speech, image-generation - Supports seamless voice interaction (turning user voice messages into text, answering in text, then turning that text back into voice)
- Supports transcribe-only mode (turning user voice messages into text, without text-generation)
- Supports text-to-speech-only mode (turning user text messages into voice, without text-generation)
- Supports encryption for Matrix communication and Account-Data-stored configuration - Supports context-management for every provider (automatically trimming older messages on whole-turn boundaries once a conversation outgrows the context window)
- Allows customizing much of the bot's configuration at runtime using commands sent via chat - Actively maintained by the team at etke.cc
Use cases
- Using AI text-generation, speech-to-text, text-to-speech, and image-generation within Matrix - Seamless voice interaction where voice messages are transcribed, processed, and answered with voice - Transcribing voice messages without generating text responses - Converting text messages to voice messages without text generation - Mixing and matching different AI providers and models for various tasks
Getting started
See the repository README for setup instructions.
License and pricing
The license is AGPL-3.0. The project is open source with no stated pricing.
Based on the project's public README and repository metadata.