[ICML 2025] RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression
Best LLM Chat Tools
LLM chat tools are the front door to modern AI — from general assistants to specialist chat UIs. Scan popular GitHub projects here (ranked by stars), then open the compare page for a compact decision table.
Popular on GitHub (by stars)
4,302 projects · ranked by GitHub stars, not a quality score
✂️ Open-source, self-hosted Opus Clip alternative. Turn long YouTube videos or uploads into viral 9:16 vertical shorts: AI viral-moment dete...
Agent-driven proactive memory CLI for AI agents — autonomously recall, maintain, and evolve persistent, source-grounded knowledge across ses...
TikTok marketing skills for Claude Code and Codex: 3-second video hooks, captions, trend mapping, and a weekly plan. Draft, humanize, and pu...
A terminal-native AI agent runtime built in Rust. Interactive chat, parallel agent orchestration, and autonomous supervision.
Claude Code skills that make Claude (Fable) the conductor of AI worker fleets: many parallel OpenAI Codex workers plus Opus design agents, o...
Open-source native macOS AI reading workspace for PDF, EPUB, and TXT with highlights, notes, book chat, and local-first storage. Download: r...
OpenAI-compatible multi-channel LLM relay gateway with admin console
Guides and scripts for Claude Code on WSL2: screenshot paste, Windows notifications, LSP, and statusline.
Credential-scoped AI quota, context, and cache in Herdr for Claude, Codex, Grok, Agy, OpenCode, Pi, and OMP.
基于 KouriChat 的 Dify 集成情感陪伴机器人,支持微信,增强 AI 交互。
Local web workspace for coding agents — Claude, Codex, Gemini, and more in one inspectable, LAN-ready hub.
Evernote MCP server - allows LLMs that support MCP (like Claude Desktop) to query your notes in Evernote
🧠 Obsidian plugin that embeds Claude Code as an AI writing companion — smart context, undo, diff preview, multi-thread chat.
Local AI clipper: long videos, podcasts and streams in, vertical 9:16 clips with captions out. Chat app + CLI, English.
Cut your AI coding agent's token bill, locally: Claude Code, Codex, Cursor, Copilot. #1 on THOL, 39% cheaper on long sessions.
Open-source AI coding agent for your terminal, written in Rust. One 7 MB native binary for Apple Silicon Macs, ~18 MB RAM, 70–90% prompt-cac...
Talk, and a team of bots does the work in a real browser, a shell and your files while she keeps talking. Open source, runs on your machine,...
Free AI models in VS Code Copilot Chat / DSH via browser auth. No API keys required.
MCP server for Cosense (Scrapbox) — read, search, create, and edit wiki pages from Claude and other AI agents. Also works as a CLI and Claud...
A lightweight, system-wide AI text-selection assistant that supports custom LLM APIs and screenshot-based AI image recognition.轻量级系统全...
HippoBuddy — AI-powered desktop assistant for chat, coding, and office workflows.
Local OpenAI, Anthropic & Gemini API bridge for Antigravity — use Claude Sonnet/Opus 4.6, Gemini 3.7/3.6/3.5, and GPT-OSS with opencode, Cla...
Build multi-model chatbots and agents from intent, with Claude Code and Codex.