vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
What is vllm-ascend?
Community maintained hardware plugin for vLLM on Huawei Ascend
Keep exploring
View all alternatives Related tools
100/100
llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve
100/100
gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
100/100
ChatALL
Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers