airllm

AirLLM 70B inference with single 4GB GPU

What is airllm?

AirLLM 70B inference with single 4GB GPU