Heterogeneous Inference

KTransformers: How Splitting LLMs Across CPU and GPU Unlocks Workstation-Scale AI

KTransformers maps LLM layers across CPU and GPU so researchers can run frontier MoE models on a single consumer GPU — no data-center budget required.

Ktransformers·Heterogeneous Inference·Local Ai