AI
HPC
Storage
Rustycage
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk
Focus
Most clusters are not compute-bound. They are bound by the slowest thing between the accelerator and the data.
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk