AI
HPC
Storage
Rustycage
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk
Focus
Serving is where models meet reality: memory ceilings, cold starts, and the parts that do not fit on the card.
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk