AI
HPC
Storage
Rustycage
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk
Focus
Every tier is a bet about what you will need next. Caching is that bet made explicit.
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk