AI
HPC
Storage
Rustycage
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk
Robotics · HPC · AI · Privacy · Storage
Every project page here is generated from the repository it describes — roadmap, pitfalls and lessons learned included, written in the repo and synced automatically. 6 projects currently tracked.
A Rust LLM serving platform with block-level KV cache tiering across GPU, RAM, and disk
Tiered KV-cache for Ollama: GPU VRAM → Host RAM → Disk, enabling near-infinite context length for LLM inference on consumer GPUs
AIPerf lab benchmark artifacts and test runs
Isaac-Nexus: An Integrated Robotics Platform for Industrial Automation
A high-performance KV cache tiering system implemented in Rust with intelligent data placement and compression