GitHub - JustVugg/colibri: A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own. · GitHub | Louche Cannon

← All bookmarks

Bookmark · 11 November 2026, 20:29

GitHub - JustVugg/colibri: A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own. · GitHub