The tool was described by its creator as a way to run the instruction-tuned Gemma 4 26B-A4B model without loading the full 14.3 GB into memory. It keeps only a shared core and cache in memory, streaming needed experts from the SSD.
log in to read full article