ggml-org gemma-4-26B-A4B-it-GGUF
Recommended way to run this model:
llama-server -hf ggml-org/gemma-4-26B-A4B-it-GGUF
Then, access http://localhost:8080
llama-server -hf ggml-org/gemma-4-26B-A4B-it-GGUF
Then, access http://localhost:8080
GGUF
Hardware compatibility
4-bit
8-bit
16-bit
Hardware compatibility
4-bit
8-bit
16-bit