Provide a mechanism for users to set aside an amount of VRAM on each GPU to make room for other applications they want to start after Ollama, or workaround memory prediction bugs |
||
|---|---|---|
| .. | ||
| config_test.go | ||
| config.go | ||
Provide a mechanism for users to set aside an amount of VRAM on each GPU to make room for other applications they want to start after Ollama, or workaround memory prediction bugs |
||
|---|---|---|
| .. | ||
| config_test.go | ||
| config.go | ||