cc269ba094
The OLLAMA_MAX_VRAM env var was a temporary workaround for OOM scenarios. With Concurrency this was no longer wired up, and the simplistic value doesn't map to multi-GPU setups. Users can still set `num_gpu` to limit memory usage to avoid OOM if we get our predictions wrong. |
||
|---|---|---|
| .. | ||
| cmd.go | ||
| interactive_test.go | ||
| interactive.go | ||
| start_darwin.go | ||
| start_default.go | ||
| start_windows.go | ||
| start.go | ||