If the system has multiple numa nodes, enable numa support in llama.cpp If we detect numactl in the path, use that, else use the basic "distribute" mode. |
||
|---|---|---|
| .. | ||
| client_test.go | ||
| client.go | ||
| types_test.go | ||
| types.go | ||
If the system has multiple numa nodes, enable numa support in llama.cpp If we detect numactl in the path, use that, else use the basic "distribute" mode. |
||
|---|---|---|
| .. | ||
| client_test.go | ||
| client.go | ||
| types_test.go | ||
| types.go | ||