History

Jeffrey Morgan 2c6e8f5248 Update submodule to `6efb8eb30e7025b168f3fda3ff83b9b386428ad6` (#1885 ) * update submodule to `6efb8eb30e7025b168f3fda3ff83b9b386428ad6` * unblock condition variable in `update_slots` when closing server		2024-01-10 16:48:38 -05:00
..
CMakeLists.txt	Code shuffle to clean up the llm dir	2024-01-04 12:12:05 -08:00
ext_server.cpp	Update submodule to `6efb8eb30e7025b168f3fda3ff83b9b386428ad6` (#1885 )	2024-01-10 16:48:38 -05:00
ext_server.h	Code shuffle to clean up the llm dir	2024-01-04 12:12:05 -08:00
README.md	Code shuffle to clean up the llm dir	2024-01-04 12:12:05 -08:00

README.md

Extern C Server

This directory contains a thin facade we layer on top of the Llama.cpp server to expose extern C interfaces to access the functionality through direct API calls in-process