* feat: enable flash attention if supported * feat: enable flash attention if supported * feat: enable flash attention if supported * feat: add flash_attn support |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| httplib.h | ||
| json.hpp | ||
| server.cpp | ||
| utils.hpp | ||
* feat: enable flash attention if supported * feat: enable flash attention if supported * feat: enable flash attention if supported * feat: add flash_attn support |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| httplib.h | ||
| json.hpp | ||
| server.cpp | ||
| utils.hpp | ||