squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Fixed switch statement, thanks @yocabon

Browse Source
This commit is contained in:
Eric Engelhart 2022-10-04 21:25:46 -04:00
parent 9b1b011bf6
commit 2211db5fab
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
csrc/flash_attn/src/fp16_switch.h
View File

@ -18,10 +18,10 @@
#define FP16_SWITCH(COND, ...) \
[&] { \
if (COND) { \
using elem_type = std::conditional<true, __nv_bfloat16, __half>::type; \
using elem_type = __nv_bfloat16; \
return __VA_ARGS__(); \
} else { \
using elem_type = std::conditional<true, __nv_bfloat16, __half>::type; \
using elem_type = __half; \
return __VA_ARGS__(); \
} \
}()