Jeremy Reizenstein 0658e320f6 Preprocessor switches to control functionality (#788) ... For faster and smaller builds in some simple cases, provide switches to allow disabling -backward -alibi -uneven k -dropout -local attention Co-authored-by: Jeremy Francis Reizenstein <bottler@users.noreply.github.com>		2024-01-29 20:44:23 -08:00
..
cutlass@751eb9a885	Update cutlass to v3.4.0	2024-01-20 22:30:06 -08:00
flash_attn	Preprocessor switches to control functionality (#788)	2024-01-29 20:44:23 -08:00
ft_attention	[Gen] Don't use ft_attention, use flash_attn_with_kvcache instead	2023-09-18 15:29:06 -07:00
fused_dense_lib	[FusedDense] Allocate lt_workspace on input device	2023-05-30 14:17:26 -07:00
fused_softmax	Add Megatron attention implementation for benchmarking	2022-10-23 23:04:16 -07:00
layer_norm	[LayerNorm] Switch from CUDA to Triton implementation	2024-01-05 00:31:17 -08:00
rotary	Support H100 for other CUDA extensions	2023-03-15 16:59:27 -07:00
xentropy	[CE] Implement CrossEntropyLoss in Triton	2023-09-15 20:05:28 -07:00