Kirthi Shankar Sivamani dd9c3a1fc2 bump to v1.0.6 ... Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>		2023-05-26 17:44:10 -07:00
..
layers	[Rotary] Implement GPT-J style (interleaved) rotary	2023-03-14 14:35:53 -07:00
losses	Tweak CrossEntropyLoss to take process_group in init	2022-12-27 10:47:43 -08:00
models	[BugFix] cannot unpack non-iterable NoneType object	2023-05-07 03:07:44 +09:00
modules	[BugFix] cannot unpack non-iterable NoneType object	2023-05-07 03:07:30 +09:00
ops	Implement LLaMa	2023-04-18 21:51:35 -07:00
utils	[Gen] Minor tweak to allocate_inference_cache	2023-04-21 11:56:47 -07:00
__init__.py	bump to v1.0.6	2023-05-26 17:44:10 -07:00
bert_padding.py	remove numpy dependency	2022-10-06 19:17:15 +02:00
flash_attention.py	Remove unused kwargs in flashattention	2023-03-15 10:36:19 -07:00
flash_attn_interface.py	Handle FlashAttnQKVPackedSplitFunc by making rng_state optional in backward	2023-04-13 06:25:52 +00:00
flash_attn_triton_og.py	Implement FlashAttention in Triton	2022-10-30 18:09:11 -07:00
flash_attn_triton.py	[Triton] Fix benchmark_causal, mention Triton version	2023-03-22 00:51:16 -07:00
flash_blocksparse_attention.py	Rename src -> flash_attn	2022-06-01 18:50:26 -07:00
flash_blocksparse_attn_interface.py	Rename src -> flash_attn	2022-06-01 18:50:26 -07:00
fused_softmax.py	Add Megatron attention implementation for benchmarking	2022-10-23 23:04:16 -07:00