4 Commits

Author	SHA1	Message	Date
Tri Dao	79bd1a2d5d	[LayerNorm] Implement residual + LayerNorm/RMSNorm in Triton	2023-11-13 02:04:49 -08:00
Tri Dao	f1a73d0740	Run isort and black on python files	2023-08-18 14:22:11 -07:00
Tri Dao	60499abcfd	[Benchmark] Add script to benchmark FlashAttention	2023-07-28 00:26:52 -10:00
Tri Dao	fb88e5e4b3	Move benchmark utils, support AMP	2022-10-23 12:50:00 -07:00