squall/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

add comment (#628)

Browse Source
This commit is contained in:
Yujia Zhai 2022-09-17 18:40:30 -07:00 committed by GitHub
parent fc9ebc645b
commit faab7536fc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/41_multi_head_attention/fused_multihead_attention.cu
View File

@ -43,6 +43,8 @@
# Run an attention example with batch size = 64 and head number = 16 without checking the correctness # Run an attention example with batch size = 64 and head number = 16 without checking the correctness
$ ./examples/41_multi_head_attention/41_multi_head_attention --head_number=16 --batch_size=64 --reference-check=false $ ./examples/41_multi_head_attention/41_multi_head_attention --head_number=16 --batch_size=64 --reference-check=false
Acknowledgement: this example is inspired by the idea originally prototyped by ByteDance Inc.
*/ */
///////////////////////////////////////////////////////////////////////////////////////////////// /////////////////////////////////////////////////////////////////////////////////////////////////