squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

fix document error for value and v_vec illustration (#3421)

Browse Source
This commit is contained in:
laneeee 2024-03-16 07:06:09 +08:00 committed by GitHub
parent a7af4538ca
commit 8fa7357f2d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

BIN
docs/source/assets/kernel/v_vec.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 50 KiB

After

Width:  |  Height:  |  Size: 42 KiB

BIN
docs/source/assets/kernel/value.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 119 KiB

After

Width:  |  Height:  |  Size: 167 KiB

2
docs/source/dev/kernel/paged_attention.rst
View File

@ -447,7 +447,7 @@ Value
a whole block of value tokens. And each ``accs`` in each thread
contains 8 elements that accumulated at 8 different head positions.
For the thread 0, the ``accs`` variable will have 8 elements, which
are 0th, 16th … 112th elements of a value head that are accumulated
are 0th, 32th … 224th elements of a value head that are accumulated
from all assigned 8 tokens.
LV