Skip to content

Commit 947830b

Browse files
authored
doc: bugfix on documentation about mask usage (#331)
This PR should fix #330 .
1 parent f237f5f commit 947830b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

python/flashinfer/prefill.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -484,7 +484,7 @@ class BatchPrefillWithPagedKVCacheWrapper:
484484
... torch.full((qo_len[i], kv_len[i]), True, device="cuda:0"),
485485
... diagonal=(kv_len[i] - qo_len[i]),
486486
... )
487-
... mask_arr.append(mask_i)
487+
... mask_arr.append(mask_i.flatten())
488488
...
489489
>>> mask = torch.cat(mask_arr, dim=0)
490490
>>> prefill_wrapper.begin_forward(

0 commit comments

Comments
 (0)