Skip to content

Pull requests: flashinfer-ai/flashinfer

New pull request New
64 Open 1,549 Closed
64 Open 1,549 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add data type check for deepseek fp4 moe
#2165 opened Dec 3, 2025 by samuellees Loading…
5 tasks
6
refactor: Move mla code from decode.py to mla.py and add to documentation
#2163 opened Dec 3, 2025 by bkryu Loading…
5 tasks done
24
feat: MxInt4 x Bf16 TRT-LLM Gen MoE support
#2159 opened Dec 2, 2025 by nekorobov Loading…
5 tasks done
29
fix xqa mha_sm90.cu
#2157 opened Dec 2, 2025 by qsang-nv Loading…
5 tasks
4
[Flashinfer-Bench integration] HF end-to-end inference
#2151 opened Nov 30, 2025 by sfc-gh-goliaro • Draft
5 tasks
2
enable sm103 moe dsl backend
#2149 opened Nov 28, 2025 by aleozlx Loading…
5 tasks done
14
Enable Hopper FA3 FP8 attention
#2148 opened Nov 28, 2025 by nvpohanh • Draft
5 tasks
2
make DeepGEMM swapAB available for linear gemm SM90
#2131 opened Nov 22, 2025 by katec846 • Draft
5 tasks
1
A unified API for the MNNVL and single-node AllReduce kernels.
#2130 opened Nov 21, 2025 by nvmbreughe • Draft
5 tasks
2
[wip] feat: support variable sequence length in decode kernel of trtllm-gen attention
#2125 opened Nov 20, 2025 by yaoyaoding • Draft
5 tasks
1
4
perf: using multi-cta optimization for top-k/top-p
#2119 opened Nov 20, 2025 by yzh119 Loading…
4 of 5 tasks
9
Refactor trtllm_mnnvl_allreduce
#2118 opened Nov 20, 2025 by timlee0212 Loading…
5 tasks done
61
refactor: update fa3 codebase and fix hopper unittest [part 1]
#2111 opened Nov 19, 2025 by yzh119 Loading…
5 tasks done
1
45
feat: support more head dim in RoPE kernel
#2109 opened Nov 19, 2025 by raayandhar Loading…
5 tasks done
23
Port TRT-LLM communication kernels to flashinfer
#2102 opened Nov 18, 2025 by djns99 Loading…
5 tasks
19
make DeepGEMM swapAB available for linear gemm SM90
#2101 opened Nov 17, 2025 by xuanzic Loading…
5 tasks
9
feat: add sink to flashinfer decode
#2087 opened Nov 13, 2025 by djmmoss Loading…
14
feat: BF16 GEMM using CUTLASS backend for SM100
#2070 opened Nov 10, 2025 by raayandhar Loading…
5 tasks done
47
Rebase FP8 SM100 Cutlass FMHA Attention to main (original PR#1238)
#2047 opened Nov 5, 2025 by pavanimajety • Draft
5 tasks
2
Added an initial implementation of Q and KV Cache in fp8 and to use t…
#2035 opened Nov 4, 2025 by Anerudhan • Draft
3 tasks done
1
Refactor flashinfer/__init__.py so that applications could selectively pack submodules without modifying __init__.py
#2027 opened Nov 3, 2025 by bangshengtang Loading…
5 tasks done
9
Blockwise GEMM with all reduce overlapping
#2007 opened Oct 30, 2025 by Amir-19 • Draft
5 tasks
1
refactor: backend_requirement + supported_compute_capability decorator for gemm
#2000 opened Oct 29, 2025 by jimmyzho Loading…
5 tasks
23
chore: agentic workflow for automatic version bump
#1947 opened Oct 19, 2025 by yzh119 Loading…
5 tasks
35
add blockwise gemm cute dsl
#1922 opened Oct 13, 2025 by Amir-19 Loading…
5 tasks
33
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.