Skip to content

Pull requests: mlc-ai/mlc-llm

New pull request New
Clear current search query, filters, and sorts
28 Open 1,727 Closed
28 Open 1,727 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Serving] Add speculative decoding
#1539 by KnowingNothing was merged Jan 10, 2024 Loading…
53
[SpecDecode] Support Eagle in speculative decoding
#2080 by KnowingNothing was merged Apr 12, 2024 Loading…
47
[Serving] Prefix Cache
#2295 by cyx-6 was merged May 21, 2024 Loading…
@vinx13
47
PoC implementation of SmoothQuant
#855 by ibsidorenko was closed Jun 24, 2024 Loading…
41
gradio polish and minigpt cli
#496 by Kathryn-cat was merged Jul 7, 2023 Loading…
@MasterJH5574
38
[SLM] Batched Llama
#1520 by MasterJH5574 was merged Jan 4, 2024 Loading…
38
[Serving][Grammar] BNF AST and Parser for EBNF grammar
#1534 by Ubospica was merged Jan 12, 2024 Loading…
27
Add support for specifying custom model path
#140 by sudeepag was merged May 16, 2023 Loading…
24
[Model] Initial batching support for Llama
#1048 by MasterJH5574 was merged Oct 14, 2023 Loading…
23
[iOS] support for multimodal
#524 by Kathryn-cat was merged Jul 17, 2023 Loading…
22
[MultiGPU] Support pre-sharded model weights
#1096 by Lunderberg was merged Nov 9, 2023 Loading…
22
[KVCache] Migrate Baichuan model to PagedKVCache
#1854 by tlopex was merged Feb 28, 2024 Loading…
22
[SLM][AutoLLM] Enable Command Line Weight Conversion
#1170 by zxybazh was merged Nov 2, 2023 Loading…
20
[SLM] Add support for StableLM architecture
#1701 by rickzx was merged Feb 3, 2024 Loading…
@CharlieFRuan
20
[SLM] Add support for Baichuan2 architecture
#1755 by tlopex was merged Feb 15, 2024 Loading…
@rickzx
20
[Model] [Serve] Add support for LLaVa model in serving engine
#1962 by anibohara2000 was closed Mar 18, 2024 Loading…
20
[REST] OpenAI compatible Rest API
#1107 by Kartik14 was merged Oct 24, 2023 Loading…
19
[Serving][Grammar] BNF grammar simplifier and matcher
#1801 by Ubospica was merged Feb 24, 2024 Loading…
19
[Serving] Support "n" for parallel generation
#1868 by MasterJH5574 was merged Mar 2, 2024 Loading…
19
[Param Manager] suppport auto-gptq checkpoints from param manager.
#506 by LeiWang1999 was merged Jul 13, 2023 Loading…
18
[SLM] Integration with Disco sharding.
#1212 by LeshengJin was merged Dec 10, 2023 Loading…
18
[SERVING] Add Conv Template and Function Calling support to JSON FFI
#2190 by Kartik14 was merged Apr 22, 2024 Loading…
18
[SLIM] Allow dynamic shape parameters
#1417 by CharlieFRuan was merged Jan 17, 2024 Loading…
17
[Multimodal Support] Add MiniGPT4
#390 by Kathryn-cat was merged Jun 22, 2023 Loading…
6 tasks done
16
[SLM] Enable FasterTransformer quantization
#1480 by cyx-6 was merged Jan 2, 2024 Loading…
16
ProTip! Updated in the last three days: updated:>2025-12-01.