Search results

[Minor][SpecInfer] Fix Optional FC Bias for Mixtral Eagle Model

Status: Merged (completed).

mlc-ai/mlc-llmnumber 2146

#2146 In mlc-ai/mlc-llm;

· by zxybazh was closed on Apr 17, 2024

[SLM][AutoLLM] Allow Weight Data Type Casting During Quantization

Status: Closed (abandoned).

mlc-ai/mlc-llmnumber 1185

#1185 In mlc-ai/mlc-llm;

· by zxybazh was closed on Nov 4, 2023

[Minor][SLM][AutoLLM] Fix Quantization Parameter Naming

Status: Closed (abandoned).

mlc-ai/mlc-llmnumber 1179

#1179 In mlc-ai/mlc-llm;

· by zxybazh was closed on Nov 2, 2023

[SLM][AutoLLM] Enable Command Line Weight Conversion

Status: Merged (completed).

mlc-ai/mlc-llmnumber 1170

#1170 In mlc-ai/mlc-llm;

· by zxybazh was closed on Nov 2, 2023

[Slim-LM] Enable Group Quant

Status: Merged (completed).

mlc-ai/mlc-llmnumber 1129

#1129 In mlc-ai/mlc-llm;

· by zxybazh was closed on Oct 29, 2023

[BugFix] Correct Order of Temperature and Top_P in Sample Function

Status: Merged (completed).

mlc-ai/mlc-llmnumber 951

#951 In mlc-ai/mlc-llm;

· by zxybazh was closed on Sep 21, 2023

Add PrimFunc Benchmark Script Dump in Debug Dump Mode

Status: Merged (completed).

mlc-ai/mlc-llmnumber 738

#738 In mlc-ai/mlc-llm;

· by zxybazh was closed on Aug 11, 2023