vLLM/Recipes

Moonshot AI

moonshotai·7 recipesHuggingFace

Multimodal

4
Kimi-K3
2.8T / 16 experts/token + shared (of 896 routed)
moe
MXFP41680G
v0.27.0+→
Kimi-K2.7-Code
1T / 32B
moe
INT4714G
v0.19.1+→
Kimi-K2.6
1T / 32B
moe
INT4714GNVFP4600G
v0.25.0+→
Kimi-K2.5
1T / 32B
moe
INT4714GNVFP4600GMXFP4669G
v0.19.1+→

Text

3
Kimi-K2-Thinking
1T / 32B
moe
INT4600GNVFP4600G
v0.12.0+→
Kimi-Linear-48B-A3B-Instruct
48B / 3B
moe
BF16115G
v0.11.2+→
Kimi-K2-Instruct
1T / 32B
moe
FP81200G
v0.12.0+→