#sglang
3
2026-10-16
RH-RunningHub/MiniMax-H3-MultiGPU-Lightning
未评级
MiniMax-H3 multi-GPU inference acceleration: ~12x on 8x RTX 6000D (step distillation + SageAttention2 + Cache-DiT + torch.compile, TP2+Ulysses4 on sglang)
2026-10-16
amitshekhariitbhu/llm-inference-engineering
未评级
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
2026-10-16
datawhalechina/zero-to-sglang
未评级
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.