#vllm
15
2026-08-28
tonyd2wild/GLM-5.3-Flash-NVFP4-1M-KV-4x-DGX-Spark
B
GLM-5.3-Flash (320B MoE) at TP4 across four DGX Sparks, same day as the model drop: 36 tok/s, 1.26M-token FP8 KV pool, 262K context, MTP spec decode. First TP4 glm5_next outside B200 hardware. Full patched-image recipe + the GB10 memory study.
2026-08-28
tonyd2wild/GLM-5.3-Flash-NVFP4-2x-DGX-Spark
B
GLM-5.3-Flash (NVFP4) on 2x NVIDIA DGX Spark - vLLM TP2, 262K context, MTP. World-first deploy recipe: 7 day-0 bugs found and fixed, patched sm121 image, probes and full report.
2026-09-23
tonyd2wild/MiMo-V2.6-Flash-DGX-Spark-Recipe
B
MiMo-V2.6-Flash-RL on 2x NVIDIA DGX Spark (GB10): vLLM TP2 + DFlash + vision/audio, fp8 KV 300K, four fixes for the stock image, measured baselines
2026-09-23
mmastrac/djev
C
Jev-style structured decisions on DiffusionGemma: the example server from vLLM PR 57250
2026-10-21
vcruz305/DSV4.1-Flash-1017-EXL3-Spark-recipe
C
DSV4.1-Flash-1017 SAGE EXL3 (1.62 bpw) on one DGX Spark with vLLM: DSpark MTP, cold-expert ATS alias, tile-K 16 MoE, memory guard, measured 31-34 tok/s
2026-10-16
GGZ14/vllm-mxfp4
unrated
The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyper
2026-10-16
VanGong1999/FDE
unrated
Updating | Collects everything about FDE (Forward Deployed Engineer) AI | From 0 to 1 | AI Agent, Workflows, RAG, knowledge bases, inference optimization and deployment, vllm and sglang, workflow, graph/loop/context/prompt engineering
2026-10-16
amitshekhariitbhu/llm-inference-engineering
unrated
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
2026-09-03
alphaparkinc/genpark-paged-attention-kv-cache-budget-calculator-skill
unrated
PagedAttention chunked prefill KV cache & GPU memory allocator (vLLM)
2026-09-02
alphaparkinc/genpark-paged-attention-virtual-memory-allocator-skill
unrated
Paged attention virtual memory allocator & non-contiguous KV cache (vLLM style)
2026-08-31
alphaparkinc/genpark-chunked-prefill-speculative-inference-server-skill
unrated
Chunked prefill speculative inference server with paged KV cache (vLLM style)
2026-08-29
LLMKube
unrated
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API. (Source Code) Apache-2.0 Go/Docker/K8S