DGX Station GB300
Public notes from one NVIDIA DGX Station GB300 in a home lab. Recipes, dated measurements, and the configs that lost. This is the page to share.
If you only read one: Testing the inner loop on DSFVE — the evidence trail and the simpler, digest-pinned Recipe v2 generated from it. Recipe, launcher, and sanitized receipts are on GitHub.
Spark (GB10) posts are a different machine. Those live under Local LLMs.
Hardware: the empty CX8 M.2s are filled. Exxact M.2 upgrade — 2× WD_BLACK SN850X 8 TB, RAID0 14.55 TiB at /models. Identify disks by serial; nvmeN reshuffles.
What this Station has actually served
| Workload | What is proven | Read |
|---|---|---|
| DeepSeek-V4-Flash-Vision-Exp (Recipe v2) | Native FP4, digest-pinned SGLang, DSpark, explicit static verification, no SPS table, checkpoint-default NextN, 1M context, TP=1. Iteration 13 measured 2,985.4 tok/s at C64; C8–C64 was equivalent to baseline inside the frozen ±3% band. | Recipe v2 evidence · original post |
| GLM-5.3-Flash NVFP4 | DFlash2 daily-driver recipe. Published: 234 tok/s single-stream; warmup is mandatory; tool-call parsers are not optional. | Flash testing |
| Full GLM-5.3 744B NVFP4 | K=2 closed on the 512K slot-cache lane (9/20 greedy, 47.13 vs 48.03 tok/s). Keep K=1. Decode remains GPU-bound and dominated by masked_row_copy C2C miss bytes. | 744B testing · HBM expert allocation |
| DeepSeek-V4.1-Flash native | One Station, native weights, 1M context, DSpark k=5: ~88 tok/s on real agent turns (150 on clean code), 18K tok/s prefill, 972K prompt in 85 s; 8-min boot; Hermes-wired. Not promoted. | Flash 4.1 testing |
Numbers are dated lab measurements from the linked posts, not leaderboard claims. Different engines, quants, and concurrency are not automatically comparable.
Posts
- GB300 DeepSeek Flash 4.1 Testing
DeepSeek-V4.1-Flash on one GB300 Station at full 1M context with DSpark on: 82 tok/s single-stream prose, 130–150 on code and tool JSON, 18K tok/s prefill, a 972K prompt in 85 s, 10/10 tool calls under the real Hermes harness, 8-minute cold boot from local NVMe. Overnight of further levers adopted nothing and retracted one noisy metric; now a formal J&M recipe. The SGLang whole-layer offloader that booted first did 3.3 tok/s. - keys suggested DFlash2 for our GLM-5.3 recipe
Measured result: DFlash2 booted on the one-GB300 UVA path but accepted only 1.5718 tokens per verification step against the frozen 3.0 gate. It was stopped, not promoted. - Recipe v2 from the DSFVE inner loop September 4, 2026
One completed outer-loop pass: 20 inner-loop iteration numbers distilled into a digest-pinned static/no-SPS Recipe v2, with measured equivalence rather than an invented speed win. - DeepSeek-V4-Flash-Vision-Exp on One GB300: Native FP4, SGLang, DSpark, 1M Context September 3, 2026
Current one-Station recipe. Native checkpoint, no requantization. Loop table, cold-prefill ladder, correctness gates, and every config that lost. - Designing an Inference Recipe Generator/Optimizer September 3, 2026
Pre-build design note: two loops, experiment cards, benchmark tiers, and how a Station becomes a nightly recipe lab. Asking for input. - GLM 5.3 Testing: HBM Expert Allocation September 5, 2026
Slot-cache build for full GLM-5.3: CUDA-graph correction, graph-replayed layer measurements, memory-budget failures, exact pinning, and demand-fill milestones. - GB300 GLM 5.3 Testing September 8, 2026
Living page corrected for E1 v2: decode-only attribution is 40.1 ms wall / 43.1 ms aggregate GPU per step; decode is graph-captured and masked_row_copy is ~50% of decode. - GB300 GLM 5.3 Flash Testing September 1, 2026
Flash NVFP4 from first token to 234 tok/s. Warmup discipline, DFlash2, 105k-token prefill in four seconds, and the tool-call bug no throughput bench caught. - DGX Station GB300: Day One September 1, 2026
Arrival, first power, kernel/driver-module trap, and the ten-launch SGLang saga to first token.
Public recipe repos
- jmeadlock/dsf-vision-exp-gb300 — Vision-Exp launcher, smoke, needle, repetition audit, cold-prefill probe.
- J-M-Recipes/gb300-glm-flash-recipe — Flash launch/warmup/bench scripts, throughput CSV, failure ledger, CDMM notes, 744B campaign writeup.
Related
- Local LLM Stack — where this Station sits relative to the Spark pair and the rest of the lab.
- Local LLMs — Spark (GB10) recipes and the broader fleet.
- Benchmarks — methodology and non-comparable result boundaries.