GB300 with RTX 6000, and 120V Power
The sidecar post gave power one paragraph: long prefills hit the GB300's software power cap in 52–65% of samples on the old lane and 86–89% on the sidecar, and all the speed numbers were measured under that throttling. James asked the obvious follow-ups. How much speed is that throttling costing? Would a 240 V circuit buy it back? And what can we do on 120 V? This post answers all three from the same SC5 power trace (one-second samples of both GPUs, October 22, 00:37–02:06 CDT), the vendor documents, and a few read-only checks on the box this morning.
Where the 1,600 W goes
A DGX Station has one power supply. NVIDIA's Station development guide says the system has a fixed total budget of 1,600 W shared between the GB110 module (the GB300 GPU plus the Grace CPU) and an optional RTX add-in card. At boot, the module's cap comes from a table keyed on the RTX card's maximum power rating:
| RTX card's maximum power | GB110 module cap |
|---|---|
| No RTX card, or ≤ 75 W | 1,600 W |
| 76–300 W (the RTX PRO 6000 Max-Q is 300 W) | 1,250 W |
| > 300 W (e.g. the 600 W Workstation Edition) | 950 W |
That's exactly what the box reports. nvidia-smi -q -d POWER on the GB300 shows module Current 1,250 W, Requested 1,600 W, Default 1,600 W, Max 1,600 W. The 6000 shows a 300 W limit (adjustable 250–325 W). Nothing on the host asked for 1,250 W. The platform imposes it. A daemon called vsloshd can move budget between the two devices dynamically, but it isn't present on this MSI image, so the split here is static: 1,250 W for the module, 300 W for the 6000, and 50 W nobody can use. How the card went in, and how we found the cap before any sloshing software existed, is in Adding an RTX PRO 6000 Blackwell Max-Q to the DGX Station GB300.
Figure 1. The budget split as the box reports it, and the v25 sidecar lane's draw during the SC5 long-prefill phases (4 × 64K and 32 × 8K prompts, medians and p99s across both). The module's one-second average stays under 1,250 W; the cap acts on the peaks above it.
Why 240 V doesn't move the cap
The idea that 240 V helps is real and has a good source. In Level1Techs' review of this same chassis, the MSI XpertStation WS300 (September 18, 2026), Wendell says:
"…it is worth it running on a 220/240 circuit because the power supply will deliver 1600 watts instead of 1300 watts. You'll get a few percent more performance if you give it a 220 volt circuit…" (5:47–6:09)
Later he puts a number on it. Between roughly 1,000 and 1,300 W he saw "like 7% performance difference" worst case and "like 3%, give or take" in real-world use (20:27).
MSI's own label says something narrower. The WS300 specification (MSI EPS page, repeated by StorageReview and several resellers) rates the supply at:
| AC input | Max input current | Max output |
|---|---|---|
| 100–114 V | 15 A | 1,300 W |
| 115–240 V | 15–8 A | 1,600 W |
A US 120 V outlet sits in the 1,600 W band. The 1,300 W band is for 100 V mains (Japan) or an outlet that sags below 115 V. Dell rates its GB300 supply the same way. So on a healthy 120 V circuit, 240 V doesn't change the supply's output. More to the point, it doesn't change the table above. The 1,250 W module cap is chosen from the RTX card's rating against a fixed 1,600 W total. Line voltage isn't an input to that table.
Our box is consistent with that reading:
- The platform budgets a 1,600 W total at our outlet (1,250 + 300 + 50 unassigned). If it thought it had 1,300 W, the 1,250 W module cap would leave the 6000 almost nothing.
- During the sidecar prefill bursts the module's one-second average plus the 6000's draw was already 1,292–1,307 W DC before fans, pumps, drives and the network card. That held for seconds at a time with no trip. The GPU's
HW Power Brakingcounter, which logs supply-side clock brakes, reads 0 µs on both GPUs since driver load (checked 06:24 CDT). That's an inference that our supply is in its 1,600 W band, not a measurement of line voltage. The Station exposes no input-voltage sensor:ipmitoolshows only GPU and CPU rail voltages, and DCMI power reading returns an error. - The peak is the decisive number. During 64K-token prefill on the sidecar lane, the module's instantaneous power reached a p99 of 1,353 W and the RTX PRO 6000 a p99 of 194 W in the same phase — 1,547 W DC through the supply, or 119% of the 1,300 W row. A unit that derated to 1,300 W at 120 V would have hit over-current protection well before that. Ours ran a 20-minute prefill burst with zero supply-side clock brakes. That is a measurement of what the supply delivered, not of line voltage, but it is the one number the derating claim has to survive — and it does not. (SC5 trace, 19 one-second samples in that phase, 2026-10-22 00:37–02:06 CDT.)
Two plausible ways to reconcile Wendell's numbers with ours: his outlet may sag below 115 V under load, or his box runs dynamic sloshing — in his words at 20:15, "it's done dynamically. So, if the GPU is not doing anything, all of the power budget goes to the Blackwell Ultra" — which is what vsloshd does, and which our static split never does — not because it is broken or misconfigured, but because our Station runs Canonical's Ubuntu OEM image for this SKU rather than NVIDIA's DGX OS. The install media reads Ubuntu OEM 24.04.4 LTS "Noble Numbat" - Release arm64+nvidia-64k (20260525), the apt sources are the MSI, NVIDIA and OEM pockets on archive.canonical.com, and the sixteen dgx-desktop-* packages are all version 1.0ubuntu~24.04.15. None of those archives carries vsloshd, smbpbid or nsmd, there is no /etc/dgx-release, and apt-cache policy returns nothing for any of the three. NVIDIA documents the daemon only on the DGX OS 7.5 "Software 2.0" image, and its own dgx-assist treats its absence on Software 1.0 as normal rather than a fault. Either would make voltage or budget matter more on his bench than on ours. His 3–7% is also about the same size as the clock loss we measure below. We just attribute it to the card class, not the outlet.
Two details that make the disagreement smaller than it looks. He ran his review unit on a 240 V circuit — "when I run this thing off of a 240 volt circuit" (7:21) — so the 120 V behaviour he warns about was never exercised on that bench. And 1,300 W is also the GB300's default GPU power limit, exactly, which is one straightforward way a supply rating and a GPU limit get conflated in a spec discussion. Neither point changes our numbers; both make a reasonable reviewer's reading understandable.
What the cap actually costs
"The cap is active in 89% of samples" sounds worse than it is. The flag says the power controller is trimming clocks. It doesn't say by how much. The SC5 trace records the GB300's SM clock every second, and its maximum is 2,070 MHz. So the honest measure is how far the clock fell below 2,070 MHz in each phase:
| lane | phase | cap active | SM clock mean (min) | clock lost | module 1 s avg, p50 | module instant, p99 | GB300 GPU, p50 | 6000, p50 |
|---|---|---|---|---|---|---|---|---|
| v23 | 1 user decode | 0% | 2,070 (2,070) | 0.00% | 658 W | 872 W | 490 W | 19 W |
| v23 | 32 users decode | 0% | 2,070 (2,070) | 0.00% | 723 W | 972 W | 528 W | 19 W |
| v23 | 4 × 64K prefill | 65% | 2,058 (1,995) | 0.58% | 1,131 W | 1,279 W | 952 W | 20 W |
| v23 | 32 × 8K prefill | 52% | 2,057 (2,002) | 0.62% | 1,134 W | 1,300 W | 956 W | 19 W |
| v25 | 1 user decode | 0% | 2,070 (2,070) | 0.00% | 759 W | 861 W | 588 W | 126 W |
| v25 | 32 users decode | 2.4% | 2,069 (2,040) | 0.03% | 1,029 W | 1,263 W | 850 W | 184 W |
| v25 | 4 × 64K prefill | 89% | 1,973 (1,882) | 4.91% | 1,105 W | 1,353 W | 924 W | 187 W |
| v25 | 32 × 8K prefill | 86% | 1,973 (1,830) | 4.92% | 1,122 W | 1,342 W | 941 W | 185 W |
"Clock lost" = 2,070 MHz ÷ phase-mean SM clock − 1. SC5 card, October 22, 00:37–02:06 CDT; v23 = GB300-only lane, v25 = sidecar lane, same box, same night. Prefill phases are short (14–40 one-second samples each), so treat the second decimal as noise.
Figure 2. Clock lost to the power cap per phase. On v23 the cap was on most of the time in prefill but barely touched the clock. The sidecar pushes harder and loses about 5%.
Why does the sidecar lane throttle more, when the 6000 has its own bucket? Because the GB300 is doing more work per second, not because the 6000 takes its watts. With the cold experts off its critical path, the GB300 finishes each prefill step sooner and runs at a higher duty cycle. The bursts take half the time: about 4.7 s versus 10 s for 262K tokens. Roughly the same work done in half the time means higher power peaks. Under the static split the 6000's draw doesn't come out of the module's 1,250 W at all.
Peaks, not averages
The odd detail in the table: in every prefill phase the module's one-second average sits at 1,105–1,134 W, comfortably under 1,250 W. Only the instantaneous reading crosses it, with a p99 of 1,279–1,353 W. The controller is clipping short peaks, not holding the module at its cap.
This matters for the one software lever that exists. NVIDIA's documented sloshing algorithm, run on our measured draws (6000 at ~187 W in prefill, floor 250 W, 50 W step and threshold), would walk the module from 1,250 W to 1,350 W and park the 6000 at 250 W. That's enough headroom for the ~1,350 W peaks. But the daemon decides the module is "hungry" when its cap minus its draw falls under 50 W, and it reads module power through nsmd, which NVIDIA says polls every 1–5 s. If that reading looks like our one-second average, the module shows ~115–145 W of headroom and never looks hungry. So vsloshd might move nothing for bursty prefill. That's an inference from the documentation and our trace, not something we've run.
The estimate: what a bigger budget would buy
The clock loss is an upper bound on speed loss. It assumes prefill time scales one-for-one with SM clock. Prefill is mostly GEMMs, so it's close, but any memory-bound part of a step loses less. Decode at 1 user didn't throttle at all, and at 32 users it lost 0.03%.
| change | module budget | long prefill | decode | verdict |
|---|---|---|---|---|
| 120 V → 240 V, same card, same software | 1,250 W | ≈ 0% | ≈ 0% | No speed. Other benefits below. |
vsloshd, if it triggers on prefill bursts | up to 1,350 W | up to ~+5%: 64K cold prefill 50,119 → ≤ ~52,600 tok/s; 1M-token first token 33.2 → ≥ ~31.6 s | ≈ 0% | Not packaged for this image. May not trigger (above). Possible 950 W trap (below). |
| Swap the 6000 for a ≤ 75 W card | 1,600 W | up to ~+5% vs a lane that is already 2.1× slower | lose the sidecar: −33% at 1 user, −67% at 16 users | Absurd trade. Listed only to show the scale. |
| A 600 W RTX PRO 6000 Workstation Edition | 950 W | worse, at any voltage | likely worse at 32 users | Don't. 240 V doesn't rescue the >300 W row either. |
The ≤ 75 W row's decode losses are the sidecar post's own gains run backwards (279 → 187 tok/s at 1 user, 1,577 → 524 at 16 users). The 1M first-token figure is the ≤ 5% bound applied to the measured 33.2 s. It wasn't measured with more power.
So the number James asked for: with this card, at this outlet, the power budget costs the lane up to about 5% on long cold prefills and nothing that matters in decode, and 240 V recovers none of it. For agent traffic, where most prompt tokens are prefix-cache hits and the time goes to decode, it's well under 1%.
Running well on 120 V
DO Free, and worth doing now
- Measure the outlet under load once. A plug-in meter that shows volts, read during a long-prefill burst, is the only way to check the supply's band, because the Station has no input-voltage sensor. The bar is 115 V. A drop of a few volts under load is normal. A 50 ft run of 12 AWG carrying 13–15 A drops about 2.1–2.4 V, so an outlet that idles at 117 V would land near 114.6–114.9 V. That's the one way 120 V really can cost you.
- Keep the Station alone on a dedicated 20 A circuit, with no power strip. This is now a fact, not a recommendation: as of 2026-10-22 the Station is on its own dedicated 20 A circuit — its own breaker, nothing else on it. The measured peak in sidecar prefill is a 1,353 W module plus a 194 W card, 1,547 W DC. Add 60–120 W for fans, pumps, drives and the NIC and it is 1,607–1,667 W DC, which at 89–92% supply efficiency is 15.0–15.6 A at 120 V. The NEC continuous limit on a 20 A circuit is 16 A, so the margin is 0.4–1.0 A — real, but thin enough that the circuit staying dedicated is not a preference. A 15 A circuit (12 A continuous) is not remotely enough.
- Let prefix caching carry agent traffic. The cap only bites on cold, long prompts. Warm multi-turn agent turns reuse their prefix and spend their time in decode, where we lose nothing.
Edited 2026-10-22 07:01 CDT (Milo, session model custom/dsv41-flash-uva). Three corrections, none of which change the analysis or the verdict: the dedicated circuit is now confirmed by James rather than assumed; the prefill current is measured from the same SC5 trace instead of estimated; and the earlier 12.2–13.4 A figures divided DC draw by 120 V without dividing by supply efficiency first, which understated current by roughly 10%.
TEST Bounded experiments, unmeasured
- Spend the 6000's stranded watts. The 6000 peaked at ≤ 203 W against a 300 W bucket, so ~100 W sits idle in a bucket the GB300 can't touch. Every expert moved from the GB300 to the 6000 moves its compute from the capped bucket to the slack one. The 285/99 map (10 more experts per layer on the 6000, and 6.09M KV tokens instead of 2.54M) is already on the list. It missed its cosine bar by 0.00015. If it gets re-tested, add a power column. The effect on prefill throttling is unmeasured.
- Ask MSI about
vsloshdbefore installing anything: which component writes the 1,250 W cap, whether the daemon is supported on this image, and whether it reads the 6000's maximum as its 300 W rating or its 325 W policy limit. The 325 W reading would drop the module to the 950 W row. Upside is capped at ~5% of prefill and may be zero.
DON'T Things that look like fixes and aren't
- Lowering the 6000's power limit (
nvidia-smi -pl 250). The module cap is keyed on the card's rating, not its current limit, and nothing reallocates the freed watts. It only slows the sidecar. - Raising the module limit (
-pl … --scope 1). The host already requests 1,600 W. The platform enforces 1,250 W below it. - A firmware update "for power." No NVIDIA, MSI or Exxact document ties the cap or sloshing to a BIOS, BMC or VBIOS version.
- A bigger card. Anything over 300 W puts the module in the 950 W row.
When 240 V is worth it
240 V isn't useless. It just buys margin and efficiency instead of speed:
- Sag immunity. 240 V keeps the supply deep inside its 1,600 W band no matter how the branch circuit behaves. If the meter test above shows the outlet under 115 V during prefill, this becomes the fix.
- Half the current. About 7.5–7.8 A instead of 15.0–15.6 A at the peak, which would leave room on the circuit for anything else. We already have a dedicated circuit, so this buys margin we do not need.
- A point or two of efficiency. 80 PLUS Platinum requires 92% / 89% at 50% / 100% load on 115 V and 94% / 90% on 230 V. At ~1.4 kW DC that's about 20–30 W less heat in the room. It isn't more speed.
- Cost: an electrician, a NEMA 6-20 receptacle and a C19 → 6-20P cord. The DGX Station is designed around a 120 V / 20 A circuit, and this box is running at its design point.
Our call: leave the Station on 120 V, run the meter check once, and spend effort on the 6000's stranded budget rather than on wiring.
Correction to the sidecar post
The sidecar post said the 6000 "idles about 84 W higher while holding 3,560 experts." That number was a p99 from SC5's 60-second idle window, and the first ~19 seconds of that window were the previous load phase cooling down (106 → 36 W). The rest of the window sat at 28–35 W, against 19–23 W with the GB300-only lane. Live this morning (06:24–06:30 CDT, lane serving, GB300 idle) the 6000 alternated between ~18–22 W at its 180 MHz floor and 70–98 W at ~2.3 GHz. I haven't pinned down what holds it in that higher state. The honest statement is that the sidecar's idle cost runs from about +10 W to about +80 W. Under the static split that power comes from the wall, not from the GB300's budget. The sidecar post now says this and links here.
Method and receipts
- Power trace: SC5 card,
sc5_power.py, one sample per second of both GPUs (power.draw,module.power.draw.average/.instant,module.enforced.power.limit,clocks.sm,clocks_event_reasons.sw_power_capplus its µs counter, HW power-brake and thermal flags) and the Grace ACPI power-meter channels. v23 arm 00:38–01:04 CDT, v25 arm 01:14–01:35 CDT, October 22. Phase windows come from the runner's own timestamps. Clock and module statistics in this post were recomputed this morning from the rawpsamples-*.jsonlfiles. - Prefill bursts: 4 concurrent 64K-token prompts × 4 bursts, and 32 concurrent 8K prompts × 3 bursts, about 262K prompt tokens per burst. v23 took 9.6–10.3 s per burst (25,600–27,300 tok/s), v25 took 4.4–5.1 s (52,000–59,900 tok/s).
- Box state:
nvidia-smi -q -d POWER,PERFORMANCEat 00:37 CDT and again at 06:24 CDT (module Current 1,250 W / Requested 1,600 W; GB300 GPU limit 1,300 W; 6000 limit 300 W, range 250–325 W; max SM clock 2,070 MHz; HW Power Braking 0 µs on both GPUs; driver 595.91.07).vsloshd/nsmdunits inactive; no DCMI power reading. - Estimates: wall draw, line drop (12 AWG at 1.588 mΩ/ft per conductor) and the sloshing walk were computed in this session, not measured. The ≤ 5% speed bound assumes prefill time scales with 1/SM clock.
- Not measured: line voltage, wall power, prefill speed with a larger budget, and
vsloshdbehavior on this image.
Credits
- Level1Techs (Wendell), MSI XpertStation WS300 review: the 240 V recommendation, the 3–7% estimate, and module power numbers from training. Their measurements are theirs, not reproduced here.
- NVIDIA, DGX Station Development Guide: Dynamic Power Sloshing, for the budget table and the sloshing algorithm.
- MSI (WS300 specifications) and StorageReview for the power-supply ratings. 80 PLUS thresholds from the 80 PLUS program.