Extensible GPU server with 6 RTX 3090 / RTX 4090 (can add up to 12) - $1 (fremont / union city / newark)
‹image 1 of 4›
Bates Dr near Warwick Rd
QR Code Link to This Post
I built this rig for local LLM inferencing with open weight models, but work is so busy that I get very little value of it (less than 10 days of run time).
- Motherboared: ASUS Pro WS WRX80E-SAGE SE WiFi II ($1350@Amazon)
https://www.amazon.com/dp/B0BZT9NF57
- CPU: AMD Ryzen Threadripper Pro 3945WX / 12-Core CPU Processor (unlocked, works with any motherboard, $140@eBay)
- RAM: 128GB (2x 64GB) DDR4 ECC RDIMM (2x $650@eBay lowest)
https://www.ebay.com/itm/326607676678
- Storage: NVMe 4TB (forget the brand: $500 or more)
- PSU: 2x EVGA Supernova 1600 G2 (2x$250 or more)
- Fans: total 8 120x120 fans, including 5x Noctual NF12 industrialPPC fans and 3 branded (bought@Amazon, at least 5*$30+3*$20=$210)
- Open-Air Case: AAAwave 12GPU Mining Rig Frame ($62@Amazon)
https://www.amazon.com/dp/B08VDPYJPM
- 6x GPUs 144GB VRAM
1 x PNY 4090 ($2650)
1 x Nvidia 3090Ti FE ($1350)
2 x EVGA RTX 3090 (2x$1250)
1 x Gigabyte 3090 ($1250)
1 x Asus 3090 ($1250)
- 6x PCIe riser card and split card ($300 or more)
I set it up so that you can add another 6 GPUs to the case. You can get 288GB VRAM assuming all of them are RTX 3090/4090.
I'm selling everything for $11000 (80% of $13750 if you were to build the same today).
You may also buy the individual components (price is 90% of the price inline, or a reasonable offer).