RTX 3090
7 storiesThe RTX 3090 is an NVIDIA consumer GPU released in 2020 with 24GB of memory, often used for local LLM inference. Recent r/LocalLLaMA posts focus on hands-on builds and hardware conditions: a dual-GPU NVLink rig running Qwen3.8-27B via vLLM, and single-card runs of a 4-bit Qwen 27B for 63 hours and over 50M tokens, or an agent running about 21 days and roughly 230M tokens. One post notes eBay buy-now prices near $1,500, up from about $1,200 weeks earlier.
Related topics
A user bought two RTX 3090 Founders Editions for €1,700 on Facebook Marketplace, bringing his total to three cards (72GB of VRAM), but his standard B760 motherboard and small case cannot fit three 3-slot GPUs. He is asking the community for low-cost options, such as an open-air mining frame with PCIe 4.0 risers and dual PSUs, or selling the third card (about €1,100) to keep 48GB of VRAM.
A LocalLLaMA user says an earlier viral warning about the RTX 3090 now makes sense and asks whether others can confirm it. The poster speculates that restrictions originally aimed at mining demand may have been lifted and could benefit LLM workloads. No data is presented.
A Reddit user shared their experience debugging PCIe link retraining with two RTX 3090 GPUs on an x8/x8 splitter, a technical discussion about local LLM hardware setups.
A Reddit user notes the cheapest 'buy it now' RTX 3090 on eBay now nears $1,500, up from about $1,200 weeks earlier, signaling tight GPU supply and rapidly rising prices.
A Reddit user showcased a homemade '2400cc Inference Racer': two used RTX 3090s linked via NVLink, driven by a bare 7840U ThinkPad motherboard, cooled by a VW Golf radiator and about 2.4 litres of coolant, with PCIe routed through WWAN and SSD slots and a patched BIOS. It runs Ubuntu and serves Qwen3.8-27B via vLLM.
A user ran a quantized Qwen 27B locally on a single RTX 3090 for about 21 days with the goal of having the agent build its own CUDA inference engine. The run consumed roughly 230M tokens, spent about 83 hours in 699 compactions, and reached about half of llama.cpp's prefill speed while producing working kernels and benchmarks.
A Reddit user ran a 4-bit quantized Qwen 3.8 27B on an RTX 3090 with a 100K context window for 63 hours (over 50M tokens) to attempt the Riemann Hypothesis; it didn’t solve it but produced internal memory and strategy logs published on Hugging Face.
That is everything