A100
7 storiesThe A100 is Nvidia's Ampere-generation data-center GPU, offered in 40GB and 80GB HBM versions. Recent coverage centers on its pricing and secondary market: community reports say A100 prices fell another 20-30%, with used 40GB SXM4 cards possibly heading toward $1,000, while RTX 6000 prices slipped from an $18,000 peak. Other stories include a developer voltage-glitching a CMP 170HX mining card into roughly 80GB, a decommissioned 9,600-A100 supercomputer listed on eBay for $60 million, and a paper finding the A100 cheaper than the H100 for gpt-oss-120b inference.
Related topics
A LocalLLaMA post says A100 prices have dropped another 20-30% since its earlier collapse warning, while RTX 6000 fell to $14,800 from an $18,000 peak. The author argues Rubin and Blackwell are 3-4x more efficient per watt with more financing available, A100s cannot be used for inference, and remaining buyers are price-sensitive hobbyists and small renters.
Developer Kate used voltage fault injection to bypass the fuse lock on an 8GB CMP 170HX mining card, restoring ~80GB of HBM and all SMs, reaching 85.9 TFLOP/s FP16 versus 72.5 on a retail A100. The mod needs a custom STM32 glitcher and 1–48 hours per card, and one of ten cards kept only 64GB.
Community reports indicate RTX 6000 workstation GPU prices fell from a peak of $18k to $16.5k, with MaxQ at $14k. Many A100s are being dumped, with used A100 40GB SXM4 potentially dropping to $1k. Increased supply and potential policy shifts may signal slowing demand.
A researcher is weighing a 32GB MacBook Pro against a Mac Mini for local model inference. Training is already covered by university access to B200, A100 and L40 machines, so the purchase targets inference only.
An IT vendor listed a decommissioned AI supercomputer on eBay for $60 million, featuring 9,600 Nvidia A100 GPUs and 4,200 AMD EPYC CPUs across 300 racks, with free shipping.
An amateur ML researcher working on drug repurposing for his wife's stage 4 colon cancer faces rising GPU costs. He trains NBFNet models on Google Vertex A100s but batch size drops to 64 due to memory limits, and he seeks cost-optimization strategies.
A paper finds open-weight inference costs about one-fifth of comparable closed models, with self-hosting at $0.12-$0.35 per million output tokens. On gpt-oss-120b, the A100 is cheaper than the H100, and A100 five-year rental prices retain 80% of one-month prices, showing older GPU families keep multi-year earning life.
That is everything