A100

7 stories

The A100 is Nvidia's Ampere-generation data-center GPU, offered in 40GB and 80GB HBM versions. Recent coverage centers on its pricing and secondary market: community reports say A100 prices fell another 20-30%, with used 40GB SXM4 cards possibly heading toward $1,000, while RTX 6000 prices slipped from an $18,000 peak. Other stories include a developer voltage-glitching a CMP 170HX mining card into roughly 80GB, a decommissioned 9,600-A100 supercomputer listed on eBay for $60 million, and a paper finding the A100 cheaper than the H100 for gpt-oss-120b inference.

Related topics

A100 GPU prices fall 20-30% as supply floods market

A LocalLLaMA post says A100 prices have dropped another 20-30% since its earlier collapse warning, while RTX 6000 fell to $14,800 from an $18,000 peak. The author argues Rubin and Blackwell are 3-4x more efficient per watt with more financing available, A100s cannot be used for inference, and remaining buyers are price-sensitive hobbyists and small renters.

r/LocalLLaMA ·

Some GPU Prices Are Dropping

Community reports indicate RTX 6000 workstation GPU prices fell from a peak of $18k to $16.5k, with MaxQ at $14k. Many A100s are being dumped, with used A100 40GB SXM4 potentially dropping to $1k. Increased supply and potential policy shifts may signal slowing demand.

r/LocalLLaMA ·

Economics of Open-Weight Inference: Older GPUs Retain Value

A paper finds open-weight inference costs about one-fifth of comparable closed models, with self-hosting at $0.12-$0.35 per million output tokens. On gpt-oss-120b, the A100 is cheaper than the H100, and A100 five-year rental prices retain 80% of one-month prices, showing older GPU families keep multi-year earning life.

Hacker News ·
That is everything