Post explains locked FP32 accumulation on RTX consumer cards
A LocalLLaMA post claims Nvidia deliberately throttles FP32-accumulation throughput on consumer GPUs for market segmentation: RTX cards from Turing to Blackwell 2.0 see halved FP16/BF16 (and FP8 on Ada and later) performance, hurting LoRA training, diffusion and LLM prefill, while pro and data-center cards are unaffected.