ROCm is AMD's open software stack for GPU computing, providing the programming and runtime support for hardware such as Instinct accelerators. Recent coverage mentions ROCm inside AMD's full-stack agentic AI platform alongside EPYC CPUs, Instinct accelerators and Pensando networking; a community note on ROCm 10.1 targeting the data-movement bottleneck; the Kyojin engine running 300B-class MoE models on a single 128GB mini PC via ROCm; and a ZLUDA plus ROCm/HIP setup for running CUDA applications on Windows.
AMD Unveils Full-Stack Agentic AI PlatformAMD introduced a full-stack platform for agentic AI spanning EPYC CPUs, Instinct accelerators, Pensando networking and ROCm software. Agentic AI shifts the CPU-to-GPU ratio from 1:4-1:8 for chatbots toward 1:1 or higher, alongside new embedded and PC partnerships.
ROCm 10.1 Targets Data-Movement BottleneckA LocalLLaMA Reddit user highlighted ROCm 10.1, saying it targets breaking the data-movement bottleneck, with few additional technical details provided.
300B-Class MoE Models Run on a Single 128GB Mini PCDevelopers released Kyojin, an ExLlamaV3-based engine for AMD Strix Halo (ROCm), letting two 300B-class MoE models each run on one 128GB mini PC. GLM-5.3-Flash prefills at ~580 tok/s; MiMo-V2.6-Flash decodes up to 44 tok/s, with KLD and Top-1 agreement versus official FP8 reported.
Community Urges Halt to FP4 Inference on Small ModelsAn r/LocalLLaMA post criticizes new inference engines that tout NVFP4/MXFP4 support, arguing FP4 quantization badly damages small dense models, causing hallucinations and reasoning errors, while large models can absorb minor precision loss.
Run CUDA apps on AMD GPUs in Windows with ZLUDAA reproducible setup using ZLUDA + ROCm/HIP lets CUDA-targeted Windows applications run on AMD GPUs (validated on Radeon RX 9060 XT). The repo tested official ZLUDA preview and HIP/rocBLAS stacks, validated several CUDA libraries and a 2.2M-parameter PPO workload, but warns CUDA coverage is workload-dependent.
The A.I. Daily