PyTorch is an open-source deep learning framework maintained by Meta, built around Python tensors and dynamic neural networks with GPU acceleration. Recent coverage centers on backends and performance: PyTorch 2.15 added FP8 and 5–6.5x faster MoE decoding on Mac MPS, while Hugging Face introduced TorchTPU and TorchNeuron so Transformers and Diffusers run natively on TPU and AWS Trainium. Tutorials on manual transformer backpropagation and GPT-2 KV caching also appeared.
Developer releases manual transformer autograd in PyTorchA developer published a minimal, self-contained PyTorch implementation of manual backpropagation for a transformer-based classifier, aimed at building intuition for autograd internals, with a GitHub repo and Colab notebook.
Practical notes for GPU kernel dev setupAn r/MachineLearning post collects setup pitfalls for GPU kernel development: CUDA 13 drops Maxwell, Pascal and Volta, so toolkits must match compute capability; PyTorch's bundled CUDA runtime says nothing about nvcc availability; and GPU launches are async, so naive timing measures queueing and requires warmup, sync and CUDA events.
Deepity releases C++/CUDA predictive coding library, edges JAX baseline on MNISTA developer released Deepity, a from-scratch predictive coding engine in C++20 with hand-written AVX2/AVX-512 kernels, a CUDA backend and Python bindings. In matched MNIST benchmarks it reached 98.21% accuracy in 487.5s, beating jpc's 97.55% and ngc-learn's 98% in 1707.7s.
Raschka releases from-scratch reasoning model video courseSebastian Raschka released an eight-video, 11-plus-hour course that builds reasoning models from a pre-trained LLM in Python and PyTorch, covering evaluation, inference-time scaling, reinforcement learning and distillation. It is a sequel to his earlier coding LLMs course.
Developer proposes speculative decoding using 2-bit draft plus RAM residualA developer published a Hugging Face repo that keeps a 2-bit draft model in VRAM and a 6-8 bit residual in system RAM, sending only activations over PCIe so the draft costs no extra memory. Tests show a 6-bit residual nears Q8_0 quality while reading about 28% fewer bytes.
Hugging Face adds native TorchTPU PyTorch backendHugging Face said TorchTPU gives PyTorch a native TPU backend, so Transformers, Diffusers and Kernels run on TPU by simply sending a model to "tpu". It includes TPU-tuned Pallas kernels and distributed-training support; the previously used Optimum TPU is no longer required.
PyTorch 2.15 brings FP8 and faster decoding to Mac MPSHugging Face's PyTorch team detailed MPS backend gains in PyTorch 2.15: FP8 support, MoE decoding 5–6.5x faster than 2.14, and Qwen3.6-35B-A3B rising from 9.4 to 61.3 tokens/s on an M3 Ultra. Softmax is about 8x faster, and Wan2.2 video VAE decode peak memory drops from 270 GiB to 8 GiB.
Open GPU kernel engineering series covers GEMM to FlashAttentionA developer launched a free 44-session GPU kernel engineering video series progressing from naive GEMM to FlashAttention, covering H100 and Blackwell topics such as TMA, WGMMA, CUTLASS, and FP8/NVFP4, with code public and the series still in progress.
Hugging Face adds native Trainium support via TorchNeuronHugging Face detailed TorchNeuron, a native PyTorch backend for AWS Trainium supporting eager mode, torch.compile and distributed APIs such as FSDP. Transformers and Diffusers can now run directly on Trainium instead of via Optimum Neuron; a public beta opens Oct. 20, 2026 via pip.
Building GPT-2 KV Cache from Scratch and Measuring PerformanceA developer implemented a KV cache for GPT-2 small from scratch in PyTorch and measured latency and memory. At context length 1000, caching reduced per-token time from 29.69 ms to 4.95 ms, and generating 1016 tokens from 14.66 s to 5.03 s. Cached and uncached greedy generation matched over 200 tokens.
Intel Unveils D270 Inference GPU for Agentic AI WorkloadsIntel launched the D270, an inference-optimized data center GPU with up to 480GB LPDDR5X memory and no HBM, using 32 Xe3P cores and 256 XMX engines to accelerate prefill. The air-cooled PCIe card targets tokens-per-watt efficiency for agentic AI's long contexts and concurrent sessions.
pytorchTensors and dynamic neural networks in Python with strong GPU acceleration.
pytorchTensors and dynamic neural networks in Python with strong GPU acceleration.
PyTorchTensors and dynamic neural networks in Python with strong GPU acceleration.
Woven by Toyota MLE Interview Focuses on PyTorch DebuggingA candidate preparing for a Woven by Toyota perception MLE interview describes a round focused on ML coding and debugging: Python fundamentals, PyTorch tensor operations and dimensions, common training patterns, and silent failures. He lists what he has practiced and seeks further advice.
MaRN: a PyTorch library for low-dimensional parameter mappingThe author released MaRN, a PyTorch library that optimizes a compact latent representation instead of all model parameters. Benchmarks show an MNIST CNN cut from 107,998 to 1,872 trainable parameters (57.7x) at 91.80% accuracy, though mapped models train much slower; the author calls results exploratory, not evidence of general superiority.
Laya adds OpenVINO support: 40 ms per question on CPUDeveloper Rupesh added OpenVINO support to Laya, achieving 40 ms per question on CPU, 3.4x faster than PyTorch. The project is open-sourced on GitHub with a Flappy Bird demo.
DiffusionGemma: parallel text generation from scratch in PyTorchA researcher shared DiffusionGemma, explaining how a diffusion language model generates text in parallel and implementing it from scratch in PyTorch, exploring non-autoregressive text generation.
Foundation Model Engineering textbookFoundation Model Engineering is a technical textbook for engineers and research-focused readers that explains architectures, training and inference pipelines, retrieval, evaluation, and engineering trade-offs; it includes concept-focused PyTorch examples, quizzes, and interactive visualizers to build coherent engineering judgment.
OpenArch — PyTorch implementations of modern LLM architecturesOpenArch is a hand-written PyTorch repository implementing modern open-source LLM architectures one model at a time, prioritizing readability and learning. It documents various attention types, normalization choices, and positional encodings; some implementations support forward passes.
Advice for hobbyists: don’t let FOMO drive local LLM spendingAdvice to hobbyists: don’t let FOMO drive costly local LLM setups—learn via APIs or small models that fit existing hardware; you can gain more by doing less rather than buying expensive GPUs.
The A.I. Daily