openvino

5 stories

OpenVINO is Intel's open-source toolkit for optimizing and deploying AI inference. Recent coverage focused on small-model inference on consumer CPUs: developer Rupesh added OpenVINO support to Laya, reaching 40 ms per question on CPU, 3.4x faster than PyTorch, and another user converted the 421M-parameter Laya model to OpenVINO, quantized it to INT8 and ran Flappy Bird locally on a 12th-gen Intel Core i7.

Related topics

openvino

Open-source toolkit for optimizing and deploying AI inference.

▲ 246 · GitHub Trending ·

openvino

Intel open-source toolkit for optimizing and deploying AI inference.

▲ 24 · GitHub Trending ·

openvino

Open-source toolkit for optimizing and deploying AI inference.

▲ 18 · GitHub Trending ·
That is everything