Intel B70: LLama.ccp SYCL vs LLama.cpp OpenVino vs LLM-Scaler

In case anyone is interested, I decided to test out LLama.cpp's new OpenVino backend to see how it compares on Intel GPUs. At first glance, it stomps all over the previous best-case, SYCL, but lags behind LLM-Scaler (Intel's VLLM fork), likely just due to the hardware optimizations against GPTQ/Int4. Interestingly tg512 was fastest on SYCL, but in real world, the prompt processing always seems the be the indicator on this card. As usual with Intel, model selection is... poor. It took a while to

More from Reddit

‘Existential Risk’: Western Car Companies Are Blowing The Software Race

Reddit

Iran court upholds death sentence for protester, 25-year term for daughter

Reddit

Apple, Google crushed California bill that helped smaller rivals

Reddit

Luce DFlash: Qwen3.6-27B at up to 2x throughput on a single RTX 3090

Reddit

GBNF grammar tweak for faster Qwen3.6 35B-A3B and Qwen3.6 27B

Reddit

Tissue regeneration moves closer to reality with lab-grown bone, muscle, and cartilage

Reddit