14 stories tagged with #inference, in publish-time order across the WeSearch catalog. Tag pages update as new stories ingest.
⌘ RSS feed for this tag → or search "Inference"
HACKER NEWS (AI / LLM)
LLM inference, visually explained: why a 13B model reads 26 GB per token
HACKER NEWS (FRONT PAGE)
An Open Field Guide to Inference Engineering
HACKER NEWS (AI / LLM)
Beyond FLOP/s: comparing AI hardware for inference by memory and communication
HACKER NEWS (AI / LLM)
FlashStates Unlocking Flexible Hybrid State Management for Agentic LLM Inference
OPENAI NEWS (GNEWS)
OpenAI Moves Research Stop Enforcement Into the Inference Path - Forkast News
HACKER NEWS (AI / LLM)
CUDA+ROCm dual-back ends LLM inference for mixed-vendor GPUs (up to 48% faster)
HACKER NEWS (FRONT PAGE)
DeepX claims inference up to 100B parameters at less than 5 W
HACKER NEWS (AI / LLM)
Ernie Evolve: automated research system for improving AI training and inference
HACKER NEWS (AI / LLM)
Hours of YouTube and 85 handtyped pages of notes on LLM Inference – Start here
HACKER NEWS (AI / LLM)
Pay per pre-configured GPU hour or per token for open-source LLM inference?
HACKER NEWS (AI / LLM)
VindexLLM – Windows Vulkan GPU GGUF LLM inference engine written in Delphi 12
HACKER NEWS (AI / LLM)
Is "GPU-hour per user" a sane way to price LLM inference?
HACKER NEWS (AI / LLM)
Everything I Wish I Knew About AI Inference Engineering [video]
HACKER NEWS (AI / LLM)