4 stories tagged with #speculative-decoding, in publish-time order across the WeSearch catalog. Tag pages update as new stories ingest.
⌘ RSS feed for this tag → or search "Speculative Decoding"
ARXIV.ORG
Cassandra: Enabling Reasoning LLMs at Edge via Self-Speculative Decoding
Speculative decoding has emerged as a promising lossless approach for accelerating Large Language Models (LLMs). As reasoning LLMs increasingly suffer from decode-stage overhead an…
DEV.TO (TOP)
The Speculative Decoding Pattern
Pattern Defined Precise Definition: Speculative Decoding is an optimization pattern where a...…
ARXIV CS.AI
D-PACE: Dynamic Position-Aware Cross-Entropy for Parallel Speculative Drafting
Speculative decoding accelerates LLM inference by having a small drafter propose tokens that a larger target model verifies in parallel. Recent diffusion-based parallel drafters su…
R/LOCALLLAMA