Sparsity coverage.

SparSEEty: Extracting Tokens from Sparsity-Exploiting LLM Serving Systems

Modern large language models (LLMs) exhibit activation sparsity, wherein only a subset of their neurons is activated for given input tokens. Researchers have leveraged this propert…