PROMPTPurify: 14 MB CPU-only prompt-injection guard (benchmarked vs. OSS guard)
PROMPTPurify is a lightweight, CPU-only prompt-injection guard designed for LLM chat applications. It offers a small installation size and operates without the need for GPUs or additional services. Developed by SecureLayer7, it aims to provide a more efficient alternative to existing open-source guardrails.
- ▪PROMPTPurify has an installation size of approximately 14 MB and runs on CPU only.
- ▪It is designed to be a drop-in guard between user input and LLMs, functioning on the same machine without requiring external services.
- ▪The model was built from scratch to achieve a favorable size and latency tradeoff, and it is MIT-licensed for use in production.
Opening excerpt (first ~120 words) tap to expand
promptpurify Tiny prompt-injection firewall for LLM chat apps. ~14 MB. CPU-only. Drop-in guard between your user input and your LLM — runs on the same box, no GPU, no API, no extra service. Built by the SecureLayer7 red-team. Most OSS guardrails are hundreds of MB, want a GPU, and still miss the attacks we see in production. We needed something we could ship inside our own AI products and our customers' apps without any of that. Why this exists promptpurify typical OSS guardrail Install size ~14 MB ONNX 180 MB – 7 GB Inference CPU, single-digit ms GPU recommended Where it runs In your Node process Sidecar or hosted API Cost per call $0 $ or GPU compute Benchmark comparison vs OSS baselines → docs/BENCHMARKS.md.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at GitHub.