The benchmark

A free Ai makes a mess of your document.

Hand a PDF to a free local Ai and it blacks out far more than the private parts. Here's the same phone bill, shown three ways: the original, then Bleep, then a free Ai called Gemma.

The top of an AT&T phone bill shown three times: the original, Bleep's version, and Gemma 3's. Bleep hides the customer's name, address, and account number and leaves the rest readable. Gemma 3 hides those too, but also blacks out the amount due, the payment date, and AT&T's own support phone numbers and website.
In the red panel on the right, the free Ai (Gemma, by Google) blacked out the amount due, the date, and AT&T's own support numbers, none of it private. Bleep, in green, hid only the personal details.

You can always take it back

When an Ai buries your PDFs in over-redactions, you're stuck. There's no quick way to correct its errors. Bleep is the opposite: Hold ⌥ Option and drag across any redaction you want removed.

The full bake-off

Notice how slow local LLMs are at redacting PDFs. While Bleep takes seconds, most local Ai's take minutes.

Also, notice the mess they make by over-redacting hundreds of words that shouldn't have been redacted. Bleep is fast and clean. And gives you the tools to touch up anything missed.

Engine Personal info caught Wrongly hidden Avg time / PDF
Bleep86%169s
Gemma 4 12B Google90%781.4m
Gemma 3 Google78%72348s
Phi-4 Microsoft70%711.3m
Qwen 2.5 Alibaba68%15750s
Llama 3.1 Meta59%22846s
Apple on-device Apple49%5641.7m

Last updated June 15, 2026  ·  Bleep v0.13.3. Every engine redacted the same 15 real-world documents. Real PDFs, scored against a Claude gold standard. Re-run before every release.