Your LLM Pipeline Pays Full Price for Documents It Has Already Read: A Near-Duplicate Gate That Doesn't
A tested MinHash LSH gate that blocks near-duplicates before they hit your LLM: scaling math, measured precision and recall, and the decision-field trap.
18 min read