EMNLP 2026 · Main Conference

CamoDocs: A Poisoning Attack Against Retrieval-Augmented Language Models Using Camouflaged Documents

Jaewon Jung1, Haizhong Zheng2, Hongsun Jang1, Jaeyong Song1, Beidi Chen2, Jinho Lee1

1Seoul National University    2Carnegie Mellon University

TL;DR — CamoDocs poisons a RAG knowledge base without putting the query in the document. It disperses poisoned-document embeddings with dispersion tokens, and applies coherence filtering to limit readability degradation.

The problem with existing attacks

They include the query in the poisoned document to win retrieval — which is exactly what makes them easy to filter.

Query inclusion versus CamoDocs
Unlike query-inclusion attacks that are easily filtered, CamoDocs injects dispersion tokens to evade defenses and induce the target incorrect answer.

How CamoDocs works

CamoDocs pipeline
CamoDocs generates benign and adversarial sub-documents, optimizes the benign parts with dispersion tokens and coherence filtering, and merges the optimized benign sub-documents with the adversarial ones to create poisoned documents.

1Preparing the Ingredients

A synthesizer LLM drafts benign and adversarial passages for the target query, and both are chunked into sub-documents.

2Token Manipulation

An optimization loop replaces tokens in the benign sub-documents with dispersion tokens that spread their embeddings apart, reranked by a coherence model to limit readability degradation. Each optimized benign sub-document is then merged with its paired adversarial sub-document.

Why it evades clustering defenses

Poisoned documents from prior attacks cluster tightly, which is what erasure-based defenses detect. Dispersion tokens weaken that signature.

Embedding analysis
Analysis of document embeddings. (Left) t-SNE of query, benign, and adversarial document embeddings for each attack. (Middle) Average internal distance among adversarial embeddings. (Right) Average pairwise distance between benign and adversarial embeddings.

Results

Attack success rate (%) against seven defenses on HotpotQA. Bold marks the best value in each column; red-shaded rows are ours.

Qwen3-8B
AttackQuery DetectionDivide-and-VoteRobustRAGIsolation ForestLLM FilterRerankTrustRAGAvg.Min.
PoisonedRAG9.0061.7052.4063.9061.0063.107.9045.577.90
PIA3.8023.8060.2052.4027.6072.007.9035.393.80
CorruptRAG4.1022.3073.6056.7074.0077.5025.7047.704.10
CamoDocs77.2070.6064.4076.1070.9057.9023.4062.9323.40
CamoDocs + Query9.4072.9065.6078.2072.1071.708.5054.068.50
Llama-3.1-8B
AttackQuery DetectionDivide-and-VoteRobustRAGIsolation ForestLLM FilterRerankTrustRAGAvg.Min.
PoisonedRAG7.6055.1052.9061.6060.0061.708.2043.877.60
PIA5.4013.9043.2050.3031.4070.107.9031.745.40
CorruptRAG5.5020.4050.5053.2071.0080.5030.0044.445.50
CamoDocs75.2059.2053.1076.1071.2061.8029.1060.8129.10
CamoDocs + Query7.8059.7057.6076.1072.6071.0010.4050.747.80
Mixtral-8x7B
AttackQuery DetectionDivide-and-VoteRobustRAGIsolation ForestLLM FilterRerankTrustRAGAvg.Min.
PoisonedRAG8.9059.0047.3064.5063.5066.408.4045.438.40
PIA7.6013.7038.7046.5031.5062.209.7029.997.60
CorruptRAG7.6016.9050.5050.6071.6074.3028.0042.797.60
CamoDocs78.0066.4053.0076.1071.0066.4027.1062.5727.10
CamoDocs + Query9.3066.6050.1077.4073.1076.6010.1051.899.30

Proprietary victims

CamoDocs remains effective against closed-source victim LLMs on HotpotQA. Bold marks the best value in each column; red-shaded rows are ours.

GPT-5.4-mini
AttackQuery DetectionDivide-and-VoteRobustRAGIsolation ForestLLM FilterRerankTrustRAGAvg.Min.
PoisonedRAG9.2060.4052.4062.2062.8061.305.6044.845.60
PIA6.3014.5024.7062.4038.3071.4014.6033.176.30
CorruptRAG5.9015.2031.8056.4075.2082.4019.4040.905.90
CamoDocs75.5069.4061.3075.7070.0056.8023.9061.8023.90
CamoDocs + Query9.9069.0060.6074.8070.7065.107.8051.137.80
Claude-Haiku-4.5
AttackQuery DetectionDivide-and-VoteRobustRAGIsolation ForestLLM FilterRerankTrustRAGAvg.Min.
PoisonedRAG1.9056.5047.3061.2065.0062.503.7042.591.90
PIA1.6015.9052.3017.7021.4014.303.9018.161.60
CorruptRAG2.0025.9061.5029.2055.0048.803.5032.272.00
CamoDocs72.2063.7056.2072.2067.7045.308.3055.098.30
CamoDocs + Query1.6065.5061.1073.6069.5057.004.0047.471.60

Additional embedding visualizations

t-SNE across datasets and retrievers
Additional t-SNE visualization of the query, benign documents, and adversarial documents produced by each method.

Citation

@misc{jung2026camodocs,
      title={CamoDocs: A Poisoning Attack Against Retrieval-Augmented Language Models Using Camouflaged Documents},
      author={Jaewon Jung and Haizhong Zheng and Hongsun Jang and Jaeyong Song and Beidi Chen and Jinho Lee},
      year={2026},
      eprint={2608.28389},
      archivePrefix={arXiv},
      primaryClass={cs.CR},
      url={https://arxiv.org/abs/2608.28389},
}