Meta Llama Guard vs Meta Prompt Guard 2 86M

Detailed comparison for runtime guardrails

MetaMeta

On Guardion's Prompt Attack Risk Benchmark, Meta Prompt Guard 2 86M is the more secure of the two: Llama Guard scores NaN% and Prompt Guard 2 86M scores NaN% on F1 score (higher is better).

Head-to-Head Overview

Prompt Guard 2 86M is the overall winner in this comparison!

Guardrail Metrics

F1 Score

Llama Guard
0.000
Prompt Guard 2 86M
0.000

Accuracy

Llama Guard
0.000
Prompt Guard 2 86M
0.000

Precision

Llama Guard
0.000
Prompt Guard 2 86M
0.000

Recall

Llama Guard
0.000
Prompt Guard 2 86M
0.000

False Positive Rate

Llama Guard
0.000
Prompt Guard 2 86M
0.000

False Negative Rate

Llama Guard
0.000
Prompt Guard 2 86M
0.000

Average Latency (ms)

Llama Guard
0.000
Prompt Guard 2 86M
0.000

p50 Latency (ms)

Llama Guard
0.000
Prompt Guard 2 86M
0.000

p90 Latency (ms)

Llama Guard
0.000
Prompt Guard 2 86M
0.000

Key Highlights

No specific highlights generated for this comparison.

Security Profile

Outward is better on every axis.

F1 ScoreAccuracyPrecisionRecallFPRFNRAverage Latency (ms)p50 Latency (ms)p90 Latency (ms)
Llama Guard
Prompt Guard 2 86M
Full security profile
Meta Llama Guard
Full security profile
Meta Prompt Guard 2 86M

Frequently asked questions

Is Meta Llama Guard or Meta Prompt Guard 2 86M more secure?

On Guardion's Prompt Attack Risk Benchmark, Meta Prompt Guard 2 86M is the more secure of the two: Llama Guard scores NaN% and Prompt Guard 2 86M scores NaN% on F1 score (higher is better).

What is the F1 score of Llama Guard vs Prompt Guard 2 86M?

Llama Guard scores NaN% F1 and Prompt Guard 2 86M scores NaN% F1 on Guardion's prompt-attack benchmark. F1 balances precision and recall — higher is better.

How were Llama Guard and Prompt Guard 2 86M tested?

Both were evaluated via API at production-like sensitivity against 30+ prompt-attack categories using zero-shot, Crescendo, and TAP methods, scored by F1.

Related Comparisons