Detailed comparison for LLMs
DeepSeek DeepSeek-V3.2-Speciale and Mistral Mistral Large 3 675B Base are evenly matched at about 45.0% attack success rate (ASR) on Guardion's LLM vulnerability Benchmark. One or both scores are estimated from public safety evaluations pending a Guardion benchmark run.
It's a close match between DeepSeek-V3.2-Speciale and Mistral Large 3 675B Base!
ASR for DeepSeek DeepSeek-V3.2-Speciale vs Mistral Mistral Large 3 675B Base. Green marks the safer model on each metric. Only the overall score is available for estimated models.
No specific highlights generated for this comparison.
Outward is better on every axis.
DeepSeek DeepSeek-V3.2-Speciale and Mistral Mistral Large 3 675B Base are evenly matched at about 45.0% attack success rate (ASR) on Guardion's LLM vulnerability Benchmark. One or both scores are estimated from public safety evaluations pending a Guardion benchmark run.
DeepSeek-V3.2-Speciale has a 45.0% ASR and Mistral Large 3 675B Base has a 45.0% ASR — the share of adversarial prompts that succeed across zero-shot, TAP, and Crescendo attacks. Lower is safer.
Both were red-teamed with the HarmBench framework across zero-shot, TAP (Tree of Attacks with Pruning), and Crescendo multi-turn attacks, scored by Attack Success Rate.