Detailed comparison for LLMs
Alibaba Qwen2 7B Instruct and DeepSeek DeepSeek VL2 are evenly matched at about 52.0% attack success rate (ASR) on Guardion's LLM vulnerability Benchmark. One or both scores are estimated from public safety evaluations pending a Guardion benchmark run.
It's a close match between Qwen2 7B Instruct and DeepSeek VL2!
ASR for Alibaba Qwen2 7B Instruct vs DeepSeek DeepSeek VL2. Green marks the safer model on each metric. Only the overall score is available for estimated models.
No specific highlights generated for this comparison.
Outward is better on every axis.
Alibaba Qwen2 7B Instruct and DeepSeek DeepSeek VL2 are evenly matched at about 52.0% attack success rate (ASR) on Guardion's LLM vulnerability Benchmark. One or both scores are estimated from public safety evaluations pending a Guardion benchmark run.
Qwen2 7B Instruct has a 52.0% ASR and DeepSeek VL2 has a 52.0% ASR — the share of adversarial prompts that succeed across zero-shot, TAP, and Crescendo attacks. Lower is safer.
Both were red-teamed with the HarmBench framework across zero-shot, TAP (Tree of Attacks with Pruning), and Crescendo multi-turn attacks, scored by Attack Success Rate.