Cyber Model Arena (opens in new tab)

(wiz.io)

2 pointsgalnagli1mo ago2 comments

2 comments

I'm wondering why they have decided to airgap the models inside docker containers. IMO, this would have been a better comparison if the models were allowed to perform tool calls.

galnagliOP1mo ago

General-Purpose Cyber Benchmark for AI Agents and their Models

j / k navigate · click thread line to collapse

Cyber Model Arena (opens in new tab)

(wiz.io)

2 pointsgalnagli1mo ago2 comments

2 comments

rollingstone231mo ago

I'm wondering why they have decided to airgap the models inside docker containers. IMO, this would have been a better comparison if the models were allowed to perform tool calls.

galnagliOP1mo ago

General-Purpose Cyber Benchmark for AI Agents and their Models

j / k navigate · click thread line to collapse