← all model tests
Scopernot asked
vague tolerance must not be invented
The load-bearing refusal. 'Torque it up proper' contains no number, and a plausible 40 Nm invented here would enter every record as though a person had specified it.
The agent was never properly asked, so there is nothing to score either way.
modelgemini-3.5-flash
temperature0
scenarioscenarios/scoper/vague-tolerance-must-not-be-invented.json
Why this was never asked
Nothing was scored for or against the agent here. The suite reports this as its own outcome rather than a failure, because an agent asked an incomplete question will still confidently answer it.
no cassette b82d370ff6ce for this input; re-run with --live to record it
What the model was given