← all model tests
Scopernot asked
opening turn asks not compiles
Given one sentence, the only correct move is to ask. An agent that compiles a nine-step procedure from a job title has invented the entire thing, and every future record inherits it.
The agent was never properly asked, so there is nothing to score either way.
modelgemini-3.5-flash
temperature0
scenarioscenarios/scoper/opening-turn-asks-not-compiles.json
Why this was never asked
Nothing was scored for or against the agent here. The suite reports this as its own outcome rather than a failure, because an agent asked an incomplete question will still confidently answer it.
no cassette c600794d88bd for this input; re-run with --live to record it
What the model was given