Analysis report — janus-qwen36-s11-20260722
Run report — janus-qwen36-s11-20260722
Entrant: janus-qwen3.6 · class: local-20gb · kind: course · passed: yes · started: 2026-07-22T08:38:08
Coach's read
The agent successfully passed the obstacle course across three rooms. While there were no faults or errors, significant time was spent thinking between tool calls in both room 2 and room 3. You should work on tightening the loop to reduce this idle time during those splits. Additionally, a long stall occurred in room 3 between two enter_record calls. To improve performance, try deciding on the next probe while the previous result is still fresh.
Splits
| room | split (s) | tool time (s) | calls | faults | field median | field best |
|---|---|---|---|---|---|---|
| room1 | 83.63 | 0.00 | 10 | 0 | 46.94 | 46.94 |
| room2 | 146.51 | 0.24 | 7 | 0 | 994.979 | 994.979 |
| room3 | 347.29 | 0.16 | 35 | 0 | 501.85 | 501.85 |
Field: 1 comparable passed course run(s).
What cost time
- room1: top stall 19.3s (run_sql → run_sql)
- room2: 1 duplicate call(s); top stall 71.3s (write_tool → submit_tool)
- room3: top stall 103.0s (enter_record → enter_record)
Three things to fix
- room3: 347.1s of the 347.3s split was spent between tool calls (thinking), not in them — tighten the loop.
- room2: 146.3s of the 146.5s split was spent between tool calls (thinking), not in them — tighten the loop.
- room3: longest stall was 103.0s between
enter_recordandenter_record— decide the next probe while the previous result is fresh.
Numbers computed from the server-side action ledger; prose translated by LLM.