GPU TASK Valid result

Sketch-and-Text Image Search

MiMo-V2.6-Flash · Codex (v0.164.0) · reasoning effort high

Task description ↗Task at evaluation revision ↗← Previous task Next task →

Task score (%)1.4

Input Tokens20,011,474including 19,133,632 cached

Output Tokens88,443

Agent time1h 52min

Cost$0.20

Recorded steps175

Cost is estimated from recorded agent tokens at official API rates in USD (2026-11-01; DeepSeek off-peak pricing).

Loading trajectory…

Select this tab to browse the saved files.

Coding time & token usage

Original agent completion: normal
Coding started: 2026-10-25T09:15:00.719341Z
Coding finished: 2026-10-25T11:07:46.704131Z
Input (includes cache): 20,011,474
Cached input (subset): 19,133,632
Cache writes (subset): 0
Output: 88,443
Reasoning (reported separately; not added): 13,425
Recorded responses: 172

Input includes cached input; output is counted once. Auxiliary reasoning counts are shown as recorded. Regrading does not repeat coding usage.

Select this tab to browse the saved files.

Configuration

Evaluation settings summary

{
  "agent": "Codex",
  "agent_timeout_sec": 21600.0,
  "coding_commit": null,
  "effort": "high",
  "model": "xiaomi/mimo-v2.6-flash",
  "provider": "OpenRouter",
  "resources": {
    "cpus": 8,
    "gpus": 1,
    "memory_mb": 32768,
    "storage_mb": 102400
  },
  "run_mode": "official_harbor_regrade",
  "task_commit": "052045836520335c1caa5e4a06ed887faacef55f",
  "verifier_commit": "052045836520335c1caa5e4a06ed887faacef55f",
  "version": "0.164.0"
}

Select this tab to browse the saved files.

Resolved configuration

Select this tab to browse the saved files.

Trial log

Select this tab to browse the saved files.

Exceptions

Select this tab to browse the saved files.

Select this tab to browse the saved files.

Trajectory downloads & provenance

Exported ATIF trajectory (.json.gz) ↓Final evaluation (.json) ↓

Public text redacts private values and normalizes host paths. Source hashes identify the original records.

Trial ID: sketch-text-search-mimo-v2.6-flash-high-a6d02b1f0a15
Source trajectory SHA-256: 6bacd10754a3fb121a8871104931fedd5a9dd4343aa315c8ed1091b13460abd2
Final reward SHA-256: 6fda1d666b4557198357e8e804b7ebff59ce5491b01663c2b2b40f57caf8b28f