Search-SWE
GPU TASK Valid result

Quantity-aware Retrieval

GPT-6 Luna · Codex (v0.164.0) · reasoning effort max

Task description ↗Task at evaluation revision ↗← Previous taskNext task →
Task score (%)0.0
Input Tokens12,673,530including 12,491,690 cached
Output Tokens136,920
Agent time45min
Cost$0.22
Recorded steps100

Cost is estimated from recorded agent tokens at official API rates in USD (2026-11-01; DeepSeek off-peak pricing).

Loading trajectory…

Select this tab to browse the saved files.

Coding time & token usage
Original agent completion
normal
Coding started
2026-10-24T09:32:25.083253Z
Coding finished
2026-10-24T10:17:55.539585Z
Input (includes cache)
12,673,530
Cached input (subset)
12,491,690
Cache writes (subset)
181,549
Output
136,920
Reasoning (reported separately; not added)
98,192
Recorded responses
97

Input includes cached input; output is counted once. Auxiliary reasoning counts are shown as recorded. Regrading does not repeat coding usage.

Select this tab to browse the saved files.

Configuration

Evaluation settings summary
{
  "agent": "Codex",
  "agent_timeout_sec": null,
  "coding_commit": null,
  "effort": "max",
  "model": "openai/gpt-6-luna",
  "provider": "OpenRouter",
  "resources": null,
  "run_mode": "saved_outputs_production_rescore",
  "task_commit": "1d73c6f9c4a90ba922b7572d9395a6f40661bbb2",
  "verifier_commit": "1d73c6f9c4a90ba922b7572d9395a6f40661bbb2",
  "version": "0.164.0"
}

Select this tab to browse the saved files.

Resolved configuration

Select this tab to browse the saved files.

Trial log

Select this tab to browse the saved files.

Exceptions

Select this tab to browse the saved files.

Select this tab to browse the saved files.

Trajectory downloads & provenance
Exported ATIF trajectory (.json.gz) ↓Final evaluation (.json) ↓

Public text redacts private values and normalizes host paths. Source hashes identify the original records.

Trial ID
quantity-aware-retrieval-gpt-6-luna-max-cd9edf6037c3
Source trajectory SHA-256
9ab9fa3491f51fbfb5c8f91db7243e3a88cf5b9b2b840fc0965dcc72c1786537
Final reward SHA-256
f66fa05485f7ec607f0185efa8023b6263e0ac2539920a47f11004be20156457