xonecas.io
64875
Mc

mini-coder / commit 46959dd

feat: apply terminal-bench prompt learnings

Record the latest Harbor leaderboard run and update prompt/tool guidance to prioritize contract discovery, early artifact creation, and exactness checks.

xonecas2026-04-11 46959dd8cfce26b666327f8f17c5ac1019722bbb parent 9341709

558 files changed

This diff is too big to show in full. The first 1000 lines are below, and every file is listed with its counts.

TODO.md+0−4
@@ -5,10 +5,6 @@ Don't keep completed items bloating the file, remove them before committing.
55 Keep the file structured and minimal.
66 The spec.md and code are the sources of truth, not this file, don't assume anything because it's documented here.
77
8-## In progress
9-
10-- [ ] **Terminal bench with harbor** in `terminal-bench`.
11-
128 ## Open items
139
1410 - [ ] **If git is not installed the app breaks** we should check before we use git, and ensure robustness.
spec.md+9−6
@@ -61,7 +61,7 @@ Two built-in tools, plus a read-only image tool. Plugins may add more (see [Plug
6161
6262 ### `shell`
6363
64-Runs a command in the user's shell. Returns stdout, stderr, and exit code.
64+Runs a command in the user's shell. Returns stdout, stderr, and exit code. Use it to explore the codebase, read tests/verifiers/examples, inspect required outputs, and run targeted checks, builds, or git commands.
6565
6666 Implementation details:
6767
@@ -72,7 +72,7 @@ Implementation details:
7272
7373 ### `edit`
7474
75-Exact-text replacement in a single file.
75+Exact-text replacement in a single file. Use it to write the exact file content the task requires.
7676
7777 Implementation details:
7878
@@ -266,14 +266,14 @@ You are mini-coder, a coding agent running in the user's terminal.
266266
267267 # Role
268268
269-You are an autonomous, senior-level coding assistant. When the user gives a direction, proactively gather context, plan with the user, implement, and verify. Bias toward action: use planning first to clear any assumptions with the user, then implement the plan. Deliver working code, unless you are genuinely blocked.
269+You are an autonomous, senior-level coding assistant. When the user gives a direction, proactively gather context, plan with the user, implement, and verify. Bias toward action: plan briefly when needed to clear important assumptions, then continue into implementation. First identify the task contract: required files, names, interfaces, output format, and checks for success. Treat those details as part of correctness, not as polish. Deliver working code, unless you are genuinely blocked.
270270
271271 # Tools
272272
273273 You have these core tools:
274274
275-- `shell` — run commands in the user's shell. Use this to explore the codebase (rg, find, ls, cat), run tests, build, git, and any other command. Prefer `rg` over `grep` for speed.
276-- `edit` — make exact-text replacements in files. Provide the file path, the exact text to find, and the replacement text. The old text must match exactly one location in the file. To create a new file, use an empty old text and the full file content as new text.
275+- `shell` — run commands in the user's shell. Use this to explore the codebase, read tests/verifiers/examples, inspect required outputs, and run targeted checks, builds, or git commands. Prefer `rg` over `grep` for speed.
276+- `edit` — make exact-text replacements in files. Provide the file path, the exact text to find, and the replacement text. The old text must match exactly one location in the file. To create a new file, use an empty old text and the full file content as new text. Use this to write the exact final file content the task requires.
277277
278278 You may also have additional tools provided by plugins. Use them when they match the task.
279279
@@ -282,7 +282,7 @@ Workflow: **inspect with shell → mutate with edit → verify with shell**.
282282 # Code quality
283283
284284 - Conform to the codebase's existing conventions: patterns, naming, formatting, language idioms.
285-- Write correct, clear, minimal code. Don't over-engineer, don't add abstractions for hypothetical futures.
285+- Write correct, clear, minimal code. Prefer the simplest solution that satisfies the task's checks exactly. Don't over-engineer, don't add abstractions for hypothetical futures.
286286 - Reuse before creating. Search for existing helpers before writing new ones.
287287 - Tight error handling: no broad try/catch, no silent failures, no swallowed errors.
288288 - Keep type safety. Avoid `any` casts. Use proper types and guards.
@@ -298,6 +298,7 @@ Workflow: **inspect with shell → mutate with edit → verify with shell**.
298298 # Exploring the codebase
299299
300300 - Think first: before any tool call, decide all files and information you need.
301+- Early in the task, look for acceptance criteria in tests, verifier scripts, eval scripts, examples, and expected-output files. Do not rely on the task text alone when machine-checkable criteria are available.
301302 - Batch reads: if you need multiple files, read them together in parallel rather than one at a time.
302303 - Only make sequential calls when a later call genuinely depends on an earlier result.
303304
@@ -312,7 +313,9 @@ Workflow: **inspect with shell → mutate with edit → verify with shell**.
312313 # Persistence
313314
314315 - Carry work through to completion within the current turn. Don't stop at analysis or partial fixes.
316+- Once the contract is clear, create the required artifact early, then iterate and improve it. Do not spend most of the turn exploring.
315317 - If you encounter an error, diagnose and fix it rather than reporting it and stopping.
318+- Before concluding, run the smallest targeted verification that checks the exact contract: required files exist, names and signatures match, outputs are in the required format, and no forbidden extra artifacts were left behind.
316319 - Avoid excessive looping: if you're re-reading or re-editing the same files without progress, stop and ask the user.
317320 ```
318321
src/prompt.test.ts+16−0
@@ -343,6 +343,22 @@ describe("buildSystemPrompt", () => {
343343 expect(prompt).toContain("# Persistence");
344344 });
345345
346+ test("includes contract, verifier, and exactness guidance", () => {
347+ const prompt = buildSystemPrompt({
348+ cwd: "/home/user/project",
349+ date: "2026-04-05",
350+ });
351+
352+ expect(prompt).toContain("First identify the task contract");
353+ expect(prompt).toContain(
354+ "look for acceptance criteria in tests, verifier scripts, eval scripts, examples, and expected-output files",
355+ );
356+ expect(prompt).toContain("create the required artifact early");
357+ expect(prompt).toContain(
358+ "run the smallest targeted verification that checks the exact contract",
359+ );
360+ });
361+
346362 test("includes session footer with date and cwd", () => {
347363 const prompt = buildSystemPrompt({
348364 cwd: "/home/user/project",
src/prompt.ts+7−4
@@ -192,14 +192,14 @@ const BASE_INSTRUCTIONS = `You are mini-coder, a coding agent running in the use
192192
193193 # Role
194194
195-You are an autonomous, senior-level coding assistant. When the user gives a direction, proactively gather context, plan with the user, implement, and verify. Bias toward action: use planning first to clear any assumptions with the user, then implement the plan. Deliver working code, unless you are genuinely blocked.
195+You are an autonomous, senior-level coding assistant. When the user gives a direction, proactively gather context, plan with the user, implement, and verify. Bias toward action: plan briefly when needed to clear important assumptions, then continue into implementation. First identify the task contract: required files, names, interfaces, output format, and checks for success. Treat those details as part of correctness, not as polish. Deliver working code, unless you are genuinely blocked.
196196
197197 # Tools
198198
199199 You have these core tools:
200200
201-- \`shell\` — run commands in the user's shell. Use this to explore the codebase (rg, find, ls, cat), run tests, build, git, and any other command. Prefer \`rg\` over \`grep\` for speed.
202-- \`edit\` — make exact-text replacements in files. Provide the file path, the exact text to find, and the replacement text. The old text must match exactly one location in the file. To create a new file, use an empty old text and the full file content as new text.
201+- \`shell\` — run commands in the user's shell. Use this to explore the codebase, read tests/verifiers/examples, inspect required outputs, and run targeted checks, builds, or git commands. Prefer \`rg\` over \`grep\` for speed.
202+- \`edit\` — make exact-text replacements in files. Provide the file path, the exact text to find, and the replacement text. The old text must match exactly one location in the file. To create a new file, use an empty old text and the full file content as new text. Use this to write the exact final file content the task requires.
203203
204204 You may also have additional tools provided by plugins. Use them when they match the task.
205205
@@ -208,7 +208,7 @@ Workflow: **inspect with shell → mutate with edit → verify with shell**.
208208 # Code quality
209209
210210 - Conform to the codebase's existing conventions: patterns, naming, formatting, language idioms.
211-- Write correct, clear, minimal code. Don't over-engineer, don't add abstractions for hypothetical futures.
211+- Write correct, clear, minimal code. Prefer the simplest solution that satisfies the task's checks exactly. Don't over-engineer, don't add abstractions for hypothetical futures.
212212 - Reuse before creating. Search for existing helpers before writing new ones.
213213 - Tight error handling: no broad try/catch, no silent failures, no swallowed errors.
214214 - Keep type safety. Avoid \`any\` casts. Use proper types and guards.
@@ -224,6 +224,7 @@ Workflow: **inspect with shell → mutate with edit → verify with shell**.
224224 # Exploring the codebase
225225
226226 - Think first: before any tool call, decide all files and information you need.
227+- Early in the task, look for acceptance criteria in tests, verifier scripts, eval scripts, examples, and expected-output files. Do not rely on the task text alone when machine-checkable criteria are available.
227228 - Batch reads: if you need multiple files, read them together in parallel rather than one at a time.
228229 - Only make sequential calls when a later call genuinely depends on an earlier result.
229230
@@ -238,7 +239,9 @@ Workflow: **inspect with shell → mutate with edit → verify with shell**.
238239 # Persistence
239240
240241 - Carry work through to completion within the current turn. Don't stop at analysis or partial fixes.
242+- Once the contract is clear, create the required artifact early, then iterate and improve it. Do not spend most of the turn exploring.
241243 - If you encounter an error, diagnose and fix it rather than reporting it and stopping.
244+- Before concluding, run the smallest targeted verification that checks the exact contract: required files exist, names and signatures match, outputs are in the required format, and no forbidden extra artifacts were left behind.
242245 - Avoid excessive looping: if you're re-reading or re-editing the same files without progress, stop and ask the user.`;
243246
244247 // ---------------------------------------------------------------------------
src/tools.test.ts+20−0
@@ -9,9 +9,11 @@ import {
99 import { tmpdir } from "node:os";
1010 import { join } from "node:path";
1111 import {
12+ editTool,
1213 executeEdit,
1314 executeReadImage,
1415 executeShell,
16+ shellTool,
1517 type ToolExecResult,
1618 truncateOutput,
1719 } from "./tools.ts";
@@ -468,6 +470,24 @@ describe("truncateOutput", () => {
468470 });
469471 });
470472
473+// ---------------------------------------------------------------------------
474+// tool definitions
475+// ---------------------------------------------------------------------------
476+
477+describe("tool definitions", () => {
478+ test("shell description steers toward verifier-aware, focused inspection", () => {
479+ expect(shellTool.description).toContain("read tests/verifiers/examples");
480+ expect(shellTool.description).toContain("inspect required outputs");
481+ expect(shellTool.description).toContain("targeted checks");
482+ });
483+
484+ test("edit description emphasizes exact required file content", () => {
485+ expect(editTool.description).toContain(
486+ "write the exact final file content the task requires",
487+ );
488+ });
489+});
490+
471491 // ---------------------------------------------------------------------------
472492 // readImage
473493 // ---------------------------------------------------------------------------
src/tools.ts+3−2
@@ -532,7 +532,8 @@ export const editTool: Tool = {
532532 "Make an exact-text replacement in a single file. " +
533533 "Provide the file path, the exact text to find, and the replacement text. " +
534534 "The old text must match exactly one location in the file. " +
535- "To create a new file, use an empty old text and the full file content as new text.",
535+ "To create a new file, use an empty old text and the full file content as new text. " +
536+ "Use this to write the exact final file content the task requires.",
536537 parameters: Type.Object({
537538 path: Type.String({
538539 description: "File path (absolute or relative to cwd)",
@@ -552,7 +553,7 @@ export const shellTool: Tool = {
552553 name: "shell",
553554 description:
554555 "Run a command in the user's shell. Returns stdout, stderr, and exit code. " +
555- "Use for exploring the codebase (rg, find, ls, cat), running tests, builds, git, etc.",
556+ "Use this to explore the codebase, read tests/verifiers/examples, inspect required outputs, and run targeted checks, builds, or git commands.",
556557 parameters: Type.Object({
557558 command: Type.String({ description: "The shell command to execute" }),
558559 }),
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57.launch.log+21−0
@@ -0,0 +1,21 @@
1+ 89/89 Mean: 0.674 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20:25:28 0:00:00Results written to terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/result.json
2+ mini-coder (gpt-5.4) on terminal-bench
3+┏━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┓
4+┃ Metric ┃ Value ┃
5+┡━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━┩
6+│ Agent │ mini-coder (gpt-5.4) │
7+│ Dataset │ terminal-bench │
8+│ Trials │ 87 │
9+│ Errors │ 15 │
10+│ │ │
11+│ Mean │ 0.674 │
12+│ │ │
13+│ Reward Distribution │ │
14+│ reward = 0.0 │ 27 │
15+│ reward = 1.0 │ 60 │
16+│ │ │
17+│ Exception Distribution │ │
18+│ AgentTimeoutError │ 14 │
19+│ VerifierTimeoutError │ 1 │
20+└────────────────────────┴──────────────────────┘
21+
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc/config.json+50−0
@@ -0,0 +1,50 @@
1+{
2+ "task": {
3+ "path": "adaptive-rejection-sampler",
4+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
5+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
6+ "name": null,
7+ "ref": null,
8+ "overwrite": false,
9+ "download_dir": null,
10+ "source": "terminal-bench"
11+ },
12+ "trial_name": "adaptive-rejection-sampler__Ecc6WCc",
13+ "trials_dir": "terminal-bench/jobs/leaderboard-2026-04-10__16-06-57",
14+ "timeout_multiplier": 1.0,
15+ "agent_timeout_multiplier": null,
16+ "verifier_timeout_multiplier": null,
17+ "agent_setup_timeout_multiplier": null,
18+ "environment_build_timeout_multiplier": null,
19+ "agent": {
20+ "name": null,
21+ "import_path": "mini_coder_agent:MiniCoderAgent",
22+ "model_name": "openai-codex/gpt-5.4",
23+ "override_timeout_sec": null,
24+ "override_setup_timeout_sec": null,
25+ "max_timeout_sec": null,
26+ "kwargs": {},
27+ "env": {}
28+ },
29+ "environment": {
30+ "type": "docker",
31+ "import_path": null,
32+ "force_build": false,
33+ "delete": true,
34+ "override_cpus": null,
35+ "override_memory_mb": null,
36+ "override_storage_mb": null,
37+ "override_gpus": null,
38+ "suppress_override_warnings": false,
39+ "mounts_json": null,
40+ "env": {},
41+ "kwargs": {}
42+ },
43+ "verifier": {
44+ "override_timeout_sec": null,
45+ "max_timeout_sec": null,
46+ "disable": false
47+ },
48+ "artifacts": [],
49+ "job_id": "5da89ebc-ff25-4691-8f46-573c706cdf8b"
50+}
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc/result.json+103−0
@@ -0,0 +1,103 @@
1+{
2+ "id": "eebdf0c8-43dc-4e17-986c-36f17295ecdb",
3+ "task_name": "adaptive-rejection-sampler",
4+ "trial_name": "adaptive-rejection-sampler__Ecc6WCc",
5+ "trial_uri": "file:///home/xonecas/src/mini-coder/terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc",
6+ "task_id": {
7+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
8+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
9+ "path": "adaptive-rejection-sampler"
10+ },
11+ "source": "terminal-bench",
12+ "task_checksum": "4fde6e809c475b000ae3ea4135f906ffe4775bccae7dafd0b123f4ecc9fcf697",
13+ "config": {
14+ "task": {
15+ "path": "adaptive-rejection-sampler",
16+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
17+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
18+ "name": null,
19+ "ref": null,
20+ "overwrite": false,
21+ "download_dir": null,
22+ "source": "terminal-bench"
23+ },
24+ "trial_name": "adaptive-rejection-sampler__Ecc6WCc",
25+ "trials_dir": "terminal-bench/jobs/leaderboard-2026-04-10__16-06-57",
26+ "timeout_multiplier": 1.0,
27+ "agent_timeout_multiplier": null,
28+ "verifier_timeout_multiplier": null,
29+ "agent_setup_timeout_multiplier": null,
30+ "environment_build_timeout_multiplier": null,
31+ "agent": {
32+ "name": null,
33+ "import_path": "mini_coder_agent:MiniCoderAgent",
34+ "model_name": "openai-codex/gpt-5.4",
35+ "override_timeout_sec": null,
36+ "override_setup_timeout_sec": null,
37+ "max_timeout_sec": null,
38+ "kwargs": {},
39+ "env": {}
40+ },
41+ "environment": {
42+ "type": "docker",
43+ "import_path": null,
44+ "force_build": false,
45+ "delete": true,
46+ "override_cpus": null,
47+ "override_memory_mb": null,
48+ "override_storage_mb": null,
49+ "override_gpus": null,
50+ "suppress_override_warnings": false,
51+ "mounts_json": null,
52+ "env": {},
53+ "kwargs": {}
54+ },
55+ "verifier": {
56+ "override_timeout_sec": null,
57+ "max_timeout_sec": null,
58+ "disable": false
59+ },
60+ "artifacts": [],
61+ "job_id": "5da89ebc-ff25-4691-8f46-573c706cdf8b"
62+ },
63+ "agent_info": {
64+ "name": "mini-coder",
65+ "version": "latest",
66+ "model_info": {
67+ "name": "gpt-5.4",
68+ "provider": "openai-codex"
69+ }
70+ },
71+ "agent_result": {
72+ "n_input_tokens": null,
73+ "n_cache_tokens": null,
74+ "n_output_tokens": null,
75+ "cost_usd": null,
76+ "rollout_details": null,
77+ "metadata": null
78+ },
79+ "verifier_result": {
80+ "rewards": {
81+ "reward": 0.0
82+ }
83+ },
84+ "exception_info": null,
85+ "started_at": "2026-04-10T20:24:01.242511Z",
86+ "finished_at": "2026-04-10T20:36:37.665717Z",
87+ "environment_setup": {
88+ "started_at": "2026-04-10T20:24:01.243217Z",
89+ "finished_at": "2026-04-10T20:24:06.565132Z"
90+ },
91+ "agent_setup": {
92+ "started_at": "2026-04-10T20:24:06.565141Z",
93+ "finished_at": "2026-04-10T20:24:45.518148Z"
94+ },
95+ "agent_execution": {
96+ "started_at": "2026-04-10T20:24:45.518183Z",
97+ "finished_at": "2026-04-10T20:36:17.378191Z"
98+ },
99+ "verifier": {
100+ "started_at": "2026-04-10T20:36:17.378245Z",
101+ "finished_at": "2026-04-10T20:36:26.849025Z"
102+ }
103+}
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc/trial.log+42−0
@@ -0,0 +1,42 @@
1+Running command: if command -v apt-get >/dev/null 2>&1; then apt-get update && apt-get install -y curl unzip ca-certificates bash git python3 ripgrep; elif command -v apk >/dev/null 2>&1; then apk add --no-cache curl unzip ca-certificates bash git python3 ripgrep; else echo "Unsupported package manager for mini-coder install" >&2; exit 1; fi
2+Command outputs captured
3+Running command: set -euo pipefail; curl -fsSL https://bun.sh/install | bash; export PATH="$HOME/.bun/bin:$PATH"; bun add -g mini-coder@latest; test -x ~/.bun/bin/bun; test -x ~/.bun/bin/mc
4+Command outputs captured
5+Running command: printf %s "$HOME"
6+Command outputs captured
7+Running command: mkdir -p /root/.config/mini-coder
8+Command outputs captured
9+Running command: chmod 600 /root/.config/mini-coder/settings.json /root/.config/mini-coder/auth.json
10+Command outputs captured
11+Running command: export PATH="$HOME/.bun/bin:$PATH"; mc -p 'Your task is to implement an adaptive-rejection sampler as described in Gilks et al. (1992).
12+
13+1. Your solution should allow the user to provide reasonable inputs, including the number of points
14+to sample, and should check the inputs for validity. The primary input should be a function or
15+expression that calculates the (possibly unnormalized) density of the distribution of interest in a
16+vectorized fashion (e.g., many of the "d" functions in R, such as "dnorm" are legitimate inputs). Your code should include checks that catch cases of non-log-concave densities during the sampling process.
17+
18+2. Formal testing is required (see 1.), with a set of tests where results are compared to some known truth.
19+You should have tests for the overall function, and for any modules that do anything complicated.
20+Given the output is stochastic, how to do this will require some thought. The output of your testing function should be clear and interpretable.
21+I.e., when I run your test function, it should print informative messages of what it is doing and whether the test was passed or failed.
22+
23+3. Your solution should involve modular code, with functions or OOP methods that implement discrete tasks.
24+You should have an overall design and style that is consistent across the components, in terms of functions vs. OOP methods, naming of objects, etc.
25+
26+Requirements:
27+- Install R if not already available, then write your code in R
28+- Save your main implementation in a file named "/app/ars.R"
29+- Include a primary function named "ars" that implements the adaptive rejection sampler
30+- Include a test function named "test" that performs formal testing with known distributions
31+- The "ars" function must validate inputs (e.g., reject negative sample counts, invalid domains)
32+- The "ars" function must include checks for log-concavity during sampling
33+- The implementation must be modular with auxiliary functions for discrete tasks
34+- The "ars" function must be able to generate valid samples from standard distributions (e.g., normal, exponential)
35+- The generated samples must follow the target distribution shape (not uniform random values)
36+- Include clear error handling for invalid inputs and non-log-concave densities
37+- Your test function should output results in the format: "TEST_NAME: PASS" or "TEST_NAME: FAIL" with mean and standard deviation statistics
38+- Generate at least one sample file named "/app/normal_samples.txt" or "/app/exponential_samples.txt" containing your test samples
39+
40+Reference: Gilks, W. R., & Wild, P. (1992). Adaptive rejection sampling for Gibbs sampling. Journal of the Royal Statistical Society: Series C (Applied Statistics), 41(2), 337-348.
41+' </dev/null >/logs/agent/mini-coder.ndjson 2>/logs/agent/mini-coder.stderr.txt
42+Command outputs captured
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc/verifier/reward.txt+1−0
@@ -0,0 +1 @@
1+0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/adaptive-rejection-sampler__Ecc6WCc/verifier/test-stdout.txt+110−0
@@ -0,0 +1,110 @@
1+Hit:1 http://archive.ubuntu.com/ubuntu noble InRelease
2+Hit:2 http://archive.ubuntu.com/ubuntu noble-updates InRelease
3+Hit:3 http://security.ubuntu.com/ubuntu noble-security InRelease
4+Hit:4 http://archive.ubuntu.com/ubuntu noble-backports InRelease
5+Reading package lists...
6+Reading package lists...
7+Building dependency tree...
8+Reading state information...
9+curl is already the newest version (8.5.0-2ubuntu10.8).
10+0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded.
11+downloading uv 0.9.5 x86_64-unknown-linux-gnu
12+no checksums to verify
13+installing to /root/.local/bin
14+ uv
15+ uvx
16+everything's installed!
17+
18+To add $HOME/.local/bin to your PATH, either restart your shell or run:
19+
20+ source $HOME/.local/bin/env (sh, bash, zsh)
21+ source $HOME/.local/bin/env.fish (fish)
22+Downloading cpython-3.13.9-linux-x86_64-gnu (download) (32.0MiB)
23+ Downloading cpython-3.13.9-linux-x86_64-gnu (download)
24+Downloading pygments (1.2MiB)
25+Downloading scipy (34.0MiB)
26+Downloading numpy (15.9MiB)
27+ Downloading pygments
28+ Downloading numpy
29+ Downloading scipy
30+Installed 8 packages in 22ms
31+============================= test session starts ==============================
32+platform linux -- Python 3.13.9, pytest-8.4.1, pluggy-1.6.0
33+rootdir: /tests
34+plugins: json-ctrf-0.3.5
35+collected 9 items
36+
37+../tests/test_outputs.py .F....... [100%]
38+
39+=================================== FAILURES ===================================
40+_______________ test_can_generate_standard_distribution_samples ________________
41+
42+ def test_can_generate_standard_distribution_samples():
43+ """Test implementation can generate samples from standard distributions."""
44+ app_dir = Path("/app")
45+
46+ # Test R implementation by sourcing ars.R and running tests
47+ test_code_r = """
48+ library(stats)
49+
50+ # Source the required ars.R file
51+ source("ars.R")
52+
53+ # Test normal distribution sampling
54+ normal_density <- function(x) {
55+ dnorm(x, mean = 0, sd = 1)
56+ }
57+
58+ # Try to generate samples
59+ tryCatch({
60+ samples <- ars(normal_density, c(-5, 5), n = 1000)
61+
62+ if (length(samples) >= 900) { # Allow some tolerance
63+ mean_val <- mean(samples)
64+ std_val <- sd(samples)
65+
66+ if (abs(mean_val) < 0.2 && std_val > 0.8 && std_val < 1.2) {
67+ cat("PASS: Generated valid normal samples\n")
68+ } else {
69+ cat("ERROR: Mean or std out of range\n")
70+ }
71+ } else {
72+ cat("ERROR: Insufficient samples generated\n")
73+ }
74+ }, error = function(e) {
75+ cat("ERROR: Failed to generate samples:", conditionMessage(e), "\n")
76+ })
77+ """
78+
79+ # Run R test
80+ test_file = app_dir / "test_normal_sampler.R"
81+ test_file.write_text(test_code_r)
82+ try:
83+ result = subprocess.run(
84+ ["Rscript", str(test_file)],
85+ capture_output=True,
86+ text=True,
87+ cwd=str(app_dir),
88+ timeout=30,
89+ )
90+ output = result.stdout + result.stderr
91+> assert "PASS" in output, (
92+ f"Failed to generate valid normal samples. Output: {output}"
93+ )
94+E AssertionError: Failed to generate valid normal samples. Output: ERROR: Failed to generate samples: `lower` and `upper` must be numeric scalars.
95+E
96+E assert 'PASS' in 'ERROR: Failed to generate samples: `lower` and `upper` must be numeric scalars. \n'
97+
98+/tests/test_outputs.py:81: AssertionError
99+==================================== PASSES ====================================
100+=========================== short test summary info ============================
101+PASSED ../tests/test_outputs.py::test_ars_function_exists
102+PASSED ../tests/test_outputs.py::test_has_test_function
103+PASSED ../tests/test_outputs.py::test_formal_testing_with_known_truth
104+PASSED ../tests/test_outputs.py::test_sample_files_generated
105+PASSED ../tests/test_outputs.py::test_implementation_is_modular
106+PASSED ../tests/test_outputs.py::test_implementation_handles_errors
107+PASSED ../tests/test_outputs.py::test_input_validation_functionality
108+PASSED ../tests/test_outputs.py::test_log_concavity_functionality
109+FAILED ../tests/test_outputs.py::test_can_generate_standard_distribution_samples
110+========================= 1 failed, 8 passed in 2.36s ==========================
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL/config.json+50−0
@@ -0,0 +1,50 @@
1+{
2+ "task": {
3+ "path": "bn-fit-modify",
4+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
5+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
6+ "name": null,
7+ "ref": null,
8+ "overwrite": false,
9+ "download_dir": null,
10+ "source": "terminal-bench"
11+ },
12+ "trial_name": "bn-fit-modify__TtbfRNL",
13+ "trials_dir": "terminal-bench/jobs/leaderboard-2026-04-10__16-06-57",
14+ "timeout_multiplier": 1.0,
15+ "agent_timeout_multiplier": null,
16+ "verifier_timeout_multiplier": null,
17+ "agent_setup_timeout_multiplier": null,
18+ "environment_build_timeout_multiplier": null,
19+ "agent": {
20+ "name": null,
21+ "import_path": "mini_coder_agent:MiniCoderAgent",
22+ "model_name": "openai-codex/gpt-5.4",
23+ "override_timeout_sec": null,
24+ "override_setup_timeout_sec": null,
25+ "max_timeout_sec": null,
26+ "kwargs": {},
27+ "env": {}
28+ },
29+ "environment": {
30+ "type": "docker",
31+ "import_path": null,
32+ "force_build": false,
33+ "delete": true,
34+ "override_cpus": null,
35+ "override_memory_mb": null,
36+ "override_storage_mb": null,
37+ "override_gpus": null,
38+ "suppress_override_warnings": false,
39+ "mounts_json": null,
40+ "env": {},
41+ "kwargs": {}
42+ },
43+ "verifier": {
44+ "override_timeout_sec": null,
45+ "max_timeout_sec": null,
46+ "disable": false
47+ },
48+ "artifacts": [],
49+ "job_id": "5da89ebc-ff25-4691-8f46-573c706cdf8b"
50+}
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL/result.json+103−0
@@ -0,0 +1,103 @@
1+{
2+ "id": "a8ed642a-abfc-4410-b566-4a2bfdc9a4e9",
3+ "task_name": "bn-fit-modify",
4+ "trial_name": "bn-fit-modify__TtbfRNL",
5+ "trial_uri": "file:///home/xonecas/src/mini-coder/terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL",
6+ "task_id": {
7+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
8+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
9+ "path": "bn-fit-modify"
10+ },
11+ "source": "terminal-bench",
12+ "task_checksum": "2758dba68c97cbf8fff87af7e955ac424bfe84ff053e20f160f713d3eee2358f",
13+ "config": {
14+ "task": {
15+ "path": "bn-fit-modify",
16+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
17+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
18+ "name": null,
19+ "ref": null,
20+ "overwrite": false,
21+ "download_dir": null,
22+ "source": "terminal-bench"
23+ },
24+ "trial_name": "bn-fit-modify__TtbfRNL",
25+ "trials_dir": "terminal-bench/jobs/leaderboard-2026-04-10__16-06-57",
26+ "timeout_multiplier": 1.0,
27+ "agent_timeout_multiplier": null,
28+ "verifier_timeout_multiplier": null,
29+ "agent_setup_timeout_multiplier": null,
30+ "environment_build_timeout_multiplier": null,
31+ "agent": {
32+ "name": null,
33+ "import_path": "mini_coder_agent:MiniCoderAgent",
34+ "model_name": "openai-codex/gpt-5.4",
35+ "override_timeout_sec": null,
36+ "override_setup_timeout_sec": null,
37+ "max_timeout_sec": null,
38+ "kwargs": {},
39+ "env": {}
40+ },
41+ "environment": {
42+ "type": "docker",
43+ "import_path": null,
44+ "force_build": false,
45+ "delete": true,
46+ "override_cpus": null,
47+ "override_memory_mb": null,
48+ "override_storage_mb": null,
49+ "override_gpus": null,
50+ "suppress_override_warnings": false,
51+ "mounts_json": null,
52+ "env": {},
53+ "kwargs": {}
54+ },
55+ "verifier": {
56+ "override_timeout_sec": null,
57+ "max_timeout_sec": null,
58+ "disable": false
59+ },
60+ "artifacts": [],
61+ "job_id": "5da89ebc-ff25-4691-8f46-573c706cdf8b"
62+ },
63+ "agent_info": {
64+ "name": "mini-coder",
65+ "version": "latest",
66+ "model_info": {
67+ "name": "gpt-5.4",
68+ "provider": "openai-codex"
69+ }
70+ },
71+ "agent_result": {
72+ "n_input_tokens": null,
73+ "n_cache_tokens": null,
74+ "n_output_tokens": null,
75+ "cost_usd": null,
76+ "rollout_details": null,
77+ "metadata": null
78+ },
79+ "verifier_result": {
80+ "rewards": {
81+ "reward": 1.0
82+ }
83+ },
84+ "exception_info": null,
85+ "started_at": "2026-04-11T09:01:50.093550Z",
86+ "finished_at": "2026-04-11T09:07:45.948206Z",
87+ "environment_setup": {
88+ "started_at": "2026-04-11T09:01:50.093811Z",
89+ "finished_at": "2026-04-11T09:02:01.327045Z"
90+ },
91+ "agent_setup": {
92+ "started_at": "2026-04-11T09:02:01.327054Z",
93+ "finished_at": "2026-04-11T09:02:48.829790Z"
94+ },
95+ "agent_execution": {
96+ "started_at": "2026-04-11T09:02:48.829824Z",
97+ "finished_at": "2026-04-11T09:07:22.547070Z"
98+ },
99+ "verifier": {
100+ "started_at": "2026-04-11T09:07:22.547126Z",
101+ "finished_at": "2026-04-11T09:07:35.086677Z"
102+ }
103+}
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL/trial.log+37−0
@@ -0,0 +1,37 @@
1+Running command: if command -v apt-get >/dev/null 2>&1; then apt-get update && apt-get install -y curl unzip ca-certificates bash git python3 ripgrep; elif command -v apk >/dev/null 2>&1; then apk add --no-cache curl unzip ca-certificates bash git python3 ripgrep; else echo "Unsupported package manager for mini-coder install" >&2; exit 1; fi
2+Command outputs captured
3+Running command: set -euo pipefail; curl -fsSL https://bun.sh/install | bash; export PATH="$HOME/.bun/bin:$PATH"; bun add -g mini-coder@latest; test -x ~/.bun/bin/bun; test -x ~/.bun/bin/mc
4+Command outputs captured
5+Running command: printf %s "$HOME"
6+Command outputs captured
7+Running command: mkdir -p /root/.config/mini-coder
8+Command outputs captured
9+Running command: chmod 600 /root/.config/mini-coder/settings.json /root/.config/mini-coder/auth.json
10+Command outputs captured
11+Running command: export PATH="$HOME/.bun/bin:$PATH"; mc -p 'You are provided with a dataset sample from a Bayesian Network in /app/bn_sample_10k.csv.
12+Your first task is to recover the underlying DAG using the provided data.
13+
14+Here is some information about the original DAG that you may find useful:
15+ - U has no parents
16+ - There are six total edges in the DAG that the data was sampled from
17+ - There may be edges not involving U for which directionality is not clear, in this case you
18+may assume that the node labeled with the letter that comes first in the alphabet is the child of the node
19+that comes second.
20+
21+
22+Once you have found a DAG take the following steps:
23+1) Save the edges of the DAG to /app/learned_dag.csv in the format:
24+ to,from
25+ A,B
26+ C,D
27+ ...
28+2) Learn a Bayesian Network from the data in /app/bn_sample_10k.csv using the
29+ DAG you recovered.
30+3) Perform a causal intervention on Y, setting its value to 0.0. (If your statistical package
31+does not allow for a exact value intervention, you may use an extremely small (10e-9) variance
32+around 0.0)
33+4) Save the edges of the intervened BN to /app/intervened_dag.csv in the same format as above.
34+4) Sample 10k points from the intervened BN and save the result to
35+ /app/final_bn_sample.csv with the same column names as the original data:
36+' </dev/null >/logs/agent/mini-coder.ndjson 2>/logs/agent/mini-coder.stderr.txt
37+Command outputs captured
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL/verifier/reward.txt+1−0
@@ -0,0 +1 @@
1+1
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/bn-fit-modify__TtbfRNL/verifier/test-stdout.txt+52−0
@@ -0,0 +1,52 @@
1+Hit:1 http://archive.ubuntu.com/ubuntu noble InRelease
2+Hit:2 http://archive.ubuntu.com/ubuntu noble-updates InRelease
3+Hit:3 http://archive.ubuntu.com/ubuntu noble-backports InRelease
4+Hit:4 http://security.ubuntu.com/ubuntu noble-security InRelease
5+Reading package lists...
6+Reading package lists...
7+Building dependency tree...
8+Reading state information...
9+curl is already the newest version (8.5.0-2ubuntu10.8).
10+0 upgraded, 0 newly installed, 0 to remove and 69 not upgraded.
11+downloading uv 0.9.5 x86_64-unknown-linux-gnu
12+no checksums to verify
13+installing to /root/.local/bin
14+ uv
15+ uvx
16+everything's installed!
17+
18+To add $HOME/.local/bin to your PATH, either restart your shell or run:
19+
20+ source $HOME/.local/bin/env (sh, bash, zsh)
21+ source $HOME/.local/bin/env.fish (fish)
22+Downloading cpython-3.13.9-linux-x86_64-gnu (download) (32.0MiB)
23+ Downloading cpython-3.13.9-linux-x86_64-gnu (download)
24+Downloading numpy (15.9MiB)
25+Downloading pygments (1.2MiB)
26+Downloading scipy (33.5MiB)
27+Downloading pandas (11.5MiB)
28+ Downloading pygments
29+ Downloading numpy
30+ Downloading pandas
31+ Downloading scipy
32+Installed 13 packages in 44ms
33+============================= test session starts ==============================
34+platform linux -- Python 3.13.9, pytest-8.4.1, pluggy-1.6.0
35+rootdir: /tests
36+plugins: json-ctrf-0.3.5
37+collected 9 items
38+
39+../tests/test_outputs.py ......... [100%]
40+
41+==================================== PASSES ====================================
42+=========================== short test summary info ============================
43+PASSED ../tests/test_outputs.py::test_bn_sample_exists
44+PASSED ../tests/test_outputs.py::test_learned_dag_structure_exists
45+PASSED ../tests/test_outputs.py::test_learned_dag_structure_csv_col_names
46+PASSED ../tests/test_outputs.py::test_learned_dag_structure
47+PASSED ../tests/test_outputs.py::test_intervened_dag_structure_exists
48+PASSED ../tests/test_outputs.py::test_intervened_dag_structure_csv_col_names
49+PASSED ../tests/test_outputs.py::test_intervened__data_structure
50+PASSED ../tests/test_outputs.py::test_sampled_csv_col_names
51+PASSED ../tests/test_outputs.py::test_sampled_data
52+============================== 9 passed in 3.91s ===============================
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N/config.json+50−0
@@ -0,0 +1,50 @@
1+{
2+ "task": {
3+ "path": "break-filter-js-from-html",
4+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
5+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
6+ "name": null,
7+ "ref": null,
8+ "overwrite": false,
9+ "download_dir": null,
10+ "source": "terminal-bench"
11+ },
12+ "trial_name": "break-filter-js-from-html__7vTmy7N",
13+ "trials_dir": "terminal-bench/jobs/leaderboard-2026-04-10__16-06-57",
14+ "timeout_multiplier": 1.0,
15+ "agent_timeout_multiplier": null,
16+ "verifier_timeout_multiplier": null,
17+ "agent_setup_timeout_multiplier": null,
18+ "environment_build_timeout_multiplier": null,
19+ "agent": {
20+ "name": null,
21+ "import_path": "mini_coder_agent:MiniCoderAgent",
22+ "model_name": "openai-codex/gpt-5.4",
23+ "override_timeout_sec": null,
24+ "override_setup_timeout_sec": null,
25+ "max_timeout_sec": null,
26+ "kwargs": {},
27+ "env": {}
28+ },
29+ "environment": {
30+ "type": "docker",
31+ "import_path": null,
32+ "force_build": false,
33+ "delete": true,
34+ "override_cpus": null,
35+ "override_memory_mb": null,
36+ "override_storage_mb": null,
37+ "override_gpus": null,
38+ "suppress_override_warnings": false,
39+ "mounts_json": null,
40+ "env": {},
41+ "kwargs": {}
42+ },
43+ "verifier": {
44+ "override_timeout_sec": null,
45+ "max_timeout_sec": null,
46+ "disable": false
47+ },
48+ "artifacts": [],
49+ "job_id": "5da89ebc-ff25-4691-8f46-573c706cdf8b"
50+}
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N/result.json+103−0
@@ -0,0 +1,103 @@
1+{
2+ "id": "aa235cc9-8021-43a7-836a-031fea9629ac",
3+ "task_name": "break-filter-js-from-html",
4+ "trial_name": "break-filter-js-from-html__7vTmy7N",
5+ "trial_uri": "file:///home/xonecas/src/mini-coder/terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N",
6+ "task_id": {
7+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
8+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
9+ "path": "break-filter-js-from-html"
10+ },
11+ "source": "terminal-bench",
12+ "task_checksum": "b33421492e86b07de2a01bc2205f7e7d2fdc36446a84787265d99e5e138fdaaa",
13+ "config": {
14+ "task": {
15+ "path": "break-filter-js-from-html",
16+ "git_url": "https://github.com/laude-institute/terminal-bench-2.git",
17+ "git_commit_id": "69671fbaac6d67a7ef0dfec016cc38a64ef7a77c",
18+ "name": null,
19+ "ref": null,
20+ "overwrite": false,
21+ "download_dir": null,
22+ "source": "terminal-bench"
23+ },
24+ "trial_name": "break-filter-js-from-html__7vTmy7N",
25+ "trials_dir": "terminal-bench/jobs/leaderboard-2026-04-10__16-06-57",
26+ "timeout_multiplier": 1.0,
27+ "agent_timeout_multiplier": null,
28+ "verifier_timeout_multiplier": null,
29+ "agent_setup_timeout_multiplier": null,
30+ "environment_build_timeout_multiplier": null,
31+ "agent": {
32+ "name": null,
33+ "import_path": "mini_coder_agent:MiniCoderAgent",
34+ "model_name": "openai-codex/gpt-5.4",
35+ "override_timeout_sec": null,
36+ "override_setup_timeout_sec": null,
37+ "max_timeout_sec": null,
38+ "kwargs": {},
39+ "env": {}
40+ },
41+ "environment": {
42+ "type": "docker",
43+ "import_path": null,
44+ "force_build": false,
45+ "delete": true,
46+ "override_cpus": null,
47+ "override_memory_mb": null,
48+ "override_storage_mb": null,
49+ "override_gpus": null,
50+ "suppress_override_warnings": false,
51+ "mounts_json": null,
52+ "env": {},
53+ "kwargs": {}
54+ },
55+ "verifier": {
56+ "override_timeout_sec": null,
57+ "max_timeout_sec": null,
58+ "disable": false
59+ },
60+ "artifacts": [],
61+ "job_id": "5da89ebc-ff25-4691-8f46-573c706cdf8b"
62+ },
63+ "agent_info": {
64+ "name": "mini-coder",
65+ "version": "latest",
66+ "model_info": {
67+ "name": "gpt-5.4",
68+ "provider": "openai-codex"
69+ }
70+ },
71+ "agent_result": {
72+ "n_input_tokens": null,
73+ "n_cache_tokens": null,
74+ "n_output_tokens": null,
75+ "cost_usd": null,
76+ "rollout_details": null,
77+ "metadata": null
78+ },
79+ "verifier_result": {
80+ "rewards": {
81+ "reward": 1.0
82+ }
83+ },
84+ "exception_info": null,
85+ "started_at": "2026-04-10T15:54:45.110080Z",
86+ "finished_at": "2026-04-10T16:02:55.709544Z",
87+ "environment_setup": {
88+ "started_at": "2026-04-10T15:54:45.110386Z",
89+ "finished_at": "2026-04-10T15:55:12.390185Z"
90+ },
91+ "agent_setup": {
92+ "started_at": "2026-04-10T15:55:12.390194Z",
93+ "finished_at": "2026-04-10T15:55:44.483006Z"
94+ },
95+ "agent_execution": {
96+ "started_at": "2026-04-10T15:55:44.483069Z",
97+ "finished_at": "2026-04-10T16:02:37.698684Z"
98+ },
99+ "verifier": {
100+ "started_at": "2026-04-10T16:02:37.698742Z",
101+ "finished_at": "2026-04-10T16:02:44.940155Z"
102+ }
103+}
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N/trial.log+22−0
@@ -0,0 +1,22 @@
1+Running command: if command -v apt-get >/dev/null 2>&1; then apt-get update && apt-get install -y curl unzip ca-certificates bash git python3 ripgrep; elif command -v apk >/dev/null 2>&1; then apk add --no-cache curl unzip ca-certificates bash git python3 ripgrep; else echo "Unsupported package manager for mini-coder install" >&2; exit 1; fi
2+Command outputs captured
3+Running command: set -euo pipefail; curl -fsSL https://bun.sh/install | bash; export PATH="$HOME/.bun/bin:$PATH"; bun add -g mini-coder@latest; test -x ~/.bun/bin/bun; test -x ~/.bun/bin/mc
4+Command outputs captured
5+Running command: printf %s "$HOME"
6+Command outputs captured
7+Running command: mkdir -p /root/.config/mini-coder
8+Command outputs captured
9+Running command: chmod 600 /root/.config/mini-coder/settings.json /root/.config/mini-coder/auth.json
10+Command outputs captured
11+Running command: export PATH="$HOME/.bun/bin:$PATH"; mc -p 'There'"'"'s a /app/filter.py script that attempts to remove JavaScript from HTML files to prevent XSS attacks.
12+The /app/filter.py script takes an HTML file as a command-line argument and modifies it in-place.
13+
14+Usage: python /app/filter.py <html_file>
15+
16+Your task is to create a file called /app/out.html that, even after being processed by /app/filter.py,
17+will still trigger a JavaScript alert() when opened in a browser.
18+Your file should not require any interaction with the webpage and should trigger automatically.
19+
20+You can run /app/test_outputs.py to verify.
21+' </dev/null >/logs/agent/mini-coder.ndjson 2>/logs/agent/mini-coder.stderr.txt
22+Command outputs captured
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N/verifier/reward.txt+1−0
@@ -0,0 +1 @@
1+1
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/break-filter-js-from-html__7vTmy7N/verifier/test-stdout.txt+40−0
@@ -0,0 +1,40 @@
1+Hit:1 http://deb.debian.org/debian bookworm InRelease
2+Hit:2 http://deb.debian.org/debian bookworm-updates InRelease
3+Hit:3 http://deb.debian.org/debian-security bookworm-security InRelease
4+Reading package lists...
5+Reading package lists...
6+Building dependency tree...
7+Reading state information...
8+curl is already the newest version (7.88.1-10+deb12u14).
9+0 upgraded, 0 newly installed, 0 to remove and 49 not upgraded.
10+downloading uv 0.9.5 x86_64-unknown-linux-gnu
11+no checksums to verify
12+installing to /root/.local/bin
13+ uv
14+ uvx
15+everything's installed!
16+
17+To add $HOME/.local/bin to your PATH, either restart your shell or run:
18+
19+ source $HOME/.local/bin/env (sh, bash, zsh)
20+ source $HOME/.local/bin/env.fish (fish)
21+Downloading pygments (1.2MiB)
22+Downloading selenium (9.2MiB)
23+ Downloading pygments
24+ Downloading selenium
25+Installed 23 packages in 22ms
26+============================= test session starts ==============================
27+platform linux -- Python 3.13.7, pytest-8.4.1, pluggy-1.6.0
28+rootdir: /tests
29+plugins: json-ctrf-0.3.5
30+collected 1 item
31+
32+../tests/test_outputs.py . [100%]
33+
34+==================================== PASSES ====================================
35+________________________ test_out_html_bypasses_filter _________________________
36+----------------------------- Captured stdout call -----------------------------
37+✓ Alert successfully triggered even after filtering! Text: 'XSS'
38+=========================== short test summary info ============================
39+PASSED ../tests/test_outputs.py::test_out_html_bypasses_filter
40+============================== 1 passed in 2.07s ===============================
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-cython-ext__FYwU2wP/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-cython-ext__FYwU2wP/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-cython-ext__FYwU2wP/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-cython-ext__FYwU2wP/trial.log+33−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-cython-ext__FYwU2wP/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-cython-ext__FYwU2wP/verifier/test-stdout.txt+67−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pmars__9mRx2Da/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pmars__9mRx2Da/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pmars__9mRx2Da/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pmars__9mRx2Da/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pmars__9mRx2Da/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pmars__9mRx2Da/verifier/test-stdout.txt+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pov-ray__V5CVxP4/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pov-ray__V5CVxP4/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pov-ray__V5CVxP4/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pov-ray__V5CVxP4/trial.log+18−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pov-ray__V5CVxP4/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/build-pov-ray__V5CVxP4/verifier/test-stdout.txt+54−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/caffe-cifar-10__VaJhuT9/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/caffe-cifar-10__VaJhuT9/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/caffe-cifar-10__VaJhuT9/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/caffe-cifar-10__VaJhuT9/result.json+104−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/caffe-cifar-10__VaJhuT9/trial.log+19−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/caffe-cifar-10__VaJhuT9/verifier/test-stdout.txt+5−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cancel-async-tasks__5SArtju/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cancel-async-tasks__5SArtju/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cancel-async-tasks__5SArtju/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cancel-async-tasks__5SArtju/trial.log+15−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cancel-async-tasks__5SArtju/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cancel-async-tasks__5SArtju/verifier/test-stdout.txt+40−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/chess-best-move__ja8wYae/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/chess-best-move__ja8wYae/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/chess-best-move__ja8wYae/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/chess-best-move__ja8wYae/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/chess-best-move__ja8wYae/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/chess-best-move__ja8wYae/verifier/test-stdout.txt+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/circuit-fibsqrt__xRtrDZo/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/circuit-fibsqrt__xRtrDZo/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/circuit-fibsqrt__xRtrDZo/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/circuit-fibsqrt__xRtrDZo/trial.log+25−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/circuit-fibsqrt__xRtrDZo/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/circuit-fibsqrt__xRtrDZo/verifier/test-stdout.txt+76−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cobol-modernization__mXESz29/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cobol-modernization__mXESz29/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cobol-modernization__mXESz29/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cobol-modernization__mXESz29/trial.log+22−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cobol-modernization__mXESz29/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/cobol-modernization__mXESz29/verifier/test-stdout.txt+37−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/code-from-image__TgzAry6/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/code-from-image__TgzAry6/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/code-from-image__TgzAry6/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/code-from-image__TgzAry6/trial.log+15−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/code-from-image__TgzAry6/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/code-from-image__TgzAry6/verifier/test-stdout.txt+36−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/compile-compcert__d8kNokM/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/compile-compcert__d8kNokM/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/compile-compcert__d8kNokM/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/compile-compcert__d8kNokM/trial.log+16−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/compile-compcert__d8kNokM/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/compile-compcert__d8kNokM/verifier/test-stdout.txt+42−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/config.json+76−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/configure-git-webserver__LTzPD4S/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/configure-git-webserver__LTzPD4S/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/configure-git-webserver__LTzPD4S/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/configure-git-webserver__LTzPD4S/trial.log+22−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/configure-git-webserver__LTzPD4S/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/configure-git-webserver__LTzPD4S/verifier/test-stdout.txt+28−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/constraints-scheduling__GDnFDti/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/constraints-scheduling__GDnFDti/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/constraints-scheduling__GDnFDti/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/constraints-scheduling__GDnFDti/trial.log+42−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/constraints-scheduling__GDnFDti/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/constraints-scheduling__GDnFDti/verifier/test-stdout.txt+40−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/count-dataset-tokens__kceRtBG/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/count-dataset-tokens__kceRtBG/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/count-dataset-tokens__kceRtBG/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/count-dataset-tokens__kceRtBG/trial.log+16−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/count-dataset-tokens__kceRtBG/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/count-dataset-tokens__kceRtBG/verifier/test-stdout.txt+35−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/trial.log+12−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/crack-7z-hash__YUNwBjT/verifier/test-stdout.txt+67−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/custom-memory-heap-crash__Uwf9Vrj/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/custom-memory-heap-crash__Uwf9Vrj/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/custom-memory-heap-crash__Uwf9Vrj/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/custom-memory-heap-crash__Uwf9Vrj/trial.log+28−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/custom-memory-heap-crash__Uwf9Vrj/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/custom-memory-heap-crash__Uwf9Vrj/verifier/test-stdout.txt+43−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/db-wal-recovery__p3Gpfic/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/db-wal-recovery__p3Gpfic/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/db-wal-recovery__p3Gpfic/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/db-wal-recovery__p3Gpfic/trial.log+26−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/db-wal-recovery__p3Gpfic/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/db-wal-recovery__p3Gpfic/verifier/test-stdout.txt+89−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/distribution-search__afeWzQK/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/distribution-search__afeWzQK/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/distribution-search__afeWzQK/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/distribution-search__afeWzQK/trial.log+37−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/distribution-search__afeWzQK/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/distribution-search__afeWzQK/verifier/test-stdout.txt+44−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-assembly__AyFHah2/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-assembly__AyFHah2/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-assembly__AyFHah2/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-assembly__AyFHah2/trial.log+31−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-assembly__AyFHah2/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-assembly__AyFHah2/verifier/test-stdout.txt+104−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-insert__SUcvanr/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-insert__SUcvanr/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-insert__SUcvanr/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-insert__SUcvanr/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-insert__SUcvanr/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/dna-insert__SUcvanr/verifier/test-stdout.txt+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-elf__guaX9M2/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-elf__guaX9M2/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-elf__guaX9M2/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-elf__guaX9M2/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-elf__guaX9M2/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-elf__guaX9M2/verifier/test-stdout.txt+124−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/trial.log+12−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/extract-moves-from-video__MwtqMxm/verifier/test-stdout.txt+70−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-differential-cryptanalysis__m8Fk3Lu/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-differential-cryptanalysis__m8Fk3Lu/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-differential-cryptanalysis__m8Fk3Lu/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-differential-cryptanalysis__m8Fk3Lu/trial.log+18−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-differential-cryptanalysis__m8Fk3Lu/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-differential-cryptanalysis__m8Fk3Lu/verifier/test-stdout.txt+412−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-linear-cryptanalysis__7S6zdtn/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-linear-cryptanalysis__7S6zdtn/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-linear-cryptanalysis__7S6zdtn/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-linear-cryptanalysis__7S6zdtn/trial.log+22−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-linear-cryptanalysis__7S6zdtn/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/feal-linear-cryptanalysis__7S6zdtn/verifier/test-stdout.txt+36−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/filter-js-from-html__Vkrtda3/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/filter-js-from-html__Vkrtda3/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/filter-js-from-html__Vkrtda3/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/filter-js-from-html__Vkrtda3/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/filter-js-from-html__Vkrtda3/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/filter-js-from-html__Vkrtda3/verifier/test-stdout.txt+1089−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/financial-document-processor__NFEqGrd/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/financial-document-processor__NFEqGrd/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/financial-document-processor__NFEqGrd/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/financial-document-processor__NFEqGrd/trial.log+25−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/financial-document-processor__NFEqGrd/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/financial-document-processor__NFEqGrd/verifier/test-stdout.txt+49−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-code-vulnerability__6Kaarzp/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-code-vulnerability__6Kaarzp/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-code-vulnerability__6Kaarzp/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-code-vulnerability__6Kaarzp/trial.log+64−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-code-vulnerability__6Kaarzp/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-code-vulnerability__6Kaarzp/verifier/test-stdout.txt+441−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-git__9J29qns/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-git__9J29qns/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-git__9J29qns/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-git__9J29qns/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-git__9J29qns/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-git__9J29qns/verifier/test-stdout.txt+36−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-ocaml-gc__iAWLxam/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-ocaml-gc__iAWLxam/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-ocaml-gc__iAWLxam/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-ocaml-gc__iAWLxam/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-ocaml-gc__iAWLxam/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/fix-ocaml-gc__iAWLxam/verifier/test-stdout.txt+3398−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gcode-to-text__9harFdo/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gcode-to-text__9harFdo/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gcode-to-text__9harFdo/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gcode-to-text__9harFdo/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gcode-to-text__9harFdo/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gcode-to-text__9harFdo/verifier/test-stdout.txt+36−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-leak-recovery__4yHejgE/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-leak-recovery__4yHejgE/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-leak-recovery__4yHejgE/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-leak-recovery__4yHejgE/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-leak-recovery__4yHejgE/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-leak-recovery__4yHejgE/verifier/test-stdout.txt+48−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-multibranch__8UForCe/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-multibranch__8UForCe/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-multibranch__8UForCe/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-multibranch__8UForCe/trial.log+30−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-multibranch__8UForCe/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/git-multibranch__8UForCe/verifier/test-stdout.txt+186−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/trial.log+12−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/gpt2-codegolf__iZKiCo2/verifier/test-stdout.txt+58−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/headless-terminal__vmexRrG/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/headless-terminal__vmexRrG/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/headless-terminal__vmexRrG/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/headless-terminal__vmexRrG/trial.log+22−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/headless-terminal__vmexRrG/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/headless-terminal__vmexRrG/verifier/test-stdout.txt+192−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/hf-model-inference__27F6bBn/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/hf-model-inference__27F6bBn/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/hf-model-inference__27F6bBn/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/hf-model-inference__27F6bBn/trial.log+40−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/hf-model-inference__27F6bBn/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/hf-model-inference__27F6bBn/verifier/test-stdout.txt+53−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/trial.log+25−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/install-windows-3.11__YNe5boL/verifier/test-stdout.txt+229−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/job.log+2321−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/kv-store-grpc__7uE6vGZ/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/kv-store-grpc__7uE6vGZ/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/kv-store-grpc__7uE6vGZ/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/kv-store-grpc__7uE6vGZ/trial.log+22−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/kv-store-grpc__7uE6vGZ/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/kv-store-grpc__7uE6vGZ/verifier/test-stdout.txt+68−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/large-scale-text-editing__w2cE9yR/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/large-scale-text-editing__w2cE9yR/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/large-scale-text-editing__w2cE9yR/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/large-scale-text-editing__w2cE9yR/trial.log+30−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/large-scale-text-editing__w2cE9yR/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/large-scale-text-editing__w2cE9yR/verifier/test-stdout.txt+39−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/largest-eigenval__YEN9YnE/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/largest-eigenval__YEN9YnE/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/largest-eigenval__YEN9YnE/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/largest-eigenval__YEN9YnE/trial.log+19−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/largest-eigenval__YEN9YnE/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/largest-eigenval__YEN9YnE/verifier/test-stdout.txt+136−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/trial.log+89−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/llm-inference-batching-scheduler__c9N35jv/verifier/test-stdout.txt+339−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/log-summary-date-ranges__byFpC2K/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/log-summary-date-ranges__byFpC2K/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/log-summary-date-ranges__byFpC2K/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/log-summary-date-ranges__byFpC2K/trial.log+41−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/log-summary-date-ranges__byFpC2K/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/log-summary-date-ranges__byFpC2K/verifier/test-stdout.txt+36−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/trial.log+27−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mailman__sRHZR4b/verifier/test-stdout.txt+402−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/trial.log+12−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-doom-for-mips__MYUDCMF/verifier/test-stdout.txt+351−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-mips-interpreter__JjoJ8Ye/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-mips-interpreter__JjoJ8Ye/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-mips-interpreter__JjoJ8Ye/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-mips-interpreter__JjoJ8Ye/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-mips-interpreter__JjoJ8Ye/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/make-mips-interpreter__JjoJ8Ye/verifier/test-stdout.txt+235−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mcmc-sampling-stan__zTXviFU/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mcmc-sampling-stan__zTXviFU/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mcmc-sampling-stan__zTXviFU/exception.txt+86−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mcmc-sampling-stan__zTXviFU/result.json+104−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mcmc-sampling-stan__zTXviFU/trial.log+34−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mcmc-sampling-stan__zTXviFU/verifier/test-stdout.txt+0−0
Binary file, not shown.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/merge-diff-arc-agi-task__R4qUkPN/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/merge-diff-arc-agi-task__R4qUkPN/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/merge-diff-arc-agi-task__R4qUkPN/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/merge-diff-arc-agi-task__R4qUkPN/trial.log+30−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/merge-diff-arc-agi-task__R4qUkPN/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/merge-diff-arc-agi-task__R4qUkPN/verifier/test-stdout.txt+43−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/model-extraction-relu-logits__tP6MLFN/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/model-extraction-relu-logits__tP6MLFN/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/model-extraction-relu-logits__tP6MLFN/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/model-extraction-relu-logits__tP6MLFN/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/model-extraction-relu-logits__tP6MLFN/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/model-extraction-relu-logits__tP6MLFN/verifier/test-stdout.txt+37−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/modernize-scientific-stack__XEntoXY/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/modernize-scientific-stack__XEntoXY/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/modernize-scientific-stack__XEntoXY/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/modernize-scientific-stack__XEntoXY/trial.log+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/modernize-scientific-stack__XEntoXY/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/modernize-scientific-stack__XEntoXY/verifier/test-stdout.txt+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-leaderboard__bZCNPD5/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-leaderboard__bZCNPD5/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-leaderboard__bZCNPD5/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-leaderboard__bZCNPD5/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-leaderboard__bZCNPD5/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-leaderboard__bZCNPD5/verifier/test-stdout.txt+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-retrieve__GkGXcQb/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-retrieve__GkGXcQb/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-retrieve__GkGXcQb/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-retrieve__GkGXcQb/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-retrieve__GkGXcQb/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/mteb-retrieve__GkGXcQb/verifier/test-stdout.txt+106−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/multi-source-data-merger__Cv9XjhZ/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/multi-source-data-merger__Cv9XjhZ/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/multi-source-data-merger__Cv9XjhZ/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/multi-source-data-merger__Cv9XjhZ/trial.log+74−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/multi-source-data-merger__Cv9XjhZ/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/multi-source-data-merger__Cv9XjhZ/verifier/test-stdout.txt+43−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/nginx-request-logging__XbEkuG5/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/nginx-request-logging__XbEkuG5/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/nginx-request-logging__XbEkuG5/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/nginx-request-logging__XbEkuG5/trial.log+36−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/nginx-request-logging__XbEkuG5/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/nginx-request-logging__XbEkuG5/verifier/test-stdout.txt+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/openssl-selfsigned-cert__XQHRe3U/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/openssl-selfsigned-cert__XQHRe3U/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/openssl-selfsigned-cert__XQHRe3U/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/openssl-selfsigned-cert__XQHRe3U/trial.log+41−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/openssl-selfsigned-cert__XQHRe3U/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/openssl-selfsigned-cert__XQHRe3U/verifier/test-stdout.txt+40−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/overfull-hbox__DVR6Ccb/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/overfull-hbox__DVR6Ccb/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/overfull-hbox__DVR6Ccb/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/overfull-hbox__DVR6Ccb/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/overfull-hbox__DVR6Ccb/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/overfull-hbox__DVR6Ccb/verifier/test-stdout.txt+135−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/password-recovery__yJ2Nbob/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/password-recovery__yJ2Nbob/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/password-recovery__yJ2Nbob/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/password-recovery__yJ2Nbob/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/password-recovery__yJ2Nbob/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/password-recovery__yJ2Nbob/verifier/test-stdout.txt+39−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing-reverse__fLEvHWw/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing-reverse__fLEvHWw/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing-reverse__fLEvHWw/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing-reverse__fLEvHWw/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing-reverse__fLEvHWw/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing-reverse__fLEvHWw/verifier/test-stdout.txt+60−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing__z64MBQc/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing__z64MBQc/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing__z64MBQc/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing__z64MBQc/trial.log+18−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing__z64MBQc/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/path-tracing__z64MBQc/verifier/test-stdout.txt+46−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-c-py__Q5zPx8U/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-c-py__Q5zPx8U/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-c-py__Q5zPx8U/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-c-py__Q5zPx8U/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-c-py__Q5zPx8U/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-c-py__Q5zPx8U/verifier/test-stdout.txt+58−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/trial.log+20−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/polyglot-rust-c__3VMsvPU/verifier/test-stdout.txt+52−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/portfolio-optimization__GnPj7br/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/portfolio-optimization__GnPj7br/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/portfolio-optimization__GnPj7br/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/portfolio-optimization__GnPj7br/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/portfolio-optimization__GnPj7br/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/portfolio-optimization__GnPj7br/verifier/test-stdout.txt+44−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/protein-assembly__DKonMkU/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/protein-assembly__DKonMkU/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/protein-assembly__DKonMkU/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/protein-assembly__DKonMkU/trial.log+46−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/protein-assembly__DKonMkU/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/protein-assembly__DKonMkU/verifier/test-stdout.txt+39−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/prove-plus-comm__uvceQtX/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/prove-plus-comm__uvceQtX/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/prove-plus-comm__uvceQtX/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/prove-plus-comm__uvceQtX/trial.log+23−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/prove-plus-comm__uvceQtX/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/prove-plus-comm__uvceQtX/verifier/test-stdout.txt+41−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pypi-server__th8Qs3i/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pypi-server__th8Qs3i/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pypi-server__th8Qs3i/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pypi-server__th8Qs3i/trial.log+21−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pypi-server__th8Qs3i/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pypi-server__th8Qs3i/verifier/test-stdout.txt+61−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-cli__7YM5rW3/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-cli__7YM5rW3/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-cli__7YM5rW3/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-cli__7YM5rW3/trial.log+18−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-cli__7YM5rW3/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-cli__7YM5rW3/verifier/test-stdout.txt+1232−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-recovery__RBgKibV/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-recovery__RBgKibV/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-recovery__RBgKibV/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-recovery__RBgKibV/trial.log+24−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-recovery__RBgKibV/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/pytorch-model-recovery__RBgKibV/verifier/test-stdout.txt+81−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/trial.log+12−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-alpine-ssh__jtruRcn/verifier/test-stdout.txt+164−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/trial.log+12−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/qemu-startup__dZSZcPn/verifier/test-stdout.txt+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/trial.log+19−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/query-optimize__gxdx4Mo/verifier/test-stdout.txt+46−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/raman-fitting__QhcqCxP/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/raman-fitting__QhcqCxP/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/raman-fitting__QhcqCxP/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/raman-fitting__QhcqCxP/trial.log+30−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/raman-fitting__QhcqCxP/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/raman-fitting__QhcqCxP/verifier/test-stdout.txt+104−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-chess__SoDEtuz/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-chess__SoDEtuz/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-chess__SoDEtuz/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-chess__SoDEtuz/trial.log+39−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-chess__SoDEtuz/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-chess__SoDEtuz/verifier/test-stdout.txt+278−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-log__5GZyUZP/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-log__5GZyUZP/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-log__5GZyUZP/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-log__5GZyUZP/trial.log+31−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-log__5GZyUZP/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/regex-log__5GZyUZP/verifier/test-stdout.txt+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/reshard-c4-data__Jo5NUcW/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/reshard-c4-data__Jo5NUcW/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/reshard-c4-data__Jo5NUcW/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/reshard-c4-data__Jo5NUcW/trial.log+27−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/reshard-c4-data__Jo5NUcW/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/reshard-c4-data__Jo5NUcW/verifier/test-stdout.txt+139−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/result.json+137−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/rstan-to-pystan__fLuJbtZ/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/rstan-to-pystan__fLuJbtZ/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/rstan-to-pystan__fLuJbtZ/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/rstan-to-pystan__fLuJbtZ/trial.log+37−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/rstan-to-pystan__fLuJbtZ/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/rstan-to-pystan__fLuJbtZ/verifier/test-stdout.txt+43−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sam-cell-seg__HuzftFu/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sam-cell-seg__HuzftFu/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sam-cell-seg__HuzftFu/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sam-cell-seg__HuzftFu/trial.log+63−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sam-cell-seg__HuzftFu/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sam-cell-seg__HuzftFu/verifier/test-stdout.txt+1867−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sanitize-git-repo__dT4FQU2/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sanitize-git-repo__dT4FQU2/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sanitize-git-repo__dT4FQU2/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sanitize-git-repo__dT4FQU2/trial.log+25−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sanitize-git-repo__dT4FQU2/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sanitize-git-repo__dT4FQU2/verifier/test-stdout.txt+38−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/schemelike-metacircular-eval__uJaVGzF/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/schemelike-metacircular-eval__uJaVGzF/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/schemelike-metacircular-eval__uJaVGzF/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/schemelike-metacircular-eval__uJaVGzF/trial.log+23−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/schemelike-metacircular-eval__uJaVGzF/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/schemelike-metacircular-eval__uJaVGzF/verifier/test-stdout.txt+364−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sparql-university__H6bHwWL/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sparql-university__H6bHwWL/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sparql-university__H6bHwWL/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sparql-university__H6bHwWL/trial.log+31−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sparql-university__H6bHwWL/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sparql-university__H6bHwWL/verifier/test-stdout.txt+217−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-db-truncate__Q4FxSL6/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-db-truncate__Q4FxSL6/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-db-truncate__Q4FxSL6/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-db-truncate__Q4FxSL6/trial.log+13−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-db-truncate__Q4FxSL6/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-db-truncate__Q4FxSL6/verifier/test-stdout.txt+35−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-with-gcov__N8oqKpH/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-with-gcov__N8oqKpH/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-with-gcov__N8oqKpH/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-with-gcov__N8oqKpH/trial.log+14−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-with-gcov__N8oqKpH/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/sqlite-with-gcov__N8oqKpH/verifier/test-stdout.txt+40−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-pipeline-parallelism__2RjPPWb/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-pipeline-parallelism__2RjPPWb/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-pipeline-parallelism__2RjPPWb/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-pipeline-parallelism__2RjPPWb/trial.log+45−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-pipeline-parallelism__2RjPPWb/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-pipeline-parallelism__2RjPPWb/verifier/test-stdout.txt+352−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-tensor-parallelism__Gsp3Aqn/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-tensor-parallelism__Gsp3Aqn/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-tensor-parallelism__Gsp3Aqn/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-tensor-parallelism__Gsp3Aqn/trial.log+31−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-tensor-parallelism__Gsp3Aqn/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/torch-tensor-parallelism__Gsp3Aqn/verifier/test-stdout.txt+747−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/trial.log+16−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/train-fasttext__Ar2ncxD/verifier/test-stdout.txt+87−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/exception.txt+73−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/result.json+108−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/trial.log+17−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/tune-mjcf__if3YgBX/verifier/test-stdout.txt+82−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/video-processing__s7MqoCw/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/video-processing__s7MqoCw/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/video-processing__s7MqoCw/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/video-processing__s7MqoCw/trial.log+37−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/video-processing__s7MqoCw/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/video-processing__s7MqoCw/verifier/test-stdout.txt+124−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/vulnerable-secret__fYZAVs5/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/vulnerable-secret__fYZAVs5/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/vulnerable-secret__fYZAVs5/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/vulnerable-secret__fYZAVs5/trial.log+19−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/vulnerable-secret__fYZAVs5/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/vulnerable-secret__fYZAVs5/verifier/test-stdout.txt+37−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/winning-avg-corewars__yjhFH2R/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/winning-avg-corewars__yjhFH2R/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/winning-avg-corewars__yjhFH2R/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/winning-avg-corewars__yjhFH2R/trial.log+27−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/winning-avg-corewars__yjhFH2R/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/winning-avg-corewars__yjhFH2R/verifier/test-stdout.txt+48−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/write-compressor__66tspro/agent/mini-coder.stderr.txt+0−0
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/write-compressor__66tspro/config.json+50−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/write-compressor__66tspro/result.json+103−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/write-compressor__66tspro/trial.log+14−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/write-compressor__66tspro/verifier/reward.txt+1−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/jobs/leaderboard-2026-04-10__16-06-57/write-compressor__66tspro/verifier/test-stdout.txt+40−0
Cut short: this commit's diff is over 1000 lines.
terminal-bench/readme.md+24−0
Cut short: this commit's diff is over 1000 lines.