AgenticVBench-Omni

AgenticVBench-Omni / Asset reconstruction

Classroom

abandoned-classroom-scene-reimplementation

You are handed off a Blender project that a colleague built for a client over a long session, under the client's direction. The client's own art director is not available to walk you through it again in person, so a recording was made instead: a narrated tour of the finished scene. Your job is to rebuild that scene as faithfully as you can, working only from what is in this directory.

Family
Asset reconstruction
Inputs
videodocuments
Media
1 video, 72 min, with sound
Reference answer
47 desks, 18 chairs and 41 materials
Deliverable
/workspace/output
Scoring
per-component

Task package · verifier code

Instruction

Full instruction given to the agent

Rebuild the abandoned-classroom scene

You are handed off a Blender project that a colleague built for a client over a long session, under the client's direction. The client's own art director is not available to walk you through it again in person, so a recording was made instead: a narrated tour of the finished scene. Your job is to rebuild that scene as faithfully as you can, working only from what is in this directory.

What you have

  • start.blend — open this in Blender. It has the camera (Camera | Reference) and nothing else: no walls, no furniture, no materials. Build everything else from scratch inside it (or a copy of it), and set the final render resolution to 3840x2880 to match the camera framing shown in the recording.
  • handover_recording.mp4 — a narrated screen recording of the finished scene: a flythrough from the reference camera, the outliner expanded section by section, close-up inspection of the furniture and fixtures, the material node trees opened one at a time, and the physics-settled chair and wall-debris state. Watch the whole thing; details are not repeated, and later moments can override what an earlier moment showed.
  • reference/reference_photo.png — the original photo the scene is based on.
  • reference/depth_aid.png, reference/whitemodel_aid.png — two aids the original art director used to judge depth and proportion. They are aids, not ground truth; the photo and the recording are what the finished scene actually matches.
  • reference/instruction_attachments/ — photos the client sent alongside specific corrections (numbered to match the prompts below), showing things like the desk hole pattern, the fan style, the switch plate style.
  • Prompts_original_zh.md / Prompts_original_en.md — the client's actual instructions and corrections to the person who built this, in time order (Chinese original and an English rendering of the same text). This tells you what the client cared about and corrected; it is not a spec and does not state final dimensions.
  • textures/ — seven material sets (each a folder of diffuse/roughness/displacement JPGs at 8K or 16K): grey_plaster, damaged_concrete_floor, wood_table_worn, peeling_painted_wall, weathered_peeling_timber, blue_plaster_weathered, rusty_metal_sheet.

Work only inside this directory. There is no internet access and no other memory of this project — everything you need is here or in the recording.

What to submit

Save your finished file to output/abandoned_classroom.blend. It must open in Blender 5.2. Set Camera | Reference as the active camera and keep the scene named Abandoned Classroom | Flash. Grading re-renders your file itself (a fixed, neutral render setup, not whatever render engine or samples you left saved), so do not spend time tuning a final beauty render — get the geometry, materials and layout right instead.

Required tags (read this section carefully — it is graded mechanically)

Because your rebuild will have its own object names, every object playing one of the roles below must carry a Blender custom property (Object Properties > Custom Properties, or obj["sr12_role"] = "..." in Python) so the grader can find it. Use exactly these string values (closed vocabulary — nothing else is recognized):

sr12_role value how many what it marks
wall 4 one per room-boundary wall (left, right, entrance end, blackboard/teaching end)
ceiling 1 the ceiling slab
floor 1 the floor slab
column_beam 1 the load-bearing column + ceiling beam structure
window 1 the window assembly (jamb/mullion/transom/grille as one object or a parent empty covering the whole assembly)
blackboard 1 the blackboard writing surface
fan 3 one per ceiling fan (tag the fan's root/parent object)
lamp_fixture 6 one per hanging fluorescent fixture (tag the fixture's root/parent object)
switch_panel 2 one per wall switch plate near the entrance
desk 47 total (46 of these + 1 desk_hero, see below) one per desk, tagged on the desk's root/parent object
desk_hero 1 (part of the 47) exactly one desk, built in full construction detail (see "Canonical desk" below); this one does not also carry sr12_role=desk
desk_part see below children of the desk_hero object only
chair 18 one per chair, tagged on the chair's root/parent object
wall_peel_fragment ~46 (exact count is part of what's graded) one per fallen wall-plaster fragment

Additional custom properties, required only on the objects noted:

  • On each lamp_fixture object: sr12_has_tube = True or False — whether that fixture's tube is present (the recording shows one fixture still empty).
  • On each switch_panel object: sr12_control_count = an integer — how many buttons/knobs are on that plate.
  • On each child of desk_hero: sr12_part = one of top, tray, blue_edge, side_panel (two of these), leg (two of these), foot (two of these), cross_brace, fastener (any number) — matching the desk construction the recording shows in close-up. Parent every one of these to the desk_hero object (direct or indirect Blender parenting).
Canonical desk (desk_hero)

The recording shows one desk in construction-level detail: the stamped steel side panels with their punched holes, the ribbed book tray, the folded blue edge band, the wood top, the legs and feet, the central fastener. Build this one desk to that level of detail and tag its parts as above. The other 46 desks only need correct position, footprint and general appearance — you do not need side-panel-level detail on every copy, but each needs its own sr12_role=desk tag at its own position.

Materials

Give every material a name and rebuild the same node structure (image texture nodes wired to the same texture-set files under textures/, the same Principled BSDF settings, bump/displacement where the recording shows it, colour ramps where shown) as the material the recording shows on that surface. The recording's shader-editor view names each material as it opens it — reuse that exact name for the corresponding material in your file (this is the one place exact naming is graded; everywhere else, position and structure are what's graded, not names). Every material must show real per-instance variation where the recording shows it (e.g. desks do not all look identical) — do this with material nodes and/or geometry, not by eye alone.

Physics-settled state

The chairs and fallen wall-plaster are shown already settled (some chairs stacked on each other, plaster fragments resting on desks and the floor in the middle of the room). You do not need to run a physics simulation — just place the final objects in the resting positions and orientations the recording shows, correctly stacked/supported.

Definitions, units and tolerances

  • All positions are in meters, in the scene's own world space, relative to the room (e.g. "near the blackboard end" means large Y in a right-handed scene with the blackboard wall at positive Y and the entrance at Y=0, matching start.blend's existing camera).
  • "Near the blackboard end" = further from the entrance door than roughly 55% of the room's interior depth. "Near the door" = within roughly 20% of the room's interior depth from the entrance wall.
  • A chair counts as "upright" if its tallest local axis remains close to vertical in the final scene (i.e. it was not tipped or laid down); otherwise it counts as "tipped/lying".
  • A chair "rests on" another chair if the two are stacked with a small horizontal offset and a vertical gap consistent with one chair seat's height above the other.
  • A wall-peel fragment counts as "layered" if it has a visibly different front (painted) face, back (base-coat) face and broken edge — i.e. more than one material assigned to it, matching what the recording's close-ups show.
  • Positions of fixed structural landmarks (walls, ceiling, floor, columns, window, blackboard, fans, lamp fixtures, switch panels) should match what is legible from the recording (N-panel transform values are shown on screen for these) to within about 5-15 cm depending on the item (switch plates tightest, columns/windows loosest).
  • Desk and wall-peel-fragment positions are not individually read out in the recording; place them by eye from the flythrough and outliner framing — exact placement is not expected, but the overall count, region, and layout should match what you saw.

No internet, no other memory

Do not use any prior knowledge of this specific project. Everything you need is in this folder. Standard Blender knowledge (how modifiers, geometry nodes and shader nodes work) is fine to use; specific facts about this scene are not.

Media

Media files are distributed separately from the repository; this task’s hash manifest lists 45 files (environment/media/SHA256SUMS.txt). Licences named for this task: see the provenance notes in the task package.

Score

AgentScore (0 to 1)
GPT-6-Astra0.195
Claude Opus 5.50.199
Claude Opus 50.178
Gemini 3.8 Flash0.064
DeepSeek 4.1 Flash0.178

One run per agent.

The agent gets a narrated screen recording that tours a finished Blender scene of an abandoned classroom, a starter file containing only the camera, and the reference photo. It rebuilds the scene and delivers the .blend. Blender reads both files, and the verifier compares seven aspects of the scene. The reference scene has 20 structural elements, 47 desks, 18 chairs, 46 fragments of peeling wall and 41 materials.

What a good answer has to get right, and how the verifier checks it

The room is laid out correctly (0.22)
Positions and sizes of walls, ceiling, floor, columns, window, blackboard, the three fans, six lamp fixtures and two switch panels, each matched to the nearest object the submission tags with that role.
The furniture is all there, where it stands (0.08)
Desk and chair counts by region of the room, and each desk’s position matched one to one, so a regular grid of identical desks does not pass.
The desk is modelled in detail (0.20)
The parts of the reference desk, compared by mesh size and by vertex and face counts after modifiers.
Chairs are posed and stacked as shown (0.12)
Whether each chair is upright or tipped, and which chair rests on which. Relations are compared, not exact resting poses.
The peeling wall is reproduced (0.13)
The number of fragments, where they are, how many are still on the wall and how many on the floor, and whether each has its layered material.
Materials are built the same way (0.18)
Each material’s node tree is compared in structure. Materials are paired by name where the names agree and otherwise by best structural fit.
It looks the same from the reference camera (0.07)
A plain render from the reference camera is compared with the same render of the delivered scene by structural similarity.

How the checks become one score

Score = the weighted sum of the seven parts, with the weights shown above; they add up to 1. Each part has its own score between 0 and 1, so a partly rebuilt scene earns credit for what is there.

What scores zero

No abandoned_classroom.blend, a file Blender cannot open, or a scene in which none of the seven parts has anything right.

Outside the score: the pixel content of textures, which is never compared.

The score line and constants in the verifier code

Reward formula in the verifier code

Two sampled runs

Two of the five runs on this task in the paper’s diagnostic sample, which has one run per system: the highest-scoring run, and the run in the middle of the other systems by score. Only runs that ended normally and whose record could be exported are eligible. Each is shown step by step: what the agent said, which tools it called, and what it got back (long outputs and images are clipped). The verifier's output for the run comes first, then the steps.

Agent
GPT-6-Astra · Codex 0.154.0
Score
0.19
Wall time
16.8 min
Steps shown
50

Loading the run…