AgenticVBench-Omni

AgenticVBench-Omni / Asset reconstruction

Blender Advanced

blender-advanced-session-reimplementation

session.mp4 (1920x1080, 20 fps, 41.7 minutes, narrated) shows a Blender session building a procedural tree/rock/moss scene from still_life_start.blend, entirely from scratch: shader and geometry-node trees are created node by node, values are dialed in, connections are wired, node groups are nested inside other trees, and materials and Geometry Nodes modifiers are assigned to objects. Some trees are edited more than once over the course of the recording — the state that counts is the last one the recording shows. There is no recap or review pass at the end; a value or link's final state may only be shown once, well before the recording ends.

Family
Asset reconstruction
Inputs
video
Media
1 video, 42 min, with sound
Reference answer
23 node trees with 838 nodes
Deliverable
/workspace/output
Scoring
per-component

Task package · verifier code

Instruction

Full instruction given to the agent

Rebuild a Blender session: node trees, groups and object assignments

session.mp4 (1920x1080, 20 fps, 41.7 minutes, narrated) shows a Blender session building a procedural tree/rock/moss scene from still_life_start.blend, entirely from scratch: shader and geometry-node trees are created node by node, values are dialed in, connections are wired, node groups are nested inside other trees, and materials and Geometry Nodes modifiers are assigned to objects. Some trees are edited more than once over the course of the recording — the state that counts is the last one the recording shows. There is no recap or review pass at the end; a value or link's final state may only be shown once, well before the recording ends.

still_life_start.blend already has every object, mesh, empty, collection, camera and light the finished scene needs. What it does not have: the node trees below (each is present only as whatever Blender creates for a brand new material, world or node group — a bare Principled BSDF -> Material Output, or an empty Group Input -> Group Output), and no object has any of the material-slot or Geometry Nodes modifier assignments listed below.

Deliverable

output/still_life.blend: still_life_start.blend with every tree below rebuilt and every assignment below made, saved by Blender. Only this file is read. Keep the tree and object names exactly as they are in the start file.

Trees to rebuild

For each of these, rebuild the tree exactly as the recording shows it in its final state:

tree kind
Bark 3 - Weave shader node group
TEX-bark3_weave shader node group
bark_oak_branches material
Bark 2 - Yew Test shader node group
TEX-bark2_cracks shader node group
bark_oak material
rock_basic material
leaves-oak material
TEX- proc_rock_base shader node group
moss material
UT-random_color_variation shader node group
UT-random_color_variation.001 shader node group
Auto Smooth geometry-node group
Moss Base material
Tree Moss geometry-node group
UT-UV_Xnoise shader node group
UT-noise_distort shader node group
World.bright world shading
Moss - Add geometry-node group
Clay Shader shader node group
Distortion Profile shader node group
HLP-bark3_distortion_profile shader node group
HLP-bark3_profile shader node group

Three more node groups appear in the recording and are used by objects below (see the assignment table), but only their declared group inputs/outputs are compared (name, socket type, order, and default value for the ones the recording shows), not their internal nodes or links:

group kind
Moss geometry-node group
Tree Leaves geometry-node group
fill geometry-node group

What must match, per tree (the 23 fully-compared trees above)

A tree counts only if all of the following match:

  1. Nodes: the number of nodes of each node type. Frames and reroutes are ignored.
  2. Connections: every link, from output socket to input socket. The two value inputs of Math and Vector Math nodes set to Add, Multiply, Minimum or Maximum are interchangeable, and so are the X and Y outputs of Separate XYZ.
  3. Node settings: every option drawn on the node (dropdowns such as operation, blend type, interpolation, dimensions or data type; checkboxes such as Clamp, Normalize), and the node group, object or collection a node references.
  4. Values: every numeric input that is not connected. Floats must be within 0.001 (Blender draws three decimals); integers and booleans must match exactly. This includes the components of vector inputs and any attribute-name text fields.
  5. Colour ramps: the interpolation, colour mode, number of stops and every stop colour.
  6. Colours: every colour swatch of an unconnected colour input and every colour-ramp stop colour, as Blender displays it (sRGB-encoded, 0-1 per channel). Each of red, green and blue must be within 0.02; alpha is ignored.
  7. Group interfaces: if the tree is a node group (not a material or world), its declared inputs and outputs — name, socket type, order, and default value for unconnected sockets — must match.

Not compared: node names, labels, locations, frames and colours/widths used only for node-editor display; inputs Blender draws without a value field.

Object assignments

For every object below, the recording shows which material(s) sit in its material slots (in order) and, where listed, a Geometry Nodes modifier with the given name, referencing the given node group, with the given exposed inputs dialed to specific values (a collection, an object, a number, a vector or a checkbox — whichever the recording shows on that input row). Reproduce every one of these exactly: the right material in the right slot, the right node group on the right modifier, and every listed input at the value the recording's last view of it shows (numeric inputs within 0.001).

object material slot(s), in order Geometry Nodes modifier(s): name -> group (exposed inputs)
GEO-leaves-oak.004 leaves-oak -
GEO-leaves-oak.005 leaves-oak -
GEO-leaves-oak.006 leaves-oak -
GEO-moss.1 moss -
GEO-moss.2 moss -
GEO-moss.3 moss Auto Smooth -> Auto Smooth (1 inputs)
GEO-moss.4 moss Auto Smooth -> Auto Smooth (1 inputs)
GEO-oak.1_trunk bark_oak -
GEO-oak.1_trunk.moss_base bark_oak GeometryNodes -> fill (0 inputs)
GEO-tree_branch_medium_01 bark_oak_branches -
GEO-tree_branch_medium_02 bark_oak_branches -
GEO-tree_branch_medium_03 bark_oak_branches -
GEO-tree_branch_medium_04 bark_oak_branches -
GEO-tree_branch_medium_06 bark_oak_branches -
GEO-tree_branch_medium_07 bark_oak_branches -
GEO-tree_branch_medium_08 bark_oak_branches -
GEO-tree_branch_small_01 bark_oak_branches -
GEO-tree_branch_small_02 bark_oak_branches -
GEO-tree_branch_small_03 bark_oak_branches -
GEO-tree_branch_small_04 bark_oak_branches -
GEO-tree_branch_small_05 bark_oak_branches -
GEO-tree_branch_small_06 bark_oak_branches -
GEO-tree_branch_small_07 bark_oak_branches -
GEO-tree_branch_small_08 bark_oak_branches -
GEO-tree_branch_twig-01 bark_oak_branches -
GEO-tree_branch_twig_02 bark_oak_branches -
GEO-tree_branch_twig_03 bark_oak_branches -
GEO-tree_branch_twig_04 bark_oak_branches -
GEO-tree_branch_twig_05 bark_oak_branches -
GEO-tree_branch_twig_06 bark_oak_branches -
GEO-tree_branch_twig_07 bark_oak_branches -
GEO-tree_branch_twig_08 bark_oak_branches -
GEO-tree_branch_twig_09 bark_oak_branches -
GEO-tree_branch_twig_10 bark_oak_branches -
Tree_Leaves - GeometryNodes -> Tree Leaves (5 inputs)
Tree_Moss Moss Base GeometryNodes -> Tree Moss (4 inputs)
rock rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
rock.001 rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
rock.002 rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
rock.003 rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
rock.004 rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
rock.005 rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
rock.006 rock_basic; Moss Base GeometryNodes -> Moss - Add (9 inputs); Auto Smooth -> Auto Smooth (1 inputs)
## Environment
  • Blender 5.1 is installed headless: run blender -b ... with --python / --python-expr; there is no display.
  • ffmpeg, tesseract and faster-whisper (model small.en, cached) are installed. You cannot hear the audio; transcribe it if you need the narration.

Rules

Work only inside the current working directory. No internet. Do not use any memory you may have of this scene or its source; everything you need is in the video and the start file.

Media

Media files are distributed separately from the repository; this task’s hash manifest lists 2 files (environment/media/SHA256SUMS.txt). Licences named for this task: see the provenance notes in the task package.

Score

AgentScore (0 to 1)
GPT-6-Astra0.118
Claude Opus 5.50.127
Claude Opus 50.103
Gemini 3.8 Flash0.000
DeepSeek 4.1 Flash0.000

One run per agent.

The agent watches a 41.7-minute narrated recording of a Blender session that builds a procedural scene of trees, rocks and moss from a starter file, node by node, and delivers the resulting .blend. Blender itself reads both files, and the verifier compares what it reports. The reference holds 23 scored node trees with 838 nodes in all, 68 material and modifier assignments, and 3 node-group interfaces.

What a good answer has to get right, and how the verifier checks it

Each node tree is rebuilt exactly
23 shader and geometry node trees are scored, paired by name. A tree counts only when its set of node types, every scored setting and colour of every node, its group interface and every connection all match. This part is worth 0.85 of the score.
Bigger trees weigh more
Within that part, each tree’s weight is its number of nodes, 838 in all. A tree with one wrong link earns nothing for that tree.
Materials and modifiers are assigned
68 items, worth 0.12: which material sits in which slot of which object, and which node group is on which object’s Geometry Nodes modifier together with the input values set on that modifier. A modifier item needs the group and every scored input right.
Group interfaces are declared
3 node groups are checked for their declared inputs and outputs: types, names, order and default values. Worth 0.03.

How the checks become one score

Score = 0.85 × share of node-tree weight right + 0.12 × share of assignment weight right + 0.03 × share of group interfaces right. The three parts are added, so a submission with correct assignments and no correct tree can reach 0.15.

What scores zero

No still_life.blend, a file Blender cannot open, or a file in which no tree, assignment or interface matches.

Outside the score: the rendered image and the scene objects that already come with the starter file. A note in the task package (provenance/CURRENT_FROZEN_SOURCE_20260918.md) records a known limitation: for some of the scored modifier input values it has not been established that the recording shows them being set.

The score line and constants in the verifier code

Reward formula in the verifier code

Two sampled runs

Two of the five runs on this task in the paper’s diagnostic sample, which has one run per system: the highest-scoring run, and the run in the middle of the other systems by score. Only runs that ended normally and whose record could be exported are eligible. Each is shown step by step: what the agent said, which tools it called, and what it got back (long outputs and images are clipped). The verifier's output for the run comes first, then the steps.

Agent
GPT-6-Astra · Codex 0.154.0
Score
0.12
Wall time
18.7 min
Steps shown
82

Loading the run…