Watch the pieces
find their place.
Teach a small visual world. Break a new image into 36 fragments. Then watch learned spatial expectations and visual continuity pull the fragments into an arrangement. Nothing is moved using its original position.
V3 · Hierarchical sieve image model: learn, deform, remember and test real photographs →
NEW · Learn movable visual fragments and reconstruct what cannot be seen →
Online memory + local relations + search.
No pretrained model. No network. No backprop required.
Source and tests ↗
1. Give the system experience
Choose a repeating visual world. Each intact example updates 36 fragment prototypes and their neighboring feature differences. Tests use fresh examples that weren't taught.
2. Give it a puzzle it hasn't seen
All 36 image tiles remain available but arrive in random positions. The learner must find their arrangement. This tests assembly, not yet synthesis of unseen pixels.
Inside the search
What this demonstration does — and what it doesn't
This is an interpretable assembly model. It learns from complete images without labels. A globally optimized one-to-one assignment and local swap search find plausible tile positions. The animated tile swaps show the resulting computed arrangement; they are not simulated neural firing. For evaluation only, the app retains original tile indices and measures exact placement and pixel error; the optimizer never reads them.
Its learned locations assume a stable visual layout. The built-in worlds are stylized and deliberately structured. For your own photos, teach multiple similar compositions, then test a different photograph. Diverse unrelated photographs, changing camera angles, repeated blank sky, and unfamiliar subjects can defeat this model. It does not yet invent details, discover movable object groupings, implement dendrites, or qualify as a competitive modern generative model.
Next research step: hierarchical coarse-to-fine groups with learned conditional predictions, explicit missing-patch synthesis, held-out real photographs, and controlled comparisons against seam-only jigsaws and ordinary image priors.