A Woolly Mammoth Stands on a Desk as Simulon Reenacts a Phone Recording

A woolly mammoth stands on an office desk, with a caveman figurine dressed in animal skins beside it. Off camera, a man raises his phone and records them. This is the Reality-Aware Rendering demo Simulon posted on X; Robert Scoble shared Divesh Naidoo's introduction.

The demo video comes from the original post. In the footage, the phone is first a capture tool and also becomes a scene editor.

Simulon's explanation is direct: use your phone to place neural assets in real-world locations, then perform a scene. After you stop recording, Simulon renders that take. The rendering process reads what is in the recording, including what you did, what you said, and what the surrounding place is like. The virtual assets respond to this information. The final output is a regenerated performance, not a copy of the original video.

The key here is how the input is used. In traditional AR or composited video, virtual objects often feel like layers pasted onto the image: they know their position but do not really understand your actions and dialogue. Simulon treats the entire recording as a scene description and lets the renderer reorganize a performance. The emphasis is not on overlaying a 3D model onto video, but on letting virtual assets respond to what happens on set. The materials do not go into technical details, and the demo only shows the result. But the direction is worth watching.

For creators, the workflow is compressed into the phone. On iPhone, you place neural assets, record the action and dialogue, stop, and wait for rendering. If you need to change the performance, record another take and generate another version. An Android version is coming soon. It addresses the hassle of repeated alignment and manual adjustment in scene compositing—at least according to the product description. Whether it actually works well will depend on whether regeneration can consistently preserve dialogue, occlusion, spatial relationships, and the appearance of the assets.

Original post link: https://x.com/Scobleizer/status/2115557060230439266