The whole process takes just a few minutes to shoot and have everything ready inside Blender. I use Eevee for realtime lights, but with Cycles, I could use Holdout, Shadow Catcher, etc. Something I am still learning to use efficiently.

Custom anchors can be specified before recording so that I could easily mark areas like table, floor, chair, each with its own anchor plane.

One thing, I noticed slight jitter time to time during capture. The data is captured at 60 fps, perhaps it can be smoothed.

This is a work in progress. There are some works to make this a complete production quality.

I do quite like the fact that we can really capture real world information data that we can bring into Blender. Then perhaps we can create Augmented Reality experience that works around this ”real world anchor”.

So we could easily blend from real world and virtual world, maybe back and forth. One day this can be realtime.