Used Astra to make a 3D scan an editable in Blender. Then turned down the gravity & opened a portal.

Gave GPT-6 Astra a 3D scan of my parents old home to make it an editable scene. Then I turned down gravity and opened a portal. Turns out multimodal LLMs might have crossed the chasm on inverse graphics. Tremendous implications for everything from VFX and AR/VR to robotics. Process: ~400 2D photos I took in 2019 went through RealityScan and became a photogrammetry mesh. That’s the classical reconstruction step. Then I dropped that mesh into Blender and used Astra to turn it into a fully editable, cleaned up 3D scene. Asked it to use textures from my photo scan and create procedural 3D shaders for the rest. It's good but it’s definitely not perfect -- funny thing is some of the mistakes are inherited from the reference mesh RealityScan produced i.e. the bird statue’s legs, contours of the furniture etc. This is where humans still have much better “spatial autocomplete” and can take an output like this all the way. My next step will be to see if I can let it use CUA with the photoscan software to interactively reference the source pixel imagery and refine its work in Blender and get even closer to reality.