Showing posts with label virtual reality. Show all posts
Showing posts with label virtual reality. Show all posts

Procedurally Created Reality Using Generative AI

Friday, March 17, 2023

What if we could create a system that could procedurally generate memories and dreams? Let's imagine a thought experiment I call "Yggdrasil", named after the tree of life in Norse mythology that connects all nine worlds. Yggdrasil could be seen as a thought experiment and theory of the end state of generative AI at some point in the future, and it has the potential to revolutionize virtual reality by allowing us to interact with procedurally generated scenes based on a single still photo.

As a quote from the historical text Prose Edda explains, "Under the third root of Yggdrasil is a wellspring of knowledge and wisdom, and it is guarded by Mimir. Whoever drinks from it gains great wisdom and foresight." In the same way, Yggdrasil as a thought experiment has the potential to unlock new knowledge and insights into the nature of consciousness and reality.

With advancements in generative AI, Yggdrasil may soon become a reality. By training an AI system with observations from every frame of every video on the internet, Yggdrasil could procedurally recreate vast realities that are visually indistinguishable from our own. The possibilities for this technology are truly limitless, and it could change the way we interact with virtual reality forever.

Currently, virtual reality uses state-of-the-art 3D computer graphics to immerse a person in a virtual scene. The hardware behind virtual reality requires a headset that will project two independent images into the retina of each eye, producing the sense of depth. However, Yggdrasil, on the basis of dreams, might be able to allow a person to procedurally interact with an imagined scene based on one still photo.

Generative AI is making this possible for us in the future. Although computationally intractable for many decades, eventually, as computational performance increases, Yggdrasil will be able to fully immerse a person in a virtual reality that is visually indistinguishable from reality. As a person sees the action of their body within the visual scene, Yggdrasil would be able to transmute these visual actions onto the procedurally generated scene. Objects within that scene could be interacted with, touched, and moved, as if a person was interacting with the object in reality.

To insert an object into the scene, one only would need to insert a photo of that object onto the scene. Once the object is inserted, it will then be transmuted into functional objects in the dream. If the object has never been observed before, it will transmute into whatever object it most closely resembles. This is absolutely within the realm of possible based on the proposed solution.

Imagine training Yggdrasil with observations of every frame of every video on the internet. Such a system would be able to recreate a vast reality. You could literally enter the Matrix using a single photo. You could interact with Keanu Reeves as Neo, which might inevitably blend into his other performances, like Ted from Bill & Ted’s Bogus Adventure. Keanu, in this case, would appear to be sentient, conscious, thinking, and intelligent. He would appear to experience pain when hurt. Any and all observations of Keanu would be combined with countless generalizations of human behavior. You could look into a microscope and see countless organisms. This system would entirely recreate reality based on observation alone.

It’s an extremely interesting idea that sounds like science fiction. With Yggdrasil, entire worlds would come alive, based on either mutable or immutable projections. With an immutable projection, there would be nothing persistent when not observed. The projected reality would only exist as you are interacting with it from your point of view. However, you could also create a mutable projection that populates an entire world through observation alone. Whatever is procedurally generated in the world will become a permanent fixture of that world.

The clock speed of the universe might be slow in our world, but over time, the computational power would have no effect on the internal experiences of the observers. All of this is possible and achievable if Yggdrasil is proven to be able to produce dreams. It's a thrilling concept that could change our understanding of consciousness and virtual reality as we know it.