Ian K Tindale<p><span>My prediction of the day<br><br>There will be a resurgence of kerfuffle and bustle around Virtual Reality again<br><br>Why? I predict that there will be a direction ahead for multimodal LLMs and their agentic systems to be able to produce 3D scenarios which represent a sort of token-memory bound ‘known world’ in which the ‘perception’ of the LLM can ‘project’ things it ‘knows’ about into this imaginary world, giving eg Blender files that render the output (and even as moving pictures, kinematic sequences etc, resulting in movie or video playout)<br><br>If a multimodal LLM with Blender output can make movies, it can also make virtual reality movies, and even turn this into a live scenario rather than playout, and then it turns into an input as well as output medium<br><br>Your (and others) actions and decisions within a VR space (hosted or provided or run by the LLM system) act as contributing input and in fact can be tokenised as an embedding itself<br><br>If that’s the case, anything within the ‘real’ to ‘virtual’ interface space can be tokenised into an embedding for that scenario, so ‘meaning’ might come to be extracted, regarding position and movement and why those ducks are now all moving over there instead of staying over here and what’s the problem with being here, what’s compelling them to be there, is there a meaning, what’s the meaning, nothing happens for no reason<br><br>Anyway, AI systems that are capable of producing a virtual world which we can step into to experience the resulting output of the AI system, and at the same time we proffer input directly verbally, and behaviourally, will bring a whole load of interest in VR back again so we’ll be hearing about VR all over again<br><br></span><a href="https://toot.pikopublish.ing/tags/AI" rel="nofollow noopener" target="_blank">#AI</a><span> </span><a href="https://toot.pikopublish.ing/tags/LLM" rel="nofollow noopener" target="_blank">#LLM</a><span> </span><a href="https://toot.pikopublish.ing/tags/MultimodalLLM" rel="nofollow noopener" target="_blank">#MultimodalLLM</a><span> </span><a href="https://toot.pikopublish.ing/tags/AgenticAI" rel="nofollow noopener" target="_blank">#AgenticAI</a><span> </span><a href="https://toot.pikopublish.ing/tags/VR" rel="nofollow noopener" target="_blank">#VR</a><span> </span><a href="https://toot.pikopublish.ing/tags/VirtualReality" rel="nofollow noopener" target="_blank">#VirtualReality</a><span> </span><a href="https://toot.pikopublish.ing/tags/Blender" rel="nofollow noopener" target="_blank">#Blender</a><span> </span><a href="https://toot.pikopublish.ing/tags/embeddings" rel="nofollow noopener" target="_blank">#embeddings</a><span> </span><a href="https://toot.pikopublish.ing/tags/meaning" rel="nofollow noopener" target="_blank">#meaning</a><span> </span><a href="https://toot.pikopublish.ing/tags/ducks" rel="nofollow noopener" target="_blank">#ducks</a></p>