Right now it’s augmenting reality with fake shit. Like you see the real world and can put non-real things in it. What I’d like to be able to do is be in a fake world and bring real world objects into that.
Like, say I’m in VRchat just sitting somewhere hanging out it would be cool if I could bring my drink, my food, my vape, etc into the game so I don’t have to fumble around looking for them with my hands. I haven’t found anything that does this though… :/
I feel like that would be significantly more difficult to implement. You’d have to be constantly tracking the objects, cutting out a portion of your gameplay to render the objects, and also making sure it doesn’t overlap with anything in the game world making you unable to see it. I think it’d be better for them to add a slider that changes the amount of passthrough, so you can see both the game world and the real world. (facebook showed a demo of this in one of their quest ads, but has yet to deliver)
They already do this with your hands. And those change shape. It shouldn’t be harder to track a thing that is rather static using the cameras and software it already uses to do hand tracking. It would just have to be trained on them since I assume it uses AI to handle some of this.
Oh I thought you meant passing the object itself through the playspace. I guess something like that could work, but again I don’t know exactly how everything works.