Right now it’s augmenting reality with fake shit. Like you see the real world and can put non-real things in it. What I’d like to be able to do is be in a fake world and bring real world objects into that.
Like, say I’m in VRchat just sitting somewhere hanging out it would be cool if I could bring my drink, my food, my vape, etc into the game so I don’t have to fumble around looking for them with my hands. I haven’t found anything that does this though… :/
I can technically accomplish what I want with a more complicated setup using my PC, a camera and some printed out QR tags since there are a couple of FOSS tools on GitHub specifically for adding tracking to anything. But I keep coming back to the fact the HMD itself (in my case, a Quest 3) has hand tracking that works good enough that it should be able to do what I am asking here without too much additional resources.