A video has been released on the Meta Quest YouTube channel promoting the usefulness of the Meta Quest 3 in everyday life. The commercial shows a man using the device to assemble a crib.
He has Whatsapp, YouTube, and a browser window in front of him as virtual panels and uses a pinch gesture, to pull one of the three windows closer to him, which is not yet possible on Quest.
If they manage to cut around the hand and screw for the guy to see it in front of the screens that would be huge.
Haha I didn’t even think of that. He has to hold it to the side, otherwise the window is covering it up ^^
I do know virtual occlusion is something they hope to bring during the Quest 3’s life span. Using the depth sensor and a well-trained algorithm, they hope to pare it down to something functionally decent that can run within the available performance envelope. I don’t know how close they are now. But they have been working on it since before Quest pro, since it was originally gonna have a depth sensor too.
Afaik the Vision Pro is projecting a point cloud and there’s a good chance that’s not dense enough for a single screw. Also, the VP is only trained on hands, so whenever you see someone hold a phone the phone is invisible and the hand occlusion is almost perfect there.
I‘m guessing it’ll be a long time until something as small as a screw will be properly occluded on Quest, which currently doesn’t have any kind of occlusion.