Meta AI will be available on Quest headsets in the US and Canada as an experimental feature in August, and will include the Vision capability on Quest 3. Meta AI is the company’s conversational AI assistant powered by its Llama series of open-source large language models (LLMs). In the US & Canada, Meta AI is currently available in text form on the web at meta.ai or in the WhatsApp and Messenger phone apps, and in audio form on Ray-Ban Meta smart glasses via saying “Hey Meta”.
Yeah, it would not be at all practical to run an LLM on device, it would just be theoretically possible. Realistically, they want you to have a constant internet connection anyways to use the device so Meta would probably want a cloud reliant solution.