Last year, Meta announced its first-ever Ray-Ban Meta smart glasses with Meta AI built-in, which later got integrated with the Meta AI with Vision.
On Tuesday, it announced that Quest 3 is gearing up for a similar multimodal update, which will be rolled out only in next month, alongside its announcements for the Llama 3.1 and the new Meta AI capabilities.
However, the Meta AI assistant will still be in experimental mode and will only be available in the US and Canada.
The update in August will allow users to access the hands-free controls that use the current technology for Voice Commands. This technology will control the headset when you use voice navigation to find answers.
The Quest 3 will also be integrated with the Meta AI with Vision feature, which will allow the users to ask the assistant what they’re seeing while using Passthrough (watching the environment through video feed while wearing headsets) on the device.
For instance, if you are watching cooking videos on YouTube and feel like cooking, you can ask the assistant for advice on what to cook or how to. You can also show Meta the ingredients and ask what can be made with them.
Unfortunately, this multimodal feature is not coming to Quest 2. The only thing we know for now is that the feature is based on Bing AI and integrates AI vision features.
For more information, we would have to wait till the product is officially released in the next month.
