META has introduced an enhanced version of its smart glasses equipped with a camera that can describe the user’s surroundings through AI-driven responses.
This new feature allows wearers to simply ask questions about what they see, and the glasses will audibly respond using built-in speakers.
The Ray-Ban Meta Smart Glasses, launched by tech mogul Mark Zuckerberg last year, originally enabled video recording and interaction with an AI assistant via the eyewear. Now, with the latest update, the glasses can analyze the environment in real-time and provide informative feedback.
For example, the AI can identify a cat breed, translate text from foreign languages, or offer details about famous landmarks. This capability, referred to as “multimodal” by Meta, means that the glasses can process both voice commands and visual inputs from the integrated camera.
Meta explains, “We introduced a multimodal AI update in December, allowing you to inquire about your surroundings, receiving intelligent and useful responses or suggestions from your glasses.”
The feature is designed to assist with tasks like translating menus or signs while traveling, utilizing the glasses’ camera and Meta AI to provide instant information without the need for a phone or screen.
However, privacy concerns restrict certain inquiries; for instance, the glasses won’t provide information about individuals for privacy reasons.
This new feature is currently being rolled out as a beta test to all Ray-Ban Meta smart glasses in the U.S. and Canada. To access it, users must update their glasses to the latest software version and initiate inquiries by saying “Hey Meta” followed by their question.
In addition to this update, Meta glasses now facilitate sharing the wearer’s point of view during video calls. When using WhatsApp or Facebook Messenger for video calls while wearing the glasses, users can show others what they are seeing in real-time.
Meta suggests practical scenarios for this capability, such as seeking advice while grocery shopping or verifying the ripeness of fruit.
The video-calling feature will be gradually released, so users may not immediately see the update.
Furthermore, Meta has introduced new frame options available in 15 countries, including the U.S., Canada, and Australia.
