Meta’s Ray‑Ban Display Update Adds Neural Handwriting, Live Captions, and an App Platform for Smart Glasses

Users can write messages by tracing letters with their finger on a surface or in the air, and the system converts those motions into typed text. Meta says the feature now works across major messaging platforms including Instagram, WhatsApp, Messenger, and native Android and iOS messaging apps.

This allows messaging without pulling out a smartphone—an important step toward fully hands‑free computing with wearable devices.

Display Recording: Capturing What You See

The update also introduces display recording, enabling users to record a video that combines:

• the camera’s point‑of‑view video
• what appears in the glasses’ in‑lens display
• ambient audio

The result is a single shareable video that shows the complete smart‑glasses experience rather than just raw camera footage.

This feature could be useful for creators demonstrating apps or AI interactions, as well as everyday users sharing experiences captured through the glasses.

Live Captions for Conversations and Calls

Meta is also expanding Live Captions, which transcribe spoken audio into text visible in the display. The captions can help users follow conversations more easily and improve accessibility for people with hearing difficulties.

The system can transcribe speech during in‑person conversations and in voice calls through messaging apps like WhatsApp, Messenger, and Instagram.

By adding real‑time text feedback directly in the wearer’s field of view, Meta is positioning the display as a tool for both accessibility and situational awareness.

Expanded Walking Navigation

Another practical improvement is expanded walking navigation. Directions that previously worked in limited areas now cover the entire United States, with additional support in major international cities such as London, Paris, and Rome.

Navigation instructions appear directly in the glasses’ display, allowing users to follow directions without constantly checking their phone.

Muse Spark AI Coming to the Glasses

Meta also plans to bring Muse Spark, its newer and more capable AI model, to its smart‑glasses ecosystem. The model is designed to make Meta AI more contextual and responsive during conversations and everyday interactions.

Reports indicate Muse Spark will arrive on Ray‑Ban Display glasses later in the year, potentially enabling more advanced AI assistance and voice interactions directly from the wearable device.

Developer Preview: Opening the Platform

Perhaps the most strategic change is the launch of a developer preview for building apps on the Ray‑Ban Display.

Developers can now create visual experiences for the glasses through two main paths:

• extending existing iOS or Android mobile apps
• building web apps designed for the glasses’ display

Meta says developers can use familiar tools and frameworks to deliver glanceable information and contextual interfaces directly in the user’s field of view.

This marks an early step toward a third‑party wearable app ecosystem, similar to what mobile app stores did for smartphones.

Why This Update Matters for Meta’s Strategy

Taken together, these features address several core components needed for a wearable computing platform:

• Input: Neural handwriting enables silent, hands‑free text entry.
• Output: The in‑lens display provides real‑time visual feedback.
• Context: Camera recording and AI features capture and interpret the surrounding world.
• Utility: Navigation, captions, and messaging add everyday practical use cases.
• Ecosystem: Developer tools allow external apps to expand what the glasses can do.

The combination suggests Meta is pushing the Ray‑Ban Display beyond novelty hardware toward something closer to a daily AI interface worn on the face. With improved input methods, contextual AI, and developer access, the glasses begin to resemble the early stages of a new computing platform built around wearable AI.