It’s only been a few months since Meta announced that it would open its smart glasses platform to third-party developers. But one startup at CES is already showing off how the glasses can help power an intriguing set of accessibility features.
Hapware has created Aleye, a haptic wristband that, when paired with Ray-Ban Meta smart glasses, can help people understand the facial expressions and other nonverbal cues of the people they are talking to. The company says the device could help people who are blind, low vision or neurodivergent unlock a type of communication that otherwise wouldn’t be available.
Aleye is a somewhat chunky wristband that can vibrate in specific patterns on your wrist to correspond to the facial expressions and gestures of the person you’re talking to. It uses the Meta Ray-Ban glasses’s computer vision abilities to stream video of your conversation to the accompanying app, which uses an algorithm to detect facial expressions and gestures.
The bumps on the underside of the Aleye vibrate to form unique patterns. (Karissa Bell for Engadget)
Users can customize which expressions and gestures they want to detect in the app, which also provides a way for people to learn to distinguish between the different patterns. Hapware CEO Jack Walters said in their early testing people have been able to learn a handful of patterns within a few minutes. The company has also tried to make them intuitive. “Jaw drop might feel like a jaw drop, a wave feels more like a side to side haptics,” he explains.
The app is also able to use Meta AI to give vocal cues about people’s expressions, though Hapware’s CTO Dr. Bryan Duarte told me it can get a bit distracting to talk to people while the assistant is babbling in your ear. Duarte, who has been blind since a motorcycle accident at the age of 18, told me he prefers Aleye to Meta AI’s other accessibility features like Live AI. “It will only tell me there’s a person in front of me,” he explains. “It won’t tell me if you’re smiling. You have to prompt it every time, it won’t just tell you stuff.”
Hapware has started taking pre-orders for the Aleye, which starts at $359 for the wristband or $637 for the wristband plus a year subscription to the app (a subscription is required and otherwise will cost $29 a month). A pair of Ray-Ban Meta glasses is also not included, though Meta has also been building a number of its own accessibility features for the device.
Credit: Source link