Google Launches Real-Time Sign Language to Text Translation on Pixel 11 Devices
Google has introduced SL2T, a new artificial intelligence model designed to translate American Sign Language (ASL) into written English text in real time. Initially available on Pixel 11 smartphones, the feature will be integrated into the Gboard keyboard and the Live Transcribe app. SL2T recognizes hand, arm, body movements, and facial expressions, converting them directly into flowing text without translating each sign individually.
The processing occurs entirely on the device, with video footage deleted immediately after analysis; only geometric body points are sent to the model for translation. Google trained SL2T on diverse data sets including various dialects, skill levels, left-handed users, and one-handed signing while holding the phone. Integration with Gboard enables sign language input for typing anywhere, such as searches, messaging, or interacting with Google’s Gemini AI. Live Transcribe users can respond in sign language during conversations instead of typing.
Currently, SL2T supports only ASL and does not cover Israeli Sign Language, which differs in vocabulary and grammar. Google plans to expand support to additional sign languages as suitable training data becomes available.