[Google Turns Sign Language into Input Method: Type Directly with Pixel 11's Camera] According to monitoring by Beating, Google DeepMind has released the SL2T sign language-to-text model and integrated it into Pixel 11's Gboard and Live Transcribe. The initial release supports translating American Sign Language (ASL) into English. Users can sign in front of their phone to search, write messages, input documents, or even ask questions directly to Gemini. SL2T was trained on over 100,000 hours of data, covering more than 50 types of sign languages, about a quarter of which is ASL. The phone first extracts the coordinates of hand, face, and body gestures, sending only the coordinates to the server for translation, while the original video is not uploaded. [Original Link]