Roblox introduces real-time AI-powered chat rephraser for inappropriate language

Rajiv Bhatia, Roblox’s Chief Safety Office, said the game is starting with profanity. For instance, if a user sends “Hurry TF up” in chat, the system will replace it with “Hurry up!” Everyone in the chat will see a note when a message has been rephrased, and the sender will see what language was edited out. A user who keeps cursing in chat will still be penalized for breaking Roblox policy even if the AI rephrases their messages. “As these systems scale, they create a flywheel for civility, where real-time feedback helps users learn and adopt our Community Standards,” Bhatia said in a blog post.

Rephrasing has been rolled out to chats between age-checked users in similar age groups and in all the languages the game’s translation tool supports. Roblox introduced a mandatory age verification system back in January after reports came out that it has a “pedophile problem,” with adult players allegedly using the game to groom children. Kids under 13 can no longer use in-game chat outside of certain experiences, while everyone else can chat with players around their age. Age check, however, hasn’t stopped authorities from suing Roblox: LA County, in a lawsuit filed in February, said Roblox knows its platform “makes children easy prey for pedophiles.” Louisiana’s AG has also just filed a lawsuit, saying Roblox “created a public park and filled it with sex predators that are preying on… children.”