A Boston-based company is using machine learning to create what it bills as the world’s first voice-native moderation service, which can tell the difference between what’s being said and what it means.
ToxMod is an attempt to solve the paradox of moderating any open space on the Internet; there aren’t enough humans to keep up with demand, but algorithms, filters, and a report system don’t understand nuance.
With ToxMod’s database, it can track factors in players’ speech like emotion and volume, which helps it distinguish between a momentary lapse and a pattern of behavior. It was recently announced as an addition to the 7v7 American football game Gridiron, currently in Steam Early Access.