Facebook is opening up about the behind-the-scenes tools it uses to combat fake account creation on its platforms, and the company says it has a new artificial intelligence-powered method known as Deep Entity Classification (DEC) that’s proved especially effective.
DEC is a machine learning model that doesn’t just take into account the activity of the suspect account, but it also evaluates all of the surrounding information, including the behaviors of the accounts and pages the suspect account interacts with. Facebook says it’s reduced the estimated volume of spam and scam accounts by 27 percent.
So far, DEC has helped Facebook thwart more than 6.5 billion fake accounts that scammers and other malicious actors created or tried to create last year.
A vast majority of those accounts are actually caught in the account creation process, and even those that do get through tend to get discovered by Facebook’s automated systems before they are ever reported by a real user.
Still, Facebook estimates that around 5 percent of all 2.89 billion monthly active users currently on the platform are fake accounts belonging to what Facebook considers violators of its terms of service.
That typically means scammers, spammers, and people attempting to phish vulnerable users or use other methods of securing sensitive personal information for some sort of financial or identity theft scheme.
That’s where DEC comes in. It takes a sophisticated and holistic approach to analyzing user behavior that takes in around 20,000 features per profile; for instance, it’ll take into account the friending activity of an account the suspicious and potentially fake account sent a friend request to, and not just the suspicious account itself. The goal is to combat the ways malicious actors replicate genuine behavior.
Over time, Facebook says the savvy spammers will get better and better at pretending to be real users, at least in the way Facebook’s automated systems view one. DEC is supposed to take advantage of that by looking deeper into how the accounts that account interacts with behave on the platform, too.
