Today, U.S. Sen. Mark R. Warner (D-VA) pressed Discord, an instant messaging social platform, about the company’s failure to safeguard minors and stop the proliferation of violent predatory groups who target children with the goal of forcing them to end their own lives and livestream the act online.
This letter follows a September warning from the FBI alerting Americans to the existence of these violent online groups, which exist on messaging platforms and deliberately extort children into producing child sexual abuse material (CSAM) or sharing acts of self-harm online. According to the warning, issued by the FBI’s Internet Crime Complaint Center, these groups target minors between the ages of 8 and 17 years old and focus on racial and ethnic minorities, LGBTQ+ youth, and those who struggle with a variety of mental health issues.
“I am extremely concerned about this abuse, and I am profoundly saddened that it has affected Virginia families, including the daughter of a military family who was coerced into self-harm and to attempt suicide,” Sen. Warner wrote. “I recognize that Discord’s Trust & Safety team is aware of this type of activity and has taken some actions to detect and remove some of these violent groups from their platforms. However, despite increased moderation, predators continue to target minors on your platform.”
“As a teenager, I fell victim to the cruel manipulation of violent predatory groups on Discord. During a period in my life where I struggled with anxiety, depression, and eating disorders, they took advantage of my feelings of isolation, and encouraged me to self-harm and even end my life. While I’m deeply grateful to have escaped their abuse, I’m heartbroken to know that this violent, dangerous behavior persists on Discord,” said Abrielle, the Virginia teenager who was coerced by “King” into attempting suicide before being found by first responders in time to save her life. “Enough is enough – tech companies need to do more to crack down on the predatory groups that nearly took my life. Discord owes it to a generation of kids and teens to eliminate the extremely harmful content that abounds on their platforms.”
Sen. Warner continued, “I urge you to devote more resources to this problem, including dedicating a greater number of content moderators, investigators, engineers, and legal professionals to it. It is my understanding that Discord currently enforces its policies through actions like suspending policy-violating users’ accounts and servers, as well as banning their Internet Protocol (IP) addresses and email addresses. I also understand that there are far more sophisticated measures, such as device-based or cookie-based bans, that could be taken to prevent identified malign users from returning to your platform. Further, I am aware of measures that could be used to proactively detect harmful activity and initiate an early intervention to prevent harm and loss of life.”
In the letter, Sen. Warner demands answers to a series of questions about the company’s efforts to address these predatory groups. Specifically, he asks that Discord outline its policies and procedures around content that violates Discord’s Terms of Service, and that it share more information on its detection mechanisms, enforcement actions, measures to prevent the re-entry of malicious actors, and more. He also requests answers on the number of accounts that have been removed over the last four years, and the quantity of suicide ideation or depiction content.
Today’s letter also follows recommendations issued in July by the Biden-Harris Administration’s Kids Online Health and Safety Task Force to address the online health and safety for children and youth, with specific recommendations made to industry. It also comes on the heels of the Senate passage of the Kids Online Safety Act (“KOSA”) and the Children and Teens’ Online Privacy Protection Act (“COPPA 2.0”), which will require online platforms to take specific measures to protect the safety and privacy of children using their platforms.
A copy of the letter is available here