When a Meta engineer questioned why the company was loosening content safety standards, senior management cited the declining stock price. This reveals a pattern: internal decisions are driven by market share, engagement, and earnings, not user safety.
A BBC investigation, based on testimony from current and former employees at Meta and TikTok, highlights an 'algorithmic arms race' where engagement is prioritized over safety. Meta allocated more resources to Instagram Reels while neglecting child protection and election integrity. Internal research showed higher rates of bullying, harassment, and hate speech on Reels.
TikTok's trust and safety team was instructed to prioritize cases involving politicians over reports of harmful content involving children, including sexual blackmail and cyberbullying. A whistleblower advised parents to delete the app for their children's safety.
Both platforms struggle with algorithms that exploit human vulnerabilities, leading to radicalization and exposure to harmful content. The regulatory response faces challenges due to the complexity and speed of technological changes, and jurisdictional issues.
The gap between internal knowledge and external action is significant, with institutional incentives rewarding the status quo despite documented harms.