Fake Accounts and Coordinated Messages Fuel Influence Networks on Social Media
Translated & summarized from Behadrei Haredim by baba
Influence networks are using fake social media accounts, often with AI-generated profiles, to manipulate public opinion and create false impressions of support in Israel. Israeli authorities have removed some accounts involved in foreign influence attempts ahead of elections, but details remain scarce. Research indicates these networks post thousands of messages, often reacting quickly to news and joining political discussions to spread specific narratives. While the Noam party denies involvement, investigations have linked similar tactics to its messaging, raising concerns about deceptive practices in political campaigns.
The story in 6 lines · by baba
- Fake social media accounts are used to create false impressions of public support and influence political discourse.
- Israeli authorities have removed accounts involved in foreign influence attempts ahead of the upcoming elections.
- A report tracked about 100 fake accounts posing as Israelis that posted 25,000 messages between August and October.
- Investigations revealed hundreds of fictitious accounts promoting messages associated with the Noam party.
- The Noam party denies allegations of using fictitious accounts for its messaging.
- Identifying fake accounts involves analyzing behavior patterns, not just profile pictures or AI-generated text.
Social media platforms are being utilized by sophisticated influence networks to manipulate public opinion, particularly in the lead-up to elections. These networks employ fake accounts, often with AI-generated profile pictures and fabricated identities, to amplify specific political messages and create a false impression of widespread public support. These coordinated efforts aim to influence political discourse, sow distrust in state institutions, and impact election integrity.
Ahead of the upcoming Knesset elections, Israeli authorities have taken action against such operations. The Shin Bet (General Security Service), in collaboration with the State Attorney's Cyber Department and the Central Elections Committee, identified and removed accounts involved in foreign influence attempts. However, details regarding the number of accounts, their operators, or the specific content disseminated were not disclosed, nor were figures on public exposure or actual impact.
A report by the Institute for National Security Studies (INSS) shed light on these tactics, tracking approximately 100 X (formerly Twitter) accounts posing as Israelis. Between August 1 and October 13, these accounts posted around 25,000 messages, many reacting to Israeli news events within days. They strategically joined existing discussions, often replying to posts by politicians and journalists, presenting diverse and sometimes contradictory viewpoints to mask their coordinated nature.
Further investigation by ynet, based on findings from the organization Fake Reporter, revealed hundreds of fictitious accounts on X and Facebook promoting messages associated with the Noam party. Many of these profiles, created in October and using AI-generated images, presented themselves as secular or traditional individuals from central Israel. These accounts rapidly amplified party posts and comments on election polls, sometimes using stolen images to appear more credible.
The Noam party has denied these allegations, stating its supporters operate genuinely and openly and rejecting any connection to fictitious accounts. Experts note that identifying fake accounts involves analyzing account behavior over time, including excessive posting, repetitive messaging, and sudden shifts in language or focus, rather than solely relying on profile pictures or improved AI-generated text. While legitimate political campaigns involve coordinated digital efforts, the use of deceptive identities and misleading activity to simulate spontaneous support crosses the line into manipulative tactics, potentially violating platform rules and even laws if foreign actors are involved.
Mentioned
