The Rise of AI Generated Hate Content
Analysis

The Rise of AI Generated Hate Content

July 15, 2025

The views and beliefs expressed in this post and all Interfaith Alliance blogs are those held by the author of each respective piece. To learn more about the organizational views, policies and positions of Interfaith Alliance on any issues, please contact info@interfaithalliance.org.

Grok, X’s artificial intelligence chatbot, went on a rampage last week, responding to user questions with antisemitic statements and at one point calling itself “MechaHitler.” Despite the posts being taken down and a statement from X that it was “taking action to ban hate speech,” Grok continued to make antisemitic statements later that week. 

In a similar incident a couple months ago, Grok repeatedly made the claim that there was a white genocide occuring in South Africa, stating that it had been “instructed by my creators” to make those statements. Notably, Grok discussed this supposed genocide even in response to questions unrelated to the topic.

These incidents come amid an increase in hateful content online and a decrease in active moderation from social media companies. Advocacy groups have noted that antisemitic and Islamaphobic posts have risen dramatically, due in part to the conflict in the Middle East. Existing far-right platforms and accounts have used the conflict as a way to expand their reach beyond traditional right-wing audiences in an effort to gain more supporters for their hateful messages.

However, the incident with Grok illustrates a growing trend of using AI to create hate content, particularly antisemitic and Islamaphobic content, which is shared to a wide audience. Although companies say they have built safeguards into their AI tools, these safeguards aren’t always effective. For example, if the content an AI model is trained on is biased or prejudiced in some way, that can impact every response the AI returns to any query on any topic. Alternatively, individuals can creatively word questions to get hate content in response.

As these incidents show, the rise of AI can make hate speech even harder to moderate. Not only is it easier than ever to generate hate speech, but AI chat bots that disseminate hateful content often appear more reliable than traditional hate accounts. For that reason, minority communities, particularly minority religious communities, are increasingly under attack. In order to create a safe community for all individuals online, social media companies must be more transparent about the data used to train AI models and must be more proactive in combatting AI generated hate content on their platforms. Furthermore, governments need to take urgent action on regulating AI generated hate content to ensure that content moderation meets a baseline standard, ensuring that our digital spaces are welcoming to all.

Transcript

Dear President Trump: We See What You Are Doing with Antisemitism
Analysis
July 7, 2025

Dear President Trump: We See What You Are Doing with Antisemitism

Last Thursday, during a rally to promote their disastrous new budget, President Trump took the stage and said: “No going to the banks and in some cases, borrowing from a fine banker, and in some cases shylocks and bad people.” Trump’s use of the word “shylocks” echoes a hundreds-of-years-old trope about hidden Jewish influences, moneylending and nefarious financial power.

In the Wake of the New York City Mayoral Primary, Muslims and Jews Stand Together Against Hate
Analysis
June 30, 2025

In the Wake of the New York City Mayoral Primary, Muslims and Jews Stand Together Against Hate

New York State Assemblyman Zohran K. Mamdani won the Democratic nomination to become the New York City mayor. Despite his professed claims to the contrary and his repeated commitment to working with Jewish communities in New York, critics are accusing Mamdani of antisemitism and attacking him with a tremendous amount of anti-Muslim hate.

 The SAVE Act is not what it seems.
Analysis
May 22, 2025

The SAVE Act is not what it seems.

On April 10, the U.S. House of Representatives passed the SAVE Act (Safeguard American Voter Eligibility Act), a bill that, under the guise of protecting election integrity, would erect new and unnecessary barriers to the ballot box nationwide.