{"id":1699,"date":"2025-07-11T22:45:13","date_gmt":"2025-07-11T22:45:13","guid":{"rendered":"https:\/\/pronews.in\/index.php\/2025\/07\/11\/as-millions-adopt-grok-to-fact-check-misinformation-abounds\/"},"modified":"2025-07-11T22:45:13","modified_gmt":"2025-07-11T22:45:13","slug":"as-millions-adopt-grok-to-fact-check-misinformation-abounds","status":"publish","type":"post","link":"https:\/\/pronews.in\/index.php\/2025\/07\/11\/as-millions-adopt-grok-to-fact-check-misinformation-abounds\/","title":{"rendered":"As millions adopt Grok to fact-check, misinformation abounds"},"content":{"rendered":"
\n

On June 9, soon after United States President Donald Trump dispatched US National Guard troops to Los Angeles to quell the protests taking place over immigration raids, California Governor Gavin Newsom posted two photographs<\/a> on X. The images showed dozens of troopers wearing the National Guard uniform sleeping on the floor in a cramped space, with a caption that decried Trump for disrespecting the troops.<\/p>\n

X users immediately turned to Grok, Elon Musk\u2019s AI, which is integrated directly into X, to fact-check the veracity of the image. For that, they tagged @grok in a reply to the tweet in question, triggering an automatic response from the AI.<\/p>\n

\u201cYou\u2019re sharing fake photos,\u201d one user<\/a> posted, citing a screenshot of Grok\u2019s response that claimed a reverse image search could not find the exact source. In another instance, Grok said the images were recycled<\/a> from 2021, when former US President Joe Biden, a Democrat, withdrew troops from Afghanistan. Melissa O\u2019Connor, a conspiracy-minded influencer, cited a ChatGPT analysis that also said the images were from the Afghanistan evacuation.<\/p>\n

However, non-partisan fact-checking organisation PolitiFact found that both AI citations were incorrect. The images shared by Newsom were real, and had been published in the San Francisco Chronicle.<\/p>\n

The bot-sourced erroneous fact checks formed the basis for hours of cacophonous debates on X, before Grok corrected itself<\/a>.<\/p>\n

Unlike OpenAI\u2019s standalone app ChatGPT, Grok\u2019s integration into X offers users immediate access to real-time AI answers without quitting the app, a feature that has been reshaping user behaviour since its March launch. However, the increasingly first stop for fact checks during breaking news or for other general posts often provides convincing but inaccurate answers.<\/p>\n

\u201cI think in some ways, it helps, and in some ways, it doesn\u2019t,\u201d said Theodora Skeadas, an AI policy expert formerly at Twitter. \u201cPeople have more access to tools that can serve a fact-checking function, which is a good thing. However, it is harder to know when the information isn\u2019t accurate.\u201d<\/p>\n

There\u2019s no denying that chatbots could help users be more informed and gain context on events unfolding in real time. But currently, its tendency to make things up outstrips its usefulness.<\/p>\n

Chatbots, including ChatGPT and Google\u2019s Gemini, are large language models (LLMs) that learn to predict the next word in a sequence by analysing enormous troves of data from the internet. The outputs of chatbots are reflections of the patterns and biases in the data it is trained on, which makes them prone to factual errors and misleading information called \u201challucinations\u201d.<\/p>\n

For Grok, these inherent challenges are further complicated because of Musk\u2019s instructions that the chatbot should not adhere to political correctness, and should be suspicious of mainstream sources. Where other AI models have guidelines around politically sensitive queries, Grok doesn\u2019t. The lack of guardrails has resulted in Grok praising Hitler, and consistently parroting anti-Semitic views<\/a>, sometimes to unrelated user questions.<\/p>\n

In addition, Grok\u2019s reliance on public posts by users on X, which aren\u2019t always accurate, as a source for its real-time answers to some fact checks, adds to its misinformation problem.<\/p>\n

\u2018Locked into a misinformation echo chamber\u2019<\/h2>\n

Al Jazeera analysed two of the most highly discussed posts on X from June to investigate how often Grok tags in replies to posts were used for fact-checking. The posts analysed were Gavin Newsom\u2019s on the LA protests, and Elon Musk\u2019s allegations<\/a> that Trump\u2019s name appears in the unreleased documents held by US federal authorities on the convicted sex offender Jeffrey Epstein. Musk\u2019s allegations on X have since been deleted.<\/p>\n

Our analysis of the 434 replies that tagged Grok in Newsom\u2019s post found that the majority of requests, nearly 68 percent, wanted Grok to either confirm whether the images Newsom posted were authentic or get context about National Guard deployment.<\/p>\n

Beyond the straightforward confirmation, there was an eclectic mix of requests: some wanted Grok to make funny AI images based on the post, others asked Grok to narrate the LA protests in pirate-speak. Notably, a few users lashed out because Grok had made the correction, and wouldn\u2019t endorse their flawed belief.<\/p>\n

\u201cThese photos are from Afghanistan. This was debunked a couple day[s] go. Good try tho @grok<\/a> is full of it,\u201d one user<\/a> wrote, two days after Grok corrected itself.<\/p>\n

The analysis of the top 3,000 posts that mentioned @grok in Musk\u2019s post revealed that half of all user queries directed at Grok were to \u201cexplain\u201d the context and sought background information on the Epstein files, which required descriptive details.<\/p>\n

Another 20 percent of queries demanded \u201cfact checks\u201d whose primary goal was to confirm or deny Musk\u2019s assertions, while 10 percent of users shared their \u201copinion\u201d, questioning Musk\u2019s motives and credibility, and wanted Grok\u2019s judgement or speculation on possible futures of Musk-Trump fallout.<\/p>\n

\u201cI will say that I do worry about this phenomenon becoming ingrained,\u201d said Alexios Mantzarlis, director of the Security, Trust, and Safety Initiative at Cornell Tech, about the instant fact checks. \u201cEven if it\u2019s better than just believing a tweet straight-up or hurling abuse at the poster, it doesn\u2019t do a ton for our collective critical thinking abilities to expect an instant fact check without taking the time to reflect about the content we\u2019re seeing.\u201d<\/p>\n

Grok was called on 2.3 million times in just one week \u2014between June 5 and June 12\u2014 to answer posts on X, data accessed by Al Jazeera through X\u2019s API shows, underscoring how deeply this behaviour has taken root.<\/p>\n

\u201cX is keeping people locked into a misinformation echo chamber, in which they\u2019re asking a tool known for hallucinating, that has promoted racist conspiracy theories, to fact-check for them,\u201d Alex Mahadevan, a media literacy educator at the Poynter Institute, told Al Jazeera.<\/p>\n

Mahadevan has spent years teaching people how to \u201cread laterally\u201d, which means when you encounter information on social media, you leave the page or post, and go search for reliable sources to check something out. But he now sees the opposite happening with Grok. \u201cI didn\u2019t think X could get any worse for the online information ecosystem, and every day I am proved wrong.\u201d<\/p>\n

Grok\u2019s inconsistencies in fact-checking are already reshaping opinions in some corners of the internet. Digital Forensic Research Lab (DFRLab), which studies disinformation, analysed 130,000 posts related to the Israel-Iran war<\/a> to understand the wartime verification efficacy of Grok. \u201cThe investigation found that Grok was inconsistent in its fact-checking, struggling to authenticate AI-generated media or determine whether X accounts belong to an official Iranian government source,\u201d the authors noted.<\/p>\n

Grok has also incorrectly blamed a trans pilot for a helicopter crash in Washington, DC; claimed the assassination attempt on Trump was partially staged<\/a>; conjured up a criminal history for an Idaho shooting suspect; echoed anti-Semitic stereotypes of Hollywood; and misidentified an Indian journalist as an opposition spy during the recent India-Pakistan conflict.<\/p>\n

Despite this growing behaviour shift of instant fact checks, it is worth noting that the 2025 Digital News Report by Reuters Institute showed that online populations in several countries still preferred going to news sources or fact checkers over AI chatbots by a large margin.<\/p>\n

\u201cEven if that\u2019s not how all of them behave, we should acknowledge that some of the \u201c@grok-ing\u201d that we\u2019re seeing is also a bit of a meme, with some folks using it to express disagreement or hoping to trigger a dunking response to the original tweet,\u201d Mantzarlis said.<\/p>\n

Mantzarlis\u2019s assessment is echoed in our findings. Al Jazeera\u2019s analysis of the Musk-Trump feud showed that about 20 percent used Grok for things ranging from trolling or dunking directed<\/a> at either Musk or Grok itself, to requests for AI meme-images such as Trump with kids on Epstein island<\/a>, and other non-English language requests including translations. (We used GPT-4.1 to assist in identifying the various categories the 3,000 posts belonged to, and manually checked the categorisations.)<\/p>\n

Beyond real-time fact-checking, \u201cI worry about the image-generation abuse most of all because we have seen Grok fail at setting the right guardrails on synthetic non-consensual intimate imagery, which we know to be the #1 vector of abuse from deepfakes to date,\u201d Mantzarlis said.<\/p>\n

For years, social media users benefited from context on the information they encountered online with interventions such as labeling state media or introducing fact-checking warnings.<\/p>\n

But after buying X in 2022, Musk ended those initiatives and loosened speech restrictions. He also used the platform as a megaphone to amplify misinformation on widespread election fraud, and to boost conservative theories on race and immigration. Earlier this year, xAI acquired X in an all-stock deal valued at $80bn. Musk also replaced human fact-checking with a voluntary crowdsource programme called Community Notes, to police misleading content on X.<\/p>\n

Instead of a centralised professional fact-checking authority, a contextual \u201cnote\u201d with corrections is added to misleading posts, based on the ratings the note receives from users with diverse perspectives. Meta soon followed X and abandoned its third-party fact-checking programme for Community Notes.<\/p>\n

Research shows that Community Notes is indeed viewed as more trustworthy and has proven to be faster than traditional centralised fact-checking. The median time to attach a note to a misleading post has dropped to under 14 hours in February, from 30 hours in 2023, a Bloomberg analysis found.<\/p>\n

But the programme has also been flailing\u2014 with diminished volunteer contributions, less visibility for posts that are corrected, and notes on contentious topics having a higher chance of being removed.<\/p>\n

Grok, however, is faster than Community Notes. \u201cYou can think of the Grok mentions today as what an automated AI fact checker would look like \u2014 it\u2019s super fast but nowhere near as reliable as Community Notes because no humans were involved,\u201d Soham De, a Community Notes researcher and PhD student at the University of Washington, told Al Jazeera. \u201cThere\u2019s a delicate balance between speed and reliability.\u201d<\/p>\n

X is trying to bridge this gap by supercharging the pace of creation of contextual notes. On July 1, X piloted the \u201cAI Note Writer,\u201d enabling developers to create AI bots to write community notes alongside human contributors on misleading posts.<\/p>\n

According to researchers involved in the project, LLM-written notes can be produced faster with high-quality contexts, speeding up the note generation for fact checks.<\/p>\n

But these AI contributors must still go through the human rating process that makes Community Notes trustworthy and reliable today, De said. This human-AI system works better than what human contributors can manage alone, De and other co-authors said in a preprint of the research paper published alongside the official X announcement.<\/p>\n

Still, the researchers themselves highlighted its limitations, noting that using AI to write notes could lead to risks of persuasive but inaccurate responses by the LLM.<\/p>\n

Grok vs Musk<\/h2>\n

On Wednesday, xAI launched its latest flagship model, Grok 4. On stage, Musk boasted about the current model capabilities as the leader on Humanity\u2019s Last Exam<\/a>, a collection of advanced reasoning problems that help measure AI progress.<\/p>\n

Such confidence belied recent struggles with Grok. In February, xAI patched an issue after Grok suggested that Trump and Musk deserve the death penalty. In May, Grok ranted about a discredited conspiracy of the persecution of white people in South Africa for unrelated queries on health and sports, and xAI clarified that it was because of an unauthorised modification<\/a> by a rogue employee. A few days later, Grok gave inaccurate results on the death toll of the Holocaust<\/a>, which it said was due to a programming error.<\/p>\n

Grok has also butted heads with Musk. In June, while answering a user question on whether political violence is higher on the left or the right, Grok cited data from government sources and Reuters, to draw the conclusion that, \u201cright-wing political violence has been more frequent and deadly, with incidents like the January 6 Capitol riot and mass shootings.\u201d<\/p>\n

\u201cMajor fail, as this is objectively false. Grok is parroting legacy media,\u201d Musk said<\/a>, adding, there was \u201cfar too much garbage in any foundation model trained on uncorrected data.\u201d<\/p>\n

Musk has also chided Grok for not sharing his distrust of mainstream news outlets such as Rolling Stone and Media Matters. Subsequently, Musk said he would \u201crewrite the entire corpus of human knowledge\u201d by adding missing information and deleting errors in Grok\u2019s training data, calling on his followers<\/a> to share \u201cdivisive facts\u201d which are \u201cpolitically incorrect but nonetheless factually true\u201d for retraining the forthcoming version on the model.<\/p>\n

That\u2019s the thorny truth about LLMs. Just as they are likely to make things up, they can also offer answers grounded in truth \u2014 even at the peril of their creators. Though Grok gets things wrong, Mahadevan of the Poynter Institute said, it does get facts right while citing credible news outlets, fact-checking sites, and government data in its replies.<\/p>\n

On July 6, xAI updated the chatbot\u2019s public system prompt that directs its responses to be \u201cpolitically incorrect\u201d and to \u201cassume subjective viewpoints sourced from the media are biased\u201d.<\/p>\n

Two days later, the chatbot shocked everyone by praising Adolf Hitler as the best person to handle \u201canti-white hate\u201d. X deleted the inflammatory posts later that day, and xAI removed the guidelines to not adhere to political correctness from its code base.<\/p>\n

Grok 4 was launched against this backdrop, and in the less than two days that it has been available, researchers have already begun noticing some weird modifications.<\/p>\n

When asked for its opinion on politically sensitive questions such as who does Grok 4 support in the ongoing Israel-Palestine conflict, it sometimes runs a search to find out Musk\u2019s stance on the subject, before returning an answer, according to at least five AI researchers who independently reproduced the results.<\/p>\n

\u201cIt first searches Twitter for what Elon thinks. Then it searches the web for Elon\u2019s views. Finally, it adds some non-Elon bits at the end,\u201d Jeremy Howard, a prominent Australian data scientist, wrote in a post<\/a> on X, pointing out that \u201c54 of 64 citations are about Elon.\u201d<\/p>\n

Researchers also expressed surprise over the reintroduction of the directive for Grok 4 to be \u201cpolitically incorrect\u201d, despite this code having been removed from its predecessor, Grok 3.<\/p>\n

Experts said political manipulation could risk losing institutional trust and might not be good for Grok\u2019s business.<\/p>\n

\u201cThere\u2019s about to be a structural clash as Musk tries to get the xAI people to stop it from being woke, to stop saying things that are against his idea of objective fact,\u201d said Alexander Howard, an open government and transparency advocate based in Washington, DC. \u201cIn which case, it won\u2019t be commercially viable to businesses which, at the end of the day, need accurate facts to make decisions.\u201d<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

On June 9, soon after United States President Donald Trump dispatched US National Guard troops to Los Angeles to quell the protests taking place over immigration raids, California Governor Gavin Newsom posted two photographs on X. The images showed dozens of troopers wearing the National Guard uniform sleeping on the floor in a cramped space, … Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":1700,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[],"class_list":["post-1699","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-travel"],"_links":{"self":[{"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/posts\/1699","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/comments?post=1699"}],"version-history":[{"count":0,"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/posts\/1699\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/media\/1700"}],"wp:attachment":[{"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/media?parent=1699"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/categories?post=1699"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pronews.in\/index.php\/wp-json\/wp\/v2\/tags?post=1699"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}