Reddit may block search crawlers

Share post:

Reddit is considering blocking search crawlers from Google and Bing, which would prevent Reddit posts from appearing in search results. 

The company is reportedly taking this step in an effort to get generative AI companies to pay for using Reddit’s data to train large language models. Initially, Reddit seemed to dismiss this notion, with spokesperson Courtney Geesey-Dorr stating, “Nothing is changing.” However, a subsequent correction by The Post clarified that the key alteration wasn’t in user logins but rather in how Reddit deals with AI companies.

Another Reddit spokesperson Tim Rathschmidt confirmed the news, but said that it does not have anything to share on that topic at the moment.

If Reddit does block crawlers, it would mean that users would no longer be able to access Reddit posts through search results. The Washington Post, which first reported on Reddit’s potential move, also noted that more than 535 news organizations have opted to block their content from being scraped by companies like OpenAI to help train products such as ChatGPT.

The sources for this piece include an article in TheVerge.

Featured Tech Jobs


Related articles

Meta is gathering data on Quest virtual reality users

Meta's latest policy update reveals plans to start collecting "anonymized" data from its Quest headset users, intensifying concerns...

X/Twitter censors India farmer protests at government request

Social media platform X (formerly Twitter) admitted to removing accounts and posts related to India's farmers' protests, citing...

Musk’s X/Twitter grants “verified” status to Hezbollah terrorists

Elon Musk's platform X, previously known as Twitter, has come under scrutiny for providing premium services, including verification,...

X/Twitter cracks down on criticism and suspends Irish journalist

Journalist Séamas O’Reilly has expressed disbelief and amusement after his account on X (formerly Twitter) was suspended shortly...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways