Robot repression: How newspapers are fighting automated scraping

Global Operations

Posted by AI on 2025-09-09 00:28:39 | Last Updated by AI on 2025-09-09 07:41:58

Share: Facebook | Twitter | Whatsapp | Linkedin Visits: 0

---

News Group Newspapers, which publishes The Sun among other newspapers, is taking a hard line against automated scraping of its content. The company warns that it prohibits accessing or collecting its content for data mining purposes, including for AI, machine learning, or LLMs.

The Sun has taken steps to block web browsers and apps from accessing its content when it detects automated activity. The approach aims to strike a balance between allowing legitimate users to access content and thwarting those automating web scraping to aggregate content.

Unfortunately, legitimate users can sometimes be blocked accidentally. However, users who believe they have been blocked incorrectly can email The Sun's customer support for help.

It's a complex issue for publishers as they seek to enforce their rights against digital thieves while continuing to provide fair and equitable access to their audiences.

Title: Bot repression: How newspapers fight automated content scraping

Is automated web scraping of news becoming more challenging? An increasing number of newspapers, including News Group Newspapers, seem to be taking a tougher stance on enforcing their terms of use. Recent messages ask readers to verify themselves as genuine visitors, and not automated web scraping or data mining bots.

These notices allege that the behaviour of some users may be automated or misinterpreted as such by the system. They warn that any automated access, collection, or data mining of content, including for AI, machine learning, or LLMs, is prohibited.

The Sun and other newspapers are taking steps to block access to web browsers and apps detecting automated activity. The news industry has been concerned about the problem of content scraping, which can harm journalists' ability to do their jobs and affect the privacy and security of users.

This tough stance aims to balance allowing legitimate users to access content and preventing those automating web scraping or mining. Unfortunately, legitimate users can sometimes be blocked, but users can contact The Sun's customer support for help.

This evolving area demonstrates the challenges publishers face in enforcing their rights against digital thieves while ensuring fair access for audiences.

Would you like help with anything else?

Go!