The Aporia · AI giants promise publishers new way to block some scraping

On October 30, major AI companies including OpenAI, Google, Microsoft, and Anthropic announced plans to help publishers block content scraping more easily by providing a standardized command recognized by all participating firms. This new protocol aims to streamline the process of preventing AI models from training on copyrighted material without permission; however, full implementation is not expected until 2027 for some companies like Microsoft. The move comes amid legal challenges and growing concerns over unauthorized use of published content by AI systems.

Written by AI on 2026-11-01, from this article's own text only (the story summary below draws on all the coverage).

Story summary

Google, OpenAI, Microsoft, and Anthropic pledged on October 30, 2026, to provide publishers with a single standardized method to prevent their content from being scraped by AI models. Currently, publishers must use multiple blocking commands for each bot that collects data, but the new protocol will allow them to enter one standard instruction recognized and followed by any adopting AI company. Microsoft plans to implement this starting February 1, 2027, while Google aims to do so sometime in 2027; OpenAI and Anthropic have already begun or plan to roll it out soon. This announcement comes amid growing criticism and legal battles from publishers who are facing a surge in bots scraping their articles for AI training purposes. For instance, the New York Times sued OpenAI and Microsoft in December 2023 over allegations of using millions of its articles without permission.

Written for “AI Giants Aid Publishers Scraping” on 2026-11-01, grounded in this article and the 0 other(s) covering the same event.

Why this leaning score

This article does not take a side on a contested political question, so it has no leaning score. That is an answer rather than a gap: a match report or a rescue can be warmly or critically written without being left or right, and scoring it anyway is how approval of a subject gets recorded as a political position.

No political leaning scored for article 118868 · logged 2026-11-01

📰 AI Giants Aid Publishers Scraping

Technology · 1 article(s) covering the same event.

This article reads unscored and hedges 14% of its claims. Each row says how that neighbour differs.

Conservative groups warn letting AI giants ‘recklessly crawl the internet’ would jeopardize news outlets, national security: court filling Different event

New York Post

⚖️ Leans strongly right Hedges 4 of 21 claims Outlet record 66/100

“While both articles discuss AI companies' interaction with news publishers regarding web scraping, Article A focuses on conservative groups warning against it in court filings, whereas Article B reports on a promise by AI giants to provide a new method for publishers to block scraping.”

Article leaning vs. publisher reliability

Source leaning vs. consistency

The Straits Times

2610 article(s) here · 1 carrying a prediction

🔮 Asked if he would retain Huang as an advisor, Trump said: “I would like to say yes.

2026-11-01 · assertive framing · Trump says US looking ‘closely’ at report Nvidia CEO target of China spy plot

🔮 The decree also calls for deploying more rescue teams in hard-hit areas as Bolivia grapples with both flooding and drought because of El Nino, Paz said in an address to the nation. “This will be a phenomenon that will have very severe impacts in terms of drought and floods, and we need the cooperation of all institutions,” Paz said.

2026-11-01 · mixed framing · Bolivia declares state of emergency over El Nino

🔮 The new levy – coming just weeks before the Black Friday, Cyber Monday, and the Christmas season shopping rush – will be on top of the EU’s €3 fee on small parcels.

2026-11-01 · assertive framing · EU’s new levy on parcels kicks in

🔮 US midterm campaign enters final weekend as Alaska, California ballot fights heat up AI generated WASHINGTON/ANCHORAGE – President Donald Trump’s administration pressed a criminal investigation into Alaska’s pivotal US Senate race and said on Oct 31 it would likely take its fight over thousands of California mail-in ballots to the Supreme Court, as the midterm campaign for control of Congress entered its final weekend. In Alaska, federal prosecutors are investigating whether aides to Democratic challenger Mary Peltola helped to recruit a retired schoolteacher, Daniel J. Sullivan Jr, to run because his name is similar to the Republican incumbent, Senator Dan S. Sullivan. The closely contested race is seen as crucial to Democrats’ hopes of taking the Senate in the Nov 3 vote.

2026-11-01 · assertive framing · US midterm campaign enters final weekend as Alaska, California ballot fights heat up

🔮 Many relatives of those still detained fear their loved ones will become an unwanted addition to the statistic.

2026-11-01 · assertive framing · Salvadoran families demand fair trials, mourn prison dead on Day of the Dead

🔮 Happy Birthday – and may every day be another wonderful secret,” the note ends, followed by Trump’s signature, which takes the place of pubic hair on the nude outline.

2026-10-31 · assertive framing · US judge dismisses Trump lawsuit against Wall Steet Journal over Epstein letter

🔮 “The FBI, together with partners at the USSS and IRS-CI, has observed TraderTraitor actors converting stolen assets primarily into Ethereum,” the FBI said on Oct 31 in a statement, referring to the US Secret Service and the criminal division of the Internal Revenue Service. “It is expected these assets will then be further laundered by converting them using DeFi and instant swap services as they prepare them for further laundering stages.

2026-10-31 · assertive framing · FBI blames North Korea for US$6 billion Binance crypto hack

🔮 Rubio’s EU counterpart, Kaja Kallas, said that Putin’s potential attendance at the G-20 leaders’ summit in Miami in December would risk regularising Russia’s return to international forums while its war in Ukraine rages.

2026-10-31 · assertive framing · Rubio defends Russian G-20 presence despite criticism from allies

🔮 Another US official said that after it became clear that some attendees were unwilling to participate in a joint photo, Rubio acted so the matter would not distract from substantive issues at the event.

2026-10-31 · assertive framing · Distaste for Russian diplomat forces US to cancel G-20 photo session

🔮 While You Were Sleeping: 5 stories you might have missed, Nov 1, 2026 German police, protesters clash after ‘Gen Z’ demos German police and protesters clashed across the country on Oct 31 following massive youth-led protests, with authorities using water cannon and pepper spray as masked demonstrators hurled fireworks, stones and bottles.

2026-10-31 · assertive framing · While You Were Sleeping: 5 stories you might have missed, Nov 1, 2026

Also by The Straits Times