Meta has put proposed updates to its commercial terms on hold after news publishers and other stakeholders raised concerns about how the changes would apply to its web crawlers. In a November 18, 2026, announcement, the company outlined a three-phase consultation that it expects to take several months.
The pause leaves existing terms in place. It does not shut down Meta’s crawlers or cancel every future crawler-related change. Meta explicitly plans to revise the proposed language, discuss the result with publishers, other stakeholders and regulators, and provide notice before new terms take effect.
That distinction matters for publishers weighing how their websites, Facebook Pages and potential AI licensing arrangements fit together. The immediate change is a halt to the proposed terms, while the scope of any eventual replacement remains unsettled.
What Meta Has Actually Paused
The paused package extends beyond the document called Commercial Terms. According to Nieman Lab’s November 5 reporting, Meta suspended updates to four sets of rules:
- Commercial Terms
- Product Catalog Terms
- Self-Serve Ad Terms
- Ad Creative Generative AI Terms
Meta also removed the preview link to the proposed terms. Its Business Help Center said the updates would no longer take effect on November 20, 2026, and that existing terms would remain in force.
The reach of the Commercial Terms helps explain the reaction. The Next Web reported that they apply to businesses using Meta products, including a business that simply operates a Facebook Page. For publishers, the dispute therefore concerned whether maintaining a presence on Meta’s services could carry new permissions involving content hosted on their own websites.
November 18 was an explanation of the consultation process following the earlier pause, not the first disclosure that the November 20 deadline had been dropped. The new announcement also supplies no replacement effective date.
Why Publishers Objected
Publisher concerns centered on the relationship between a business account and the content outside Meta’s platforms.
Ars Technica reported that legal experts warned the proposed language could grant broad permission to crawl linked external websites and use the material for AI development. Its account also described concerns about the absence of an opt-out for businesses wishing to keep their Facebook Pages, and provisions requiring test credentials that could let crawlers access paywalled material.
Meta’s November 18 announcement does not reproduce the full proposed language. Those details therefore come from reporting on the earlier drafts, and the warnings about their possible reach should be understood as interpretations of proposed terms, not evidence that Meta carried out those activities.
The language had already changed during the backlash. Nieman Lab reported that Meta removed the word “train” on October 16 and narrowed the stated uses of future scraped content to advertising and business products. That revision did not resolve concerns about how broadly the remaining permissions could be read.
The commercial stakes are straightforward: permission to retrieve a page and permission to use its contents can have different consequences. If account terms provide extensive reuse rights, publishers may question what control or negotiating leverage remains for separate licensing agreements. That is the practical issue behind the dispute, although the eventual terms could change substantially through consultation.
The pressure also reached courts and regulators. Nieman Lab reported preliminary injunctions in Norway and Brazil following lawsuits by media organizations, alongside a UK Competition and Markets Authority investigation into whether Meta was abusing a dominant position through its proposed terms. Those actions added scrutiny; they did not produce a single, worldwide determination of what the terms meant.
Robots.txt and Commercial Permission Are Different Questions
Meta’s official response includes a direct statement:
“Meta follows the industry standard robots.txt mechanism”
The company makes that assertion in its November 18 announcement, referring readers to its crawler documentation.
A robots.txt file communicates which parts of a website a crawler is permitted to visit. As The Next Web explained, Meta said website owners could continue to block its crawler through that mechanism.
The disagreement concerned how that operational assurance fitted with the contract. Ars reported that critics remained concerned because the revised terms had not included specific language committing to respect robots.txt preferences.
Two separate issues are therefore in play:
- Crawler instructions: What preferences does the website communicate, and how does Meta say its crawlers respond?
- Contractual permissions: What rights would a business grant by continuing to use the covered Meta products?
A public promise about crawler behavior helps explain Meta’s position, but publishers also want to understand the permissions written into the agreement itself.
My view is that the most useful revision would make the relationship explicit. If robots.txt preferences remain meaningful under the new terms, spelling that out would give publishers a clearer basis for evaluating the agreement. Meta’s accompanying explainer could help, but the contractual wording will still deserve close attention.
The Timeline: From Delays to Consultation
The proposal had already gone through revisions and postponements before Meta published its three-phase plan.
| Date | Reported development |
|---|---|
| October 15, 2026 | Nieman Lab first reported concerns about the proposed terms and website scraping. |
| October 16 | Meta removed the reference to training and narrowed the stated uses of future scraped content. |
| October 23 | Meta moved the effective date from October 30 to November 20. |
| October 28 |
Frequently Asked Questions
3 questions
1Has Meta Stopped Crawling Publisher Websites?
The announcement pauses proposed terms updates, not crawler operations. Meta says it follows robots.txt and is consulting publishers about the proposed changes.