Meta's new commercial terms take effect October 30: it may crawl websites linked to business accounts to train AI, with no opt-out

2026-10-17·8 min read

The word AI never appears in the clause. There is one use of train and a long list of crawler synonyms. That is enough for publishers to start running the numbers: where licensing used to be required, continuing to use a Meta business account now counts as consent to be crawled. And the terms come with no opt-out.

Start with the clause itself and its effective date. Nieman Lab reported it first on October 15, with The Verge and Ars Technica following on October 16: Meta's updated commercial terms take effect on October 30. The text says business accounts authorise Meta, or any entity acting on its behalf, to use automated software such as web scrapers, bots, robots, spiders, crawlers and user agents and to create test credentials in order to access, index, cache, analyze, collect, retrieve or crawl the domains, web pages or URLs associated with their products or services, or made available through their or users' use of Meta company products and services, and to periodically pull updates from them. Meta may use any content from those domains, web pages or URLs to provide, develop, improve, research, train and maintain the integrity of Meta company products, services and features. The scope covers business accounts that promote their content across Facebook, Instagram, WhatsApp and Messenger, which Nieman Lab notes means virtually every news organisation has at least one, Nieman Lab included.

The second point is Meta's own framing. In a blog post, Meta says the update streamlines its commercial terms, adding that the changes reduce overlap between its agreements and improve the clarity of the terms that apply to your use of its products. A public affairs spokesperson told Nieman Lab by email that language around crawling had previously been scattered across different terms of use, including terms about using generative AI in ads, and that this update consolidates them in one place; he also said the new terms will not change how Meta crawls publishers in future, stressing that content owners can still manage how their content is accessed by using robots.txt. To Ars Technica, the spokesperson put it as: there is no change to how Meta uses web crawlers, and any suggestion to the contrary is false. Meta's developer pages still document how to block its crawlers with robots.txt.

The third point is what lawyers and Ars's side-by-side comparison found. Three legal experts reviewed the terms at Nieman Lab's request. Matt Topic, a media and intellectual property attorney at Loevy & Loevy, called it a remarkable provision to bury in terms of service, given that it would give Meta access to material that would likely cost many millions of dollars in a licensing market. James Grimmelmann, a professor of digital and information law at Cornell Law School, said that for news publishers this clearly represents permission for Meta to train AI on any content from their sites and possibly to deploy some of that content even in competition with the publishers themselves; asked about the alternatives, he said publishers either have to trust that Meta does not mean the full extent of what the terms say, or stop using business accounts. Benjamin Sobel, a law professor at the University of Wisconsin, likened it to tying in antitrust law: if you want to use the Meta products that require acceptance of the commercial terms, you have to also acquiesce to the scraping and crawling permissions exacted in those terms, comparing it to Google's policies that require consent to AI Overviews in order to appear in ordinary search. Ars also compared old and new text: the current commercial terms never mention test credentials, and that phrasing appears only in the Self-Service Ads Terms introduced this month, which let users grant Meta permission to scrape their content to generate ads; the new terms widen that from content connected to your ads to improving all of Meta's products.

The boundaries and open questions need equal clarity. First, the word AI does not appear in the clause; the training intent is inferred from a single use of train plus references to scrapers and crawlers. Second, there is no opt-out: the update reads that if you do not agree to the updated terms, please stop all access or use of the products for business or commercial purposes. Third, enforceability is unsettled: the experts said it is not clear whether a court would enforce the terms, but Topic's advice is that publishers should assume it would be enforceable. Fourth, precedence between robots.txt and the commercial terms is unresolved, and Meta did not answer whether test credentials would be used to bypass paywalls or other paid content; Grimmelmann said the wording technically allows Meta to sign up as a fake user to get past a publisher's registration wall. Fifth, the wider context is that fair use for AI training is still being litigated: publisher lawsuits against OpenAI are working through federal courts, including a May class action by five large book publishers alleging Meta pirated millions of books to train its Llama models. Sixth, the terms arrive alongside Meta One, a paid subscription that limits how many external links some accounts can post — Nieman Lab's summary being that Meta has begun charging users to post links to the same content it will be permitted to crawl for free.

🤔 Frequently Asked Questions

When do the new terms take effect?

October 30, 2026. Nieman Lab reported it first on October 15, with The Verge and Ars Technica following the next day.

Can a business account refuse?

There is no opt-out. The terms simply say that if you do not agree, please stop all access or use of the products for business or commercial purposes. As Grimmelmann puts it, publishers either trust that Meta does not mean the full extent of the wording, or stop using business accounts.

Do the terms mention AI?

No. The clause uses the word train once, alongside references to automated software such as web scrapers, bots, robots, spiders, crawlers and user agents; the legal reading rests on those two things.

What does Meta say?

Meta calls it streamlining, consolidating crawling language previously scattered across different terms of use, including ad-related generative AI terms, and says crawler behaviour is unchanged and content owners can still use robots.txt. It declined to answer questions including whether test credentials would bypass paywalls.

Why do experts call it tying?

Benjamin Sobel, a law professor at the University of Wisconsin, uses the antitrust concept of tying: to use the Meta products that require accepting the commercial terms, you must also accept the scraping and crawling permissions. He compares it with Google's requirement that sites consent to AI Overviews in order to appear in search.

🛠️ Recommended Tools

  • robots.txt Generator The most practical line in the whole dispute is that content owners can still manage access with robots.txt, so get your own rules written correctly and completely.
  • Text Diff Checker The reliable way to tell streamlining from expansion is a line-by-line comparison of old and new terms, not the wording of the announcement.
  • Markdown Editor Pulling together clause text, expert quotes and a timeline is faster in Markdown than in a word processor, and easier to keep updating.
  • URL Encoder / Decoder The clause governs URL-level crawling, so when you check which of your paths are actually reachable, get the URLs and their encoding straight first.
  • Hash Generator Terms get revised; hashing your archived copies of the text gives you a fingerprint that tells you immediately when something no longer matches.

Summary

Meta is updating its commercial terms effective October 30, 2026. The text authorises Meta to use automated software such as web scrapers and to create test credentials in order to access, index, cache, analyze, collect, retrieve or crawl domains, web pages and URLs associated with business accounts and their content, and to pull updates periodically, with that content usable to provide, develop, improve, research and train Meta products. It covers business accounts promoting content across Facebook, Instagram, WhatsApp and Messenger, which per Nieman Lab is virtually every news organisation, and there is no opt-out, only a line telling businesses that do not agree to stop using the products for commercial purposes. Meta says it is consolidating crawling language previously scattered across different terms, including ad-related generative AI terms, that crawler behaviour is unchanged and that robots.txt still works, but it declined to answer whether test credentials bypass paywalls. Three legal experts' verdicts: Matt Topic of Loevy & Loevy calls it a remarkable provision to bury in terms of service, covering material that would likely cost millions in a licensing market; James Grimmelmann of Cornell Law says it clearly represents permission for Meta to train AI on publishers' content and possibly deploy it in competition with them; Benjamin Sobel of the University of Wisconsin calls it tying in the antitrust sense. Ars Technica's comparison shows test credentials is new language introduced this month in the Self-Service Ads Terms, with the new terms widening the purpose from ads to improving all of Meta's products. Boundaries: the words AI never appear; training intent is inferred from one use of train plus crawler references; enforceability is untested; and pending litigation includes a class action by five large book publishers alleging Meta pirated millions of books to train Llama. Everything here comes from the sources below with no speculation added.

Sources: Nieman Journalism Lab(2026-10-15): Meta's new commercial terms will allow the scraping of news sites, legal experts say
Ars Technica(2026-10-16): Meta may use sweeping new commercial TOS to avoid millions in AI licensing fees

The Verge(2026-10-16): Meta's new terms may allow it to train AI on news sites for free

Meta 官方页面: 商业条款更新预览(Business Terms Update Preview)