Four AI Giants Back Unified robots.txt Training Preference Signal: what are the key facts?

On October 30, 2026, Google, OpenAI, Microsoft and Anthropic announced support for a new AI training preference signal.

Four AI Giants Back Unified robots.txt Training Preference Signal: what are the key facts?

The signal reuses the robots.txt standard, letting sites set AI training permissions with a single token.

Four AI Giants Back Unified robots.txt Training Preference Signal: what are the key facts?

Currently only Anthropic has enabled the token; OpenAI plans to implement it in the coming months.

Four AI Giants Back Unified robots.txt Training Preference Signal: what are the key facts?

Microsoft will begin honoring it in February 2027, and Google plans to support it in early 2027.

Four AI Giants Back Unified robots.txt Training Preference Signal: what are the key facts?

All four companies retain their own existing tokens, and the new signal is not mandatory.

Physix Frontier · News Briefing Card (enbrief · Nov 7, 2026)

Four AI Giants Back Unified robots.txt Training Preference Signal

KEY FACTS

On October 30, 2026, Google, OpenAI, Microsoft and Anthropic announced support for a new AI training preference signal.
The signal reuses the robots.txt standard, letting sites set AI training permissions with a single token.
Currently only Anthropic has enabled the token; OpenAI plans to implement it in the coming months.
Microsoft will begin honoring it in February 2027, and Google plans to support it in early 2027.
All four companies retain their own existing tokens, and the new signal is not mandatory.

KEY DATA

October 30, 2026Announcement date

February 2027Microsoft compliance start

Early 2027Google planned support

PHYSIX OBSERVATION

The unified signal reduces the complexity of managing AI crawlers for websites, but staggered effective dates and the lack of enforcement make it hard to change the status quo in the short term. Anthropic moved first, while Microsoft is separately pushing DisallowExtended, showing the giants are still jockeying over standard-setting and site owners still need multiple schemes running in parallel.

Source: enbrief original report ↗