Microsoft Urges Publishers to Open Gates for AI Bots, Promotes Licensing Marketplace
Key Takeaways
- ▸80% of websites currently block AI bot crawlers, cutting off publishers from visibility to AI agents and reducing business opportunities
- ▸Microsoft's Publisher Content Marketplace enables publishers to monetize content through licensing agreements, with compensation tied to actual usage
- ▸The marketplace has expanded to eight premium publishers and includes major tech companies as partners, positioning Microsoft as the clearing house for publisher data licensing
Summary
Microsoft is urging publishers and retailers to allow AI bots to crawl their sites rather than blocking them, according to Nikhil Kolar, VP of Publisher Product at Microsoft AI. Currently, 80% of websites block AI crawlers, which Kolar warns cuts publishers off from discovery through AI agents and search engines. To address publisher concerns about fair value for their data, Microsoft is promoting its Publisher Content Marketplace, launched in February, which facilitates licensing agreements between publishers and AI developers including OpenAI and Meta.
The marketplace distinguishes between 'training'—initial model development using published content—and 'grounding'—real-time data pulls from trusted sources through sophisticated connections. Microsoft's focus is on the latter, compensating publishers each time their data informs an AI tool's reasoning. The marketplace has grown from one initial partner (People Inc.) to eight premium publishers, with Microsoft aiming to eventually license content from the entire open web. Publishers benefit from direct compensation while Microsoft captures additional value through Azure cloud infrastructure costs for inference.
- There is a self-serving element for Microsoft: the company benefits from publisher data for its AI models while also profiting from Azure cloud compute costs
