AI's free web scraping days may be over, thanks to this new licensing protocol

The article introduces the Really Simple Licensing (RSL) protocol, a new web standard designed to return control to content publishers against aggressive AI data scraping. Rather than relying on ignored robots.txt files, RSL embeds machine-readable licensing terms directly into web infrastructure. This allows creators to explicitly define how their work is used, offering options ranging from free access with attribution to mandatory payment for crawling or AI inference, effectively ending the era of uncompensated content harvesting. To address the significant imbalance of power between individual publishers and large AI corporations, the initiative is supported by the RSL Collective. Modeled after music rights organizations, this entity enables creators to pool their rights and negotiate licensing terms collectively. By presenting a united front, publishers can secure fair compensation and establish sustainable economic models, ensuring that the entities benefiting from AI training data contribute financially back to the content creators who made the information possible. This development is critically relevant to open_data as it establishes a technical framework for balancing open access with creator rights. RSL demonstrates how open protocols can evolve to govern data usage in the AI age, providing a standardized method for licensing and attribution. It challenges the assumption that all data must be freely available for training, proposing instead a system where open data initiatives can coexist with commercial licensing requirements, thereby protecting intellectual property while maintaining interoperability.

Source: zdnet.com
Published on 2025-09-11

AI's free web scraping days may be over, thanks to this new licensing protocol

Related news