Google, Microsoft and AI giants agree to a shared website scraping rule, but webmasters still have no real control over how their content is used - Investment Watch Blog
Big Tech companies pledge to respect a single robots.txt signal, streamlining consent for AI training data. This reduces webmaster burden by replacing fragmented rules with a unified standard, directly enhancing transparency in how open data sources are utilized for machine learning. However, the initiative merely indicates usage preference rather than blocking access, leaving previously scraped content unaffected. Since it remains unapproved and lacks full compliance, its immediate impact on open data governance is limited despite the symbolic shift toward user control. This development is relevant to open data as it highlights the tension between data accessibility and ethical sourcing. While it offers a simplified consent mechanism, the lack of enforcement means open data advocates must remain vigilant about unauthorized AI training on public information.
Source: investmentwatchblog.comPublished on 2026-11-11
Related news
- Nvidia-KAIST Lab Sets 2027 Goal for Korean AI Training Data | EconoTimes
- Australia plans AI safety regulator after OpenAI agent breach
- Gov proposes AI safety regulator
- Agentic Commerce Means Companies Have to Relearn Their Audiences
- American Atheists sues Departments of Justice, Interior Over Worship Event on National Mall | American Atheists