AI giants targeted by scraping bots — ChatGPT and Perplexity enter the most-scraped websites list for the first time

Businesses are fundamentally shifting their data collection strategies by targeting AI platforms like ChatGPT and Perplexity instead of conventional retail sites. This change reveals that organizations no longer just monitor search queries but actively scrape AI outputs to understand consumer perceptions and brand positioning. Consequently, traditional e-commerce giants have dropped from the top monitoring lists, indicating a broader evolution in consumer behavior and where value is now assessed. This transition highlights a critical implication for open data, as AI-generated content becomes a primary source of market intelligence. The data shows that scraping AI responses allows companies to gauge how their products are described and ranked by automated systems, rather than direct user searches. This suggests that the integrity and transparency of AI outputs are becoming as important as the raw data itself for business decision-making. Furthermore, the rise of AI agents suggests that automated systems may soon conduct these scrapes, accelerating the feedback loop between consumer trends and AI responses. For the open data community, this marks a pivotal moment where the focus must shift from accessing static web data to understanding dynamic AI-generated insights. It underscores the need for transparent data practices within AI models to ensure that market information remains accurate and accessible for all stakeholders.

Source: techradar.com
Published on 2026-10-06

AI giants targeted by scraping bots — ChatGPT and Perplexity enter the most-scraped websites list for the first time

Related news