The org behind the dataset used to train Stable Diffusion claims it has removed CSAM | TechCrunch

LAION has released Re-LAION-5B, a thoroughly cleaned version of its widely used image-text dataset, to address serious ethical concerns regarding illegal content. Following a Stanford investigation that identified thousands of links to suspected child sexual abuse material and other harmful content within the original dataset, LAION collaborated with major nonprofits to remove these indices. This update demonstrates the open-source community’s capacity to self-regulate and correct data integrity issues, ensuring that foundational resources for generative AI remain aligned with safety standards and legal requirements. The initiative highlights the critical importance of transparency and accountability in open_data ecosystems. By providing a verified, safe alternative, LAION underscores the necessity of rigorous curation processes for public datasets, especially those with broad accessibility and commercial implications. This effort serves as a model for how research organizations can respond to external scrutiny, offering a clear path for researchers to migrate to safer assets while maintaining the collaborative spirit inherent to open science. This release is particularly relevant to open_data as it illustrates the tension between rapid innovation and ethical responsibility. It emphasizes that even non-commercial, research-oriented datasets can have significant downstream impacts on AI development and public trust. The availability of Re-LAION-5B encourages the broader community to prioritize data hygiene, proving that open access does not preclude strict adherence to legal and moral boundaries in data management.

Source: techcrunch.com
Published on 2024-08-31