AI pioneer Cerebras opens up generative AI where OpenAI goes dark

Cerebras Systems has released seven open-source large language models, directly challenging the industry’s growing trend toward secrecy. While competitors like OpenAI withhold technical details to protect commercial advantages, Cerebras provides both the source code and training methodologies, aiming to foster a collaborative ecosystem rather than a closed one. This move highlights a strategic divergence in how the AI community values transparency versus proprietary control. The release is significant because it includes state-of-the-art training efficiency techniques and the first open-source scaling law, derived from publicly available data. By sharing these benchmarks, Cerebras enables researchers to accurately reproduce results and understand model performance without relying on hidden corporate datasets. This level of detail allows the broader scientific community to verify claims and build upon established knowledge, addressing the reproducibility crisis in AI research. This action is crucial for open data because it democratizes access to advanced AI tools that are typically reserved for well-funded entities. Cerebras argues that high computational efficiency reduces costs, allowing companies to share their innovations without losing competitive edge. By removing barriers to entry, this initiative encourages diverse institutions to develop novel applications, ensuring that the benefits of generative AI are distributed more widely across academia and smaller enterprises rather than being monopolized by a few tech giants.

Source: zdnet.com
Published on 2023-03-30