Hugging Face apuesta por el futuro de la inteligencia artificial con la adquisición de XetHub
Hugging Face has acquired XetHub, a technology designed to manage massive volumes of data through an optimized version control system. This merger enables updating only the changes in extremely large files, eliminating the need for full re-uploads and drastically optimizing the use of computational resources and time, which is essential for machine learning teams operating at an industrial scale. The integration resolves a critical limitation of traditional infrastructures, allowing efficient storage and management of repositories and models that far exceed current limits. By adopting advanced techniques such as deduplication and content-based management, the open-source platform can support datasets and models of terabyte scale, facilitating faster and more efficient iterations without sacrificing the collaboration and traceability capabilities that characterize its development environments. This move is crucial for the open data ecosystem because it validates and scales the need for open infrastructures capable of handling the complexity of the next generation of artificial intelligence. By ensuring that the leading AI platform remains accessible yet technically robust, a significant technical barrier to collaborative research and development is removed, guaranteeing that the community can work with increasingly large and complex models within a transparent and scalable framework.
Source: wwwhatsnew.comPublished on 2024-08-11