Balancing training data and human knowledge makes AI act more like a scientist

The article introduces a framework for "informed machine learning" that balances the influence of human-provided rules against data-driven patterns in AI models. Unlike purely data-driven generative AI, which often fails to grasp fundamental physical laws and struggles with unfamiliar scenarios, informed models integrate explicit scientific principles to better reflect reality. This approach addresses the critical challenge of determining how much weight to assign to knowledge versus data, ensuring that AI systems can effectively navigate complex scientific problems while maintaining robust performance beyond their training datasets. By evaluating the relative contribution of individual rules, the framework allows developers to optimize model accuracy and efficiency. The researchers demonstrate that analyzing interactions between multiple rules helps filter out redundant or interfering constraints while identifying synergistic combinations. This optimization prevents model collapse when handling complex equations or experimental conditions, such as in chemistry, proving that structured knowledge significantly enhances predictive capabilities in engineering and physics applications. This research is highly relevant to open data because it advances the goal of creating transparent, interpretable, and scientifically rigorous AI systems. By enabling models to extract rules directly from data, the work moves toward autonomous "AI scientists" that can generate and validate knowledge openly. This reduces reliance on opaque, black-box algorithms, fostering a future where AI development is grounded in verifiable, accessible, and reproducible scientific principles rather than hidden statistical correlations.

Source: sciencedaily.com
Published on 2024-03-11