Study on an automated test case selection method based on a time-weighted utility scoring model
Abstract
To address the inefficiency, excessive resource consumption, and reliance on subjective experience in traditional test case selection for industrial Human-Machine Interface (HMI) systems, this paper proposes a Time-Weighted Utility Scoring Model (TWUSM) for automated test case prioritization and selection. The model quantitatively evaluates test cases across three key dimensions—risk impact on system safety, functional importance, and testing cost—using a weighted utility score that dynamically incorporates historical execution feedback. Based on the computation, test cases are categorized into priority tiers, high-score cases are selected deterministically as mandatory tests, while lower-score cases are subject to probabilistic sampling with selection probability proportional to their scores. Experimental results on an industrial HMI system demonstrate that TWUSM significantly reduces testing time, improves fault detection efficiency, and enhances the objectivity and reproducibility of the regression testing process, offering a lightweight, practical, and sustainable solution for industrial-scale automated testing.