In this study, a novel method for selecting the optimal data augmentation method in combination with explainable artificial intelligence techniques is presented. Accordingly, a convolutional neural network-based model was designed to quantitatively evaluate the affective sound quality characteristics of vehicle driving sounds, which were classified as professional knowledge. Virtual learning data were created by adjusting the color of the image to avoid damaging the physical features of the spectrogram. By implementing the explainable artificial intelligence technique, the spectrogram features were extracted using domain knowledge. In particular, the engine noise of the vehicle, which plays a significant role in determining the characteristics of the running sound of the vehicle, was selected as a physical characteristic called the engine order line in the spectrogram. The explainable artificial intelligence technique was used to select the most influential feature among those extracted from the spectrogram. By observing the changes in the selected characteristics according to the data augmentation method, an optimal data augmentation method is proposed according to each characteristic. Furthermore, an average classification accuracy of 94.22% was obtained using the proposed data augmentation method, which is an improvement of 1.55–5.55% over the existing data augmentation methods. Moreover, according to the dataset, the standard deviation of the classification accuracy was 2.13%, which yielded an optimum result.
|Journal||Mechanical Systems and Signal Processing|
|Publication status||Published - 2022 Nov 1|
Bibliographical noteFunding Information:
This work was supported by the Sound Design Research Lab, R&D Division of Hyundai Motor Group (Grant No. 2021110528). This study was supported by the National Research Foundation of Korea (Grant No. 2022R1A2C2011034).
© 2022 Elsevier Ltd
All Science Journal Classification (ASJC) codes
- Control and Systems Engineering
- Signal Processing
- Civil and Structural Engineering
- Aerospace Engineering
- Mechanical Engineering
- Computer Science Applications