Chang-Nam Lim, Ye-Seul Park, Jung-Won Lee

KIPS Transactions on Software and Data Engineering, Vol. 10, No. 9, pp. 375-384, Sep. 2021
https://doi.org/10.3745/KTSDE.2021.10.9.375,   PDF Download:
Keywords: Deep Learning, Coverage Testing, Image Feature Extraction, Validation Method, Dataset Splitting Method
Abstract

Deep learning techniques have been proven to have high performance in image processing and are applied in various fields. The most widely used methods for validating a deep learning model include a holdout verification method, a k-fold cross verification method, and a bootstrap method. These legacy methods consider the balance of the ratio between classes in the process of dividing the data set, but do not consider the ratio of various features that exist within the same class. If these features are not considered, verification results may be biased toward some features. Therefore, we propose a deep learning model validation method based on data feature coverage for image classification by improving the legacy methods. The proposed technique proposes a data feature coverage that can be measured numerically how much the training data set for training and validation of the deep learning model and the evaluation data set reflects the features of the entire data set. In this method, the data set can be divided by ensuring coverage to include all features of the entire data set, and the evaluation result of the model can be analyzed in units of feature clusters. As a result, by providing feature cluster information for the evaluation result of the trained model, feature information of data that affects the trained model can be provided.

Statistics
Cite this article