Kim Soo In, Jeon Young Jin, Lee Sang Bum, Kim Won Gyum

KIPS Transactions on Software and Data Engineering, Vol. 12, No. 12, pp. 519-524, Dec. 2023
https://doi.org/10.3745/KTSDE.2023.12.12.519,   PDF Download:
Keywords: Deephashing, Image retrieval, Variational Inference, Self-Supervised Learning, Attention Mechanism
Abstract

In hashing-based image retrieval, the hash code of a manipulated image is different from the original image, making it difficult to search for the same image. This paper proposes and evaluates a self-supervised deephashing model that generates perceptual hash codes from feature information such as texture, shape, and color of images. The comparison models are autoencoder-based variational inference models, but the encoder is designed with a fully connected layer, convolutional neural network, and transformer modules. The proposed model is a variational inference model that includes a SimAM module of extracting geometric patterns and positional relationships within images. The SimAM module can learn latent vectors highlighting objects or local regions through an energy function using the activation values of neurons and surrounding neurons. The proposed method is a representation learning model that can generate low-dimensional latent vectors from high-dimensional input images, and the latent vectors are binarized into distinguishable hash code. From the experimental results on public datasets such as CIFAR-10, ImageNet, and NUS-WIDE, the proposed model is superior to the comparative model and analyzed to have equivalent performance to the supervised learning-based deephashing model. The proposed model can be used in application systems that require low-dimensional representation of images, such as image search or copyright image determination.

Statistics
Cite this article