International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

TriMAE: Fashion visual search with Triplet Masked Auto Encoder Vision Transformer

Authors :

Lachin Zamani¹ Reza Azmi²

1- Department of Computer Engineering, Faculty of Engineering, Alzahra University, Tehran, Iran 2- Department of Computer Engineering, Faculty of Engineering, Alzahra University, Tehran, Iran

Keywords :

Visual Search،Triplet Network،Masked Auto Encoders Vision Transformer

Abstract :

Visual search is a technology that identifies images similar to a provided query image and presents results ranked by similarity. In the realm of apparel, this innovative tool revolutionizes shopping by enabling users to effortlessly find desired items based on visual preference. Visual search remains a challenging problem despite its potential to significantly enhance user experience. The existence of differences in minute details, the presence of multiple garments in a single image, discrepancies between user-taken and catalog images, and the inherent flexibility of clothing are among the challenges associated with this issue. By selecting robust features and improving the learning of similarity and dissimilarity between images, superior results can be obtained. Consequently, a method has been proposed to yield enhanced outcomes. Convolutional Neural Networks and Vision Transformers are commonly used as the backbone of triplet neural networks for visual search tasks. These networks are designed to better learn the similarities and differences between images. In this research, we employ a combination of triplet neural networks and a masked auto-encoder vision transformer model. A triplet loss function is used during network training to learn the similarity between images. We evaluate our method on the DeepFashion In-shop dataset, which comprises different categories of clothing images. Through extensive experiments on this benchmark, our model achieves an impressive Recall@1 of 93.2% for visual search.

Papers List

List of archived papers

Parallel Local Feature Selection For High-dimensional Data

Zhaleh Manbari - Chiman Salavati - Fardin AkhlaghianTab - Barzan Saeedpoor - Himan Delbina - Mahmud Abdulla Mohammad

Vaccine Distribution Modelling in Pandemics through Multi-Agent Systems: COVID-19 Case

Hossein Yarahmadi - Mohammad Ebrahim Shiri - Hamid Reza Navidi - Arash Sharifi - Moharram Challenger - Hassan Piriaei

Intelligent Adaptive Control of Wheeled Mobile Robots with MLP Neural Networks under Input Constraints

Soheil Sheikh ahmadi - Arash Rahmani

A Comprehensive Dataset of Real-scene Images for Text Detection and Recognition in Persian

Iman Souzanchi - Ramin Rahimi - Mohammad Ali Majidi Anvari - Atefeh Baniasadi - Ashkan Sadeghi - Mohammad Reza Mohammadi

Classification of COVID-19 and Nodule in CT Images using Deep Convolutional Neural Network

Amirhossein Ghaemi - Seyyed Amir Mousavi mobarakeh - Habibollah Danyali - Kamran Kazemi

Analysis of Insect-plant Interactions Affected by Mining operations, A Graph Mining Approach

Mohammad Heydari - Ali Bayat - Amir Albadvi

AVID: A VARIATIONAL INFERENCE DELIBERATION FOR META-LEARNING

Alireza Javaheri - Arsham Gholamzadeh Khoee - Saeed Reza Kheradpisheh - Hadi Farahani - Mohammad Ganjtabesh

Improvement of Credit Scoring by LSTM Autoencoder Model

Milad Sattari Maleki - Seyedeh Niusha Motevallian - Faezehsadat Hosseini - Mohammad Sabokrou - Hamidreza Soltanalizadeh Maleki

A Language-Independent Approach to Classification of Textual File Fragments: Case Study of Persian, English, and Chinese Languages

Fatemeh Mansouri Hanis - Hamidreza Khoshvaghti - Mehdi Teimouri - Hadi Veisi

Improving the classification of high dimensional class-imbalanced data using the Chaos particle swarm optimization with Levy Flight

Mohammad Ali Zarif - Javad Hamidzadeh