International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

TriMAE: Fashion visual search with Triplet Masked Auto Encoder Vision Transformer

Authors :

Lachin Zamani¹ Reza Azmi²

1- Department of Computer Engineering, Faculty of Engineering, Alzahra University, Tehran, Iran 2- Department of Computer Engineering, Faculty of Engineering, Alzahra University, Tehran, Iran

Keywords :

Visual Search،Triplet Network،Masked Auto Encoders Vision Transformer

Abstract :

Visual search is a technology that identifies images similar to a provided query image and presents results ranked by similarity. In the realm of apparel, this innovative tool revolutionizes shopping by enabling users to effortlessly find desired items based on visual preference. Visual search remains a challenging problem despite its potential to significantly enhance user experience. The existence of differences in minute details, the presence of multiple garments in a single image, discrepancies between user-taken and catalog images, and the inherent flexibility of clothing are among the challenges associated with this issue. By selecting robust features and improving the learning of similarity and dissimilarity between images, superior results can be obtained. Consequently, a method has been proposed to yield enhanced outcomes. Convolutional Neural Networks and Vision Transformers are commonly used as the backbone of triplet neural networks for visual search tasks. These networks are designed to better learn the similarities and differences between images. In this research, we employ a combination of triplet neural networks and a masked auto-encoder vision transformer model. A triplet loss function is used during network training to learn the similarity between images. We evaluate our method on the DeepFashion In-shop dataset, which comprises different categories of clothing images. Through extensive experiments on this benchmark, our model achieves an impressive Recall@1 of 93.2% for visual search.

Papers List

List of archived papers

Adaptive Pattern Reconstruction Using Linear Regression for Improved TPS Anomaly Detection

Ali Azarsina - Alireza Safarzadeh - MohammadReza Jamali - Abdolhossein Vahabie

Parallel Local Feature Selection For High-dimensional Data

Zhaleh Manbari - Chiman Salavati - Fardin AkhlaghianTab - Barzan Saeedpoor - Himan Delbina - Mahmud Abdulla Mohammad

Optimal PMU Placement Considering Reliability of Measurement System in Smart Grids

Mohammad Shahraeini - Shahla Khormali - Ahad Alvandi

AVID: A VARIATIONAL INFERENCE DELIBERATION FOR META-LEARNING

Alireza Javaheri - Arsham Gholamzadeh Khoee - Saeed Reza Kheradpisheh - Hadi Farahani - Mohammad Ganjtabesh

An Automated Visual Defect Segmentation for Flat Steel Surface Using Deep Neural Networks

Dorna Nourbakhsh Sabet - Mohammad Reza Zarifi - Javad Khoramdel - Yasamin Borhani - Esmaeil Najafi

Swin-RSCBNet: A Transformer-Based Network for Skin Cancer Segmentation with Multi-Scale and Attention Modules

Benyamin Mirab Golkhatmi - Mostafa Heydari - Mahboobeh Houshmand - Seyyed Abed Hosseini

Computational Microscopy Based on Fourier Ptychography using Embedded Architecture

Rezvan Mir - Abedin Vahedian

Distilled BERT Model In Natural Language Processing

Yazdan Zandiye Vakili - Avisa Fallah - Hedieh Sajedi

VVC-AAR: Adaptive Attention-Aware Resolution and Residual Coding for Perceptually Optimized Ultra-Low Bitrate VVC Compression

Yaghoub Saberi - Somayeh Arab Najafabadi - Mohammadreza Hemmati

An intelligent linguistic error detection approach to automated diagnosis of Dyslexia disorder in Persian speaking children

Fatemeh Asghari - Mahsa Khorasani - Mohsen Kahani - Seyed Amir Amin Yazdi - Mahdi Arkhodi Ghalenoei