ImageSeek: A Hybrid Text-to-Image Image Retrieval Systemfor Domain-Specific Collections

This abstract has open access
Abstract Summary
Large image collections are typically organized around basic metadata and keyword tags, making content discovery challenging for users seeking specific visual information. Although images may be accompanied by descriptive text, traditional retrieval systems often struggle to bridge the semantic gap between textual descriptions and visual content. In this demo, we present ImageSeek, a hybrid text-to-image retrieval system designed to enhance search effectiveness by combining text and image-based retrieval methods through an asymmetric score adjustment mechanism. The system leverages multilingual CLIP models to encode both visual and textual information, creating unified representations for cross-modal retrieval. Users can search through natural language queries in any supported language, with results ranked using a hybrid approach that treats image-based retrieval as a reliable baseline while harmonizing text-based scores through position-dependent adjustments. The demonstration system operates on a dataset of 42,333 images from the Portuguese Presidency website, providing an appropriate testbed for multimodal retrieval performance. The web application enables direct comparison between conventional CLIP-based retrieval and our hybrid approach, supporting image searches under the same conditions on external platforms, including Google Images and the Arquivo.pt image search system, enabling comparative analysis of the results. To evaluate its effectiveness, ImageSeek allows users to experience differences between retrieval modes while exploring domain-specific visual content.
Abstract ID :
NKDR159
Submission Type

Associated Sessions

University of Beira Interior; INESC TEC
MSc Student
,
UBI / INESC TEC
Professor
,
University Of Beira Interior / INESC TEC

Abstracts With Same Type

Abstract ID
Abstract Title
Abstract Topic
Submission Type
Primary Author
NKDR143
Applications Machine Learning and Large Language Models Recommender systems Search and ranking
Demos
Trung Vo
NKDR166
Applications Machine Learning and Large Language Models Search and ranking Societally-motivated IR research
Demos
Rodrigo Silva
NKDR168
Demos
Rishiraj Saha Roy
NKDR156
Applications Machine Learning and Large Language Models Search and ranking System aspects
Demos
Quang Hieu Vu
NKDR160
Applications Conversational search and recommender systems Societally-motivated IR research
Demos
Markos Dimitsas
NKDR27
Evaluation researchMachine Learning and Large Language ModelsRecommender systems
Demos
Lukas Wegmeth
1 visits