Increasing Image Memorability with Neural Style Transfer - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles ACM Transactions on Multimedia Computing, Communications and Applications Year : 2019

Increasing Image Memorability with Neural Style Transfer

Abstract

Recent works in computer vision and multimedia have shown that image memorability can be automatically inferred exploiting powerful deep learning models. This paper advances the state of the art in this area by addressing a novel and more challenging issue: "Given an arbitrary input image, can we make it more memorable?". To tackle this problem we introduce an approach based on an editing-by-applying-filters paradigm: given an input image, we propose to automatically retrieve a set of "style seeds", i.e. a set of style images which, applied to the input image through a neural style transfer algorithm, provide the highest increase in memorability. We show the effectiveness of the proposed approach with experiments on the publicly available LaMem dataset, performing both a quantitative evaluation and a user study. To demonstrate the flexibility of the proposed framework, we also analyze the impact of different implementation choices, such as using different state of the art neural style transfer methods. Finally, we show several qualitative results to provide additional insights on the link between image style and memorability.
Fichier principal
Vignette du fichier
Siarohin-TOMM-2019.pdf (12.04 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01858389 , version 1 (03-11-2020)

Identifiers

Cite

Aliaksandr Siarohin, Gloria Zen, Cveta Majtanovic, Xavier Alameda-Pineda, Elisa Ricci, et al.. Increasing Image Memorability with Neural Style Transfer. ACM Transactions on Multimedia Computing, Communications and Applications, 2019, 15 (2), ⟨10.1145/3311781⟩. ⟨hal-01858389⟩
230 View
202 Download

Altmetric

Share

Gmail Facebook X LinkedIn More