Increasing Image Memorability with Neural Style Transfer - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue ACM Transactions on Multimedia Computing, Communications and Applications Année : 2019

Increasing Image Memorability with Neural Style Transfer

Résumé

Recent works in computer vision and multimedia have shown that image memorability can be automatically inferred exploiting powerful deep learning models. This paper advances the state of the art in this area by addressing a novel and more challenging issue: "Given an arbitrary input image, can we make it more memorable?". To tackle this problem we introduce an approach based on an editing-by-applying-filters paradigm: given an input image, we propose to automatically retrieve a set of "style seeds", i.e. a set of style images which, applied to the input image through a neural style transfer algorithm, provide the highest increase in memorability. We show the effectiveness of the proposed approach with experiments on the publicly available LaMem dataset, performing both a quantitative evaluation and a user study. To demonstrate the flexibility of the proposed framework, we also analyze the impact of different implementation choices, such as using different state of the art neural style transfer methods. Finally, we show several qualitative results to provide additional insights on the link between image style and memorability.
Fichier principal
Vignette du fichier
Siarohin-TOMM-2019.pdf (12.04 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01858389 , version 1 (03-11-2020)

Identifiants

Citer

Aliaksandr Siarohin, Gloria Zen, Cveta Majtanovic, Xavier Alameda-Pineda, Elisa Ricci, et al.. Increasing Image Memorability with Neural Style Transfer. ACM Transactions on Multimedia Computing, Communications and Applications, 2019, 15 (2), ⟨10.1145/3311781⟩. ⟨hal-01858389⟩
239 Consultations
262 Téléchargements

Altmetric

Partager

More