DeepComics: saliency estimation for comics - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2018

DeepComics: saliency estimation for comics

Abstract

A key requirement for training deep learning saliency models is large training eye tracking datasets. Despite the fact that the accessibility of eye tracking technology has greatly increased , collecting eye tracking data on a large scale for very specific content types is cumbersome, such as comic images, which are different from natural images such as photographs because text and pictorial content is integrated. In this paper, we show that a deep network trained on visual categories where the gaze deployment is similar to comics outperforms existing models and models trained with visual categories for which the gaze deployment is dramatically different from comics. Further, we find that it is better to use a computa-tionally generated dataset on visual category close to comics one than real eye tracking data of a visual category that has different gaze deployment. These findings hold implications for the transference of deep networks to different domains.
Fichier principal
Vignette du fichier
Bannier_ETRA_2018.pdf (4.44 Mo) Télécharger le fichier
architectureShortPaper.jpg (216.51 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01951413 , version 1 (11-12-2018)

Identifiers

Cite

Kévin Bannier, Eakta Jain, Olivier Le Meur. DeepComics: saliency estimation for comics. ETRA 2018 - ACM Symposium on Eye Tracking Research & Applications, Jun 2018, Warsaw, Poland. pp.1-5, ⟨10.1145/3204493.3204560⟩. ⟨hal-01951413⟩
176 View
329 Download

Altmetric

Share

More