DeepComics: saliency estimation for comics - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2018

DeepComics: saliency estimation for comics

Résumé

A key requirement for training deep learning saliency models is large training eye tracking datasets. Despite the fact that the accessibility of eye tracking technology has greatly increased , collecting eye tracking data on a large scale for very specific content types is cumbersome, such as comic images, which are different from natural images such as photographs because text and pictorial content is integrated. In this paper, we show that a deep network trained on visual categories where the gaze deployment is similar to comics outperforms existing models and models trained with visual categories for which the gaze deployment is dramatically different from comics. Further, we find that it is better to use a computa-tionally generated dataset on visual category close to comics one than real eye tracking data of a visual category that has different gaze deployment. These findings hold implications for the transference of deep networks to different domains.
Fichier principal
Vignette du fichier
Bannier_ETRA_2018.pdf (4.44 Mo) Télécharger le fichier
architectureShortPaper.jpg (216.51 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01951413 , version 1 (11-12-2018)

Identifiants

Citer

Kévin Bannier, Eakta Jain, Olivier Le Meur. DeepComics: saliency estimation for comics. ETRA 2018 - ACM Symposium on Eye Tracking Research & Applications, Jun 2018, Warsaw, Poland. pp.1-5, ⟨10.1145/3204493.3204560⟩. ⟨hal-01951413⟩
176 Consultations
329 Téléchargements

Altmetric

Partager

More