EasyDeep: An IoT Friendly Robust Detection Method for GAN Generated Deepfake Images in Social Media - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2022

EasyDeep: An IoT Friendly Robust Detection Method for GAN Generated Deepfake Images in Social Media

Alakananda Mitra
  • Fonction : Auteur
  • PersonId : 1355559
Saraju P. Mohanty
  • Fonction : Auteur
  • PersonId : 1112791
Peter Corcoran
  • Fonction : Auteur
  • PersonId : 1355560
Elias Kougianos
  • Fonction : Auteur
  • PersonId : 1112792

Résumé

Advancements in artificial intelligence, and especially deep learning technology have given birth to a new era of multimedia forgery. Deepfake takes it to a whole new level. This deep learning based technology creates new images with features which have been acquired from a different set of images. The rapid evolution of Generative Adversarial networks (GANs) provides an available route to create deepfakes. They generate highly sophisticated and realistic images through deep learning and implement deepfake using image-to-image translation. We propose a novel, memory-efficient lightweight machine learning based deepfake detection method which is successfully deployed in the IoT platform. A detection API is proposed along with the detection method. To the best of the authors’ knowledge, this effort is the first ever for detecting highly sophisticated GAN generated deepfake images at the edge. The novelty of the work is achieving a considerable amount of accuracy with a short training time and inference at the edge device. The total time for sending the image to the edge, detecting and result display through the API is promising. Some discussion is also provided to improve accuracy and to reduce the inference time. A comparative study is also made by performing a three-fold textural analysis - computation of Shannon’s entropy, measurement of some of Haralick’s texture features (like contrast, dissimilarity, homogeneity, correlation) and study of the histograms of the generated images. Even when generated fake images look similar to the corresponding real images, the results present clear evidence that they differ significantly from the real images in entropy, contrast, dissimilarity, homogeneity, and correlation.
Fichier sous embargo
Fichier sous embargo
0 0 10
Année Mois Jours
Avant la publication
mercredi 1 janvier 2025
Fichier sous embargo
mercredi 1 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04471531 , version 1 (21-02-2024)

Licence

Identifiants

Citer

Alakananda Mitra, Saraju P. Mohanty, Peter Corcoran, Elias Kougianos. EasyDeep: An IoT Friendly Robust Detection Method for GAN Generated Deepfake Images in Social Media. 4th IFIP International Internet of Things Conference (IFIPIoT), Nov 2021, Virtual, Netherlands. pp.217-236, ⟨10.1007/978-3-030-96466-5_14⟩. ⟨hal-04471531⟩
32 Consultations
2 Téléchargements

Altmetric

Partager

More