OSLO: On-the-Sphere Learning for Omnidirectional images and its application to 360-degree image compression - Inria EPFL Access content directly
Journal Articles IEEE Transactions on Image Processing Year : 2022

OSLO: On-the-Sphere Learning for Omnidirectional images and its application to 360-degree image compression

Abstract

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not straightforward. First, omnidirectional images have specific spatial and statistical properties that can not be fully captured by current CNN models. Second, basic mathematical operations composing a CNN architecture, e.g., translation and sampling, are not welldefined on the sphere. In this paper, we study the learning of representation models for omnidirectional images and propose to use the properties of HEALPix uniform sampling of the sphere to redefine the mathematical tools used in deep learning models for omnidirectional images. In particular, we: i) propose the definition of a new convolution operation on the sphere that keeps the high expressiveness and the low complexity of a classical 2D convolution; ii) adapt standard CNN techniques such as stride, iterative aggregation, and pixel shuffling to the spherical domain; and then iii) apply our new framework to the task of omnidirectional image compression. Our experiments show that our proposed on-the-sphere solution leads to a better compression gain that can save 13.7% of the bit rate compared to similar learned models applied to equirectangular images. Also, compared to learning models based on graph convolutional networks, our solution supports more expressive filters that can preserve high frequencies and provide a better perceptual quality of the compressed images. Such results demonstrate the efficiency of the proposed framework, which opens new research venues for other omnidirectional vision tasks to be effectively implemented on the sphere manifold.
Fichier principal
Vignette du fichier
OSLO__On_the_Sphere_Learning_for_Omnidirectional_images_and_its_application_to_360_degree_image_compression.pdf (16.38 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03833562 , version 1 (28-10-2022)

Identifiers

  • HAL Id : hal-03833562 , version 1

Cite

Navid Mahmoudian Bidgoli, Roberto Azevedo, Thomas Maugey, Aline Roumy, Pascal Frossard. OSLO: On-the-Sphere Learning for Omnidirectional images and its application to 360-degree image compression. IEEE Transactions on Image Processing, 2022, pp.1-16. ⟨hal-03833562⟩
51 View
47 Download

Share

Gmail Facebook X LinkedIn More