We take up on recent work on the Riemannian geometry of generative networks to propose a new approach for learning both a manifold structure and a Riemannian metric from data. It allows the derivation of statistical analysis on manifolds without the need for the user to design new Riemannian structure for each specific problem. In high-dimensional data, it can learn non diagonal metrics, whereas manual design is often limited to the diagonal case. We illustrate how the method allows the construction of a meaningful low-dimensional representation of data and exhibit the geometry of the space of brain images during Alzheimer's progression.