Deep learning languages: a key fundamental shift from probabilities to weights? - Inria - Institut national de recherche en sciences et technologies du numérique
Pré-Publication, Document De Travail Année : 2019

Deep learning languages: a key fundamental shift from probabilities to weights?

Résumé

Recent successes in language modeling, notably with deep learning methods, coincide with a shift from probabilistic to weighted representations. We raise here the question of the importance of this evolution, in the light of the practical limitations of a classical and simple probabilistic modeling approach for the classification of protein sequences and in relation to the need for principled methods to learn non-probabilistic models.
Fichier principal
Vignette du fichier
probxit.pdf (185.95 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02235207 , version 1 (01-08-2019)

Identifiants

Citer

François Coste. Deep learning languages: a key fundamental shift from probabilities to weights?. 2019. ⟨hal-02235207⟩
77 Consultations
161 Téléchargements

Altmetric

Partager

More