Online Deep Learning Hyperparameter Tuning based on Provenance Analysis - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Journal of Information and Data Management Year : 2021

Online Deep Learning Hyperparameter Tuning based on Provenance Analysis


Training Deep Learning (DL) models require adjusting a series of hyperparameters. Although there are several tools to automatically choose the best hyperparameter configuration, the user is still the main actor to take the final decision. To decide whether the training should continue or try different configurations, the user needs to analyze online the hyperparameters most adequate to the training dataset, observing metrics such as accuracy and loss values. Provenance naturally represents data derivation relationships (i.e., transformations, parameter values, etc.), which provide important support in this data analysis. Most of the existing provenance solutions define their own and proprietary data representations to support DL users in choosing the best hyperparameter configuration, which makes data analysis and interoperability difficult. We present Keras-Prov and its extension, named Keras-Prov++, which provides an analytical dashboard to support online hyperparameter fine-tuning. Different from the current mainstream solutions, Keras-Prov automatically captures the provenance data of DL applications using the W3C PROV recommendation, allowing for hyperparameter online analysis to help the user deciding on changing hyperparameters' values after observing the performance of the models on a validation set. We provide an experimental evaluation of Keras-Prov++ using AlexNet and a real case study, named DenseED, that acts as a surrogate model for solving equations. During the online analysis, the users identify scenarios that suggest reducing the number of epochs to avoid unnecessary executions and fine-tuning the learning rate to improve the model accuracy.
Fichier principal
Vignette du fichier
JIDM_SBBD_2020__Special_Issue_(24).pdf (1.63 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

lirmm-03443660 , version 1 (23-11-2021)



Liliane Kunstmann, Débora Pina, Filipe Silva, Aline Paes, Patrick Valduriez, et al.. Online Deep Learning Hyperparameter Tuning based on Provenance Analysis. Journal of Information and Data Management, 2021, 12 (5), pp.396-414. ⟨10.5753/jidm.2021.1924⟩. ⟨lirmm-03443660⟩
89 View
225 Download



Gmail Mastodon Facebook X LinkedIn More