Learning and Reasoning for Cultural Metadata Quality - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Journal on Computing and Cultural Heritage Year : 2022

Learning and Reasoning for Cultural Metadata Quality

Abstract

This work combines semantic reasoning and machine learning to create tools that allow curators of the visual art collections to identify and correct the annotations of the artwork as well as to improve the relevance of the content-based search results in these collections. The research is based on the Joconde database maintained by French Ministry of Culture that contains illustrated artwork records from main French public and private museums representing archeological objects, decorative arts, fine arts, historical and scientific documents, etc. The Joconde database includes semantic metadata that describes properties of the artworks and their content. The developed methods create a data pipeline that processes metadata, trains a Convolutional Neural Network image classification model, makes prediction for the entire collection and expands the metadata to be the base for the SPARQL search queries. We developed a set of such queries to identify noise and silence in the human annotations and to search image content with results ranked according to the relevance of the objects quantified by the prediction score provided by the deep learning model. We also developed methods to discover new contextual relationships between the concepts in the metadata by analyzing the contrast between the concepts similarities in the Joconde's semantic model and other vocabularies and we tried to improve the model prediction scores based on the semantic relations. Our results show that cross-fertilization between symbolic AI and machine learning can indeed provide the tools to address the challenges of the museum curators work describing the artwork pieces and searching for the relevant images.
Fichier principal
Vignette du fichier
Learning and Reasoning for Cultural Metadata Quality.revision2.pdf (1.62 Mo) Télécharger le fichier
Supplementary Materials for Learning and Reasoning for Cultural Metadata Quality.Revision2.pdf (1.17 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03363442 , version 1 (04-10-2021)

Identifiers

Cite

Anna Bobasheva, Fabien Gandon, Frédéric Precioso. Learning and Reasoning for Cultural Metadata Quality. Journal on Computing and Cultural Heritage, 2022, 15 (3), ⟨10.1145/3485844⟩. ⟨hal-03363442⟩
294 View
308 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More