The iBench Integration Metadata Generator - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Proceedings of the VLDB Endowment (PVLDB) Year : 2015

The iBench Integration Metadata Generator

Patricia C. Arocena
  • Function : Author
  • PersonId : 969192
Boris Glavic
  • Function : Author
  • PersonId : 969193
Radu Ciucanu
Renée J. Miller
  • Function : Author
  • PersonId : 969194


Given the maturity of the data integration field it is surprising that rigorous empirical evaluations of research ideas are so scarce. We identify a major roadblock for empirical work - the lack of comprehensive metadata generators that can be used to create benchmarks for different integration tasks. This makes it difficult to compare integration solutions, understand their generality, and understand their performance. We present iBench, the first metadata generator that can be used to evaluate a wide-range of integration tasks (data exchange, mapping creation, mapping composition, schema evolution, among many others). iBench permits control over the size and characteristics of the metadata it generates (schemas, constraints, and mappings). Our evaluation demonstrates that iBench can efficiently generate very large, complex, yet realistic scenarios with different characteristics. We also present an evaluation of three mapping creation systems using iBench and show that the intricate control that iBench provides over metadata scenarios can reveal new and important empirical insights. iBench is an open-source, extensible tool that we are providing to the community. We believe it will raise the bar for empirical evaluation and comparison of data integration systems.
No file

Dates and versions

hal-01251237 , version 1 (05-01-2016)


  • HAL Id : hal-01251237 , version 1


Patricia C. Arocena, Boris Glavic, Radu Ciucanu, Renée J. Miller. The iBench Integration Metadata Generator. Proceedings of the VLDB Endowment (PVLDB), 2015, 9 (3), pp.108-119. ⟨hal-01251237⟩
86 View
0 Download


Gmail Facebook X LinkedIn More