In the context of benchmarking XML implementations, several XML benchmarks have been produced to either test the application’s overall performance or evaluate individual XML functionalities of a specific XML implementation. Among six popular XML benchmarks investigated in this article, all techniques rely on code-generated datasets which disregard many of XML’s irregular aspects such as varying the depth and breadth of the XML documents’ structure. This paper introduces a new test-model called the “3D XML benchmark” which aims to address these limitations by extending the dataset and query-set of existing XML benchmarks. Our experimental results have shown that XML techniques can perform inconsistently over different XML databases for some query classes, thus justifying the use of an improved benchmark.

XML Database Research at the University of Sheffield
Dr Siobhán North | Department of Computer Science | University of Sheffield