This repository contains the code needed to run the Crossfilter Benchmark. Details on all materials associated with the Crossfilter Benchmark project, including our datasets, Docker environment, and detailed instructions are available through our OSF repository.
More details on how to run IDEBench itself are available on the IDEBench GitHub wiki.
MIT
Users of the Crossfilter Benchmark are requested to use the following BibTeX reference for our SIGMOD 2020 paper:
@inproceedings{battle2020database,
author = {Battle, Leilani and Eichmann, Philipp and Angelini, Marco and Catarci, Tiziana and Santucci, Giuseppe and Zheng, Yukun and Binnig, Carsten and Fekete, Jean-Daniel and Moritz, Dominik},
title = {Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data},
year = {2020},
isbn = {9781450367356},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3318464.3389732},
doi = {10.1145/3318464.3389732},
booktitle = {Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data},
pages = {1571--1587},
numpages = {17},
keywords = {visualization performance benchmarks, interactive data exploration},
location = {Portland, OR, USA},
series = {SIGMOD '20}
}
Leilani Battle, Philipp Eichmann, Marco Angelini, Carsten Binnig, Tiziana Catarci, Jean-Daniel Fekete, Giuseppe Santucci, Dominik Moritz, and Yukun Zheng. "Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data." SIGMOD 2020. PDF
Philipp Eichmann, Emanuel Zgraggen, Carsten Binnig and Tim Kraska. "IDEBench: A Benchmark for Interactive Data Exploration". SIGMOD 2020. PDF
Leilani Battle, Marco Angelini, Carsten Binnig, Tiziana Catarci, Philipp Eichmann, Jean-Daniel Fekete, Giuseppe Santucci, Michael Sedlmair and Wesley Willett. "Evaluating Visual Data Analysis Systems: A Discussion Report." HILDA 2018 PDF
Leilani Battle, Remco Chang, Jeffrey Heer, and Michael Stonebraker. "Position Statement: The Case for a Visualization Performance Benchmark." DSIA Workshop 2017. PDF
Eichmann, Philipp, Emanuel Zgraggen, Zheguang Zhao, Carsten Binnig, and Tim Kraska. "Towards a Benchmark for Interactive Data Exploration." IEEE Data Eng. Bull. 39, no. 4 (2016): 50-61. PDF