Fixed workloads let learned systems overfit, so standard benchmarks overstate their benefit. We proposed benchmarks that vary workloads and data, report distributions and outliers in addition to averages, and account for the cost of training learned database components.
Research Goal
Evaluate learned components fairly
