We discuss what questions benchmarks can answer, the value of hypothesis tests, and which tests to use in different benchmarking scenarios.