Our benchmark files currently have no way to print the return the possible options to the user. If we'd implement such feature, we would not have to worry about our benchmark tests anymore that they might fail due to changes in any benchmark options. We could just go ahead and read the benchmarks specific options first and then run the test with the specific subset of options that are suitable.
I opened this issue as a kind of feature request in case someone else would like to open a PR to implement this and also to get feedback from others about it.
// cc @Trott I guess you might be interested in something like this.
Our benchmark files currently have no way to print the return the possible options to the user. If we'd implement such feature, we would not have to worry about our benchmark tests anymore that they might fail due to changes in any benchmark options. We could just go ahead and read the benchmarks specific options first and then run the test with the specific subset of options that are suitable.
I opened this issue as a kind of feature request in case someone else would like to open a PR to implement this and also to get feedback from others about it.
// cc @Trott I guess you might be interested in something like this.