crosperf: Add support for using aquarium in Telemetry.
We want to test the story aquarium in rendering.desktop and see
the results comparison with graphics_WebGLAquarium in autotest.
This patch adds support to filter out the most important metric to
display in the report for the two aquarium stories (with different
number of fish). Also fix the logic of reading histogram results
when there's None value in the list.
Also add the test to toolchain nightly tests.
BUG=None
TEST=crosperf --board=nami with the two benchmarks
Change-Id: Ia1aa6bf796bee78bf6199332a07f4b96aa084845
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1779248
Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
Commit-Queue: Tiancong Wang <tcwang@google.com>
Tested-by: Tiancong Wang <tcwang@google.com>
Legacy-Commit-Queue: Commit Bot <commit-bot@chromium.org>
diff --git a/buildbot_test_toolchains.py b/buildbot_test_toolchains.py
index 22df871..a820320 100755
--- a/buildbot_test_toolchains.py
+++ b/buildbot_test_toolchains.py
@@ -171,6 +171,20 @@
run_local: False
retries: 0
}
+
+ benchmark: rendering.desktop {
+ run_local: False
+ suite: telemetry_Crosperf
+ test_args: --story-filter=aquarium$
+ iterations: 5
+ }
+
+ benchmark: rendering.desktop {
+ run_local: False
+ suite: telemetry_Crosperf
+ test_args: --story-filter=aquarium_20k$
+ iterations: 3
+ }
"""
with open(experiment_file, 'w') as f: