[development] automated tests for timing editor loading of the 10k levels (#7472)

It has been observed that when entering game mode in the editor with the 10k levels, the Vulkan backend performs significantly worse compared to DX12 on Windows. These tests are intended to detect if either backend gets worse with a currently generous timeout of 3 minutes to complete (10 for the Vulkan outlier) and should lowered over time as this metric stabilizes. Added a new periodic tests job to specifically run on a GPU instance. Signed-off-by: AMZN-ScottR <24445312+AMZN-ScottR@users.noreply.github.com>
2022-02-15 11:17:15 -08:00
parent 4bf6b6ba15
commit aaa8b9df7c
11 changed files with 250 additions and 1 deletions
@@ -0,0 +1,15 @@
+"""
+Copyright (c) Contributors to the Open 3D Engine Project.
+For complete copyright and license terms please see the LICENSE at the root of this distribution.
+
+SPDX-License-Identifier: Apache-2.0 OR MIT
+"""
+
+from Performance.utils.perf_timer import time_editor_level_loading
+
+def EditorLevelLoading_10kVegInstancesTest():
+    time_editor_level_loading('Performance', '10kVegInstancesTest')
+
+if __name__ == "__main__":
+    from editor_python_test_tools.utils import Report
+    Report.start_test(EditorLevelLoading_10kVegInstancesTest)