You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
o3de/AutomatedTesting/Gem/PythonTests/editor_test_testing
AMZN-AlexOteiza b815c203da
(Continuation) Implemented automation paralellization & standarization (#1718)
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
4 years ago
..
EditorTest_That_Crashes.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago
EditorTest_That_Fails.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago
EditorTest_That_Passes.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago
EditorTest_That_PassesToo.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago
TestSuite_Main.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago
__init__.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago
conftest.py (Continuation) Implemented automation paralellization & standarization (#1718) 4 years ago