birkeh/o3de
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,750 Commits 3 Branches 3 Tags
fc3d2ce94cdca041d3aa896dfd487dc3480fea7e
Commit Graph

108 Commits

Author SHA1 Message Date
Allen Jackson 815c2d1986 {lyn5868} fixing the asset_processor_batch_tests.py auto tests (#5247) 
Signed-off-by: Allen Jackson <23512001+jackalbe@users.noreply.github.com>
 2021-11-03 13:19:22 -05:00
Mike Balfour 576ebada70 Merge commit '8b5a0350b57486bbfa04f1233abfd3a086c25ea1' into mbalfour/gitflow_211102_o3de 2021-11-02 09:38:35 -05:00
Allen Jackson 8b5a0350b5 {lyn7621} adding more time via ap_max_activate_time (#5180) 
* adding more time via ap_max_activate_time so that the Debug
  version of AP-GUI can load all the builder DLLs

Signed-off-by: jackalbe <23512001+jackalbe@users.noreply.github.com>
 2021-11-01 17:27:17 -05:00
Sean Sweeney ea4bc31b38 Merge pull request #4675 from aws-lumberyard-dev/editor_test_tools_cleanup 
Editor test tools cleanup
 2021-10-29 15:47:26 -07:00
evanchia 4e2de0170c reverting typehints 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-28 19:33:59 -07:00
evanchia 7c25cb6d5a addressing minor details in feedback 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-26 10:37:39 -07:00
Sean Sweeney 45b164e722 Merge pull request #4881 from aws-lumberyard-dev/lytt_update_defaults 
Lytt update defaults
 2021-10-22 14:27:56 -07:00
evanchia 29ecb0a246 fixing more AR only unit test failures 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-21 19:49:42 -07:00
evanchia f61c37786f fixing unit test with local time issue 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-21 16:40:48 -07:00
evanchia 670e9a1fa1 merge with development 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-21 14:56:16 -07:00
evanchia 6168528964 fixing unit tests 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-21 14:44:43 -07:00
AMZN-AlexOteiza ea442b80d1 Renamed ctest_pytest.ini to pytest.ini so it is used by default, added TestSuite_ as collection file (#4822) 
* Fixed warnings of unused marks, renamed ctest_pytest.ini to pytest.ini to better consistency on runs

* Fixed some test suites to run propertly

* Fix missing arguments

* Fixed missing cmakelists and renamed missing file

* Temp disable editor_testing_tests as timeout in jenkins
 2021-10-21 22:03:18 +01:00
sweeneys ea325d356c updated defaults in all launchers, with additional unit test 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-21 12:07:43 -07:00
sweeneys a1edb2c4ac Update platform defaults to return a launcher instead of a string 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-21 11:51:47 -07:00
evanchia 64a20c45b5 adding editor integ tests to AR 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-19 15:51:44 -07:00
evanchia 62a5aa1874 fixing test breaking changes 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-18 18:15:46 -07:00
evanchia 90bd09ffca Fixing minor details in unit tests 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-18 14:13:31 -07:00
evanchia 84493760ca addressing PR feedback 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-18 13:27:40 -07:00
evanchia f12d7626f8 Finishing up unit tests 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-13 16:22:26 -07:00
sweeneys 2b7262f566 Mock additional popen calls 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-13 14:14:01 -07:00
evanchia a53e0e8124 Merging development into editor_test_tools_cleanup 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-13 12:50:17 -07:00
evanchia 8ab9f89b46 Adding unit tests and docstrings for editor test files 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-13 12:43:54 -07:00
sweeneys f1fa0acbb4 Stabilize asset processor immediately exiting 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-13 11:44:15 -07:00
Sean Sweeney 1ea472bdeb Merge pull request #4589 from aws-lumberyard-dev/lytt_integ_linux 
Platform manager and sanity tests for Linux
 2021-10-12 15:11:12 -07:00
Artur K 80db67e90a Remove many unused variables and unused setting files (#4607) 
* Remove many unused variables and unused setting files

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>

* Remove a few more dead config vars

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>

* fix android test_ConfigureSettings_DefaultValues_SetsValues

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>
 2021-10-12 17:06:15 -05:00
sweeneys 45def74409 Fix extension ignoring between Windows and Linux 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-11 11:11:40 -07:00
sweeneys 2034cd3053 Platform manager and sanity tests for Linux 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-08 15:36:52 -07:00
Sean Sweeney a8559c4000 Merge pull request #4374 from aws-lumberyard-dev/lytt_linux_tests 
Lytt linux tests
 2021-09-29 09:31:44 -07:00
sweeneys f6585a741c docstring updates 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-09-28 14:55:16 -07:00
evanchia bcf024edf9 registering linux integ test to cmake 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-09-27 14:33:08 -07:00
evanchia 4998f44246 adding process_utils linux integ test 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-09-27 14:25:43 -07:00
sweeneys 09ce73aa44 Initial update for this module's unit tests on Linux 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-09-22 17:50:38 -07:00
AMZN-AlexOteiza d784ff8c57 Added debugger attachment utilities to the engine, fixed crash when showing console variables, improvements to timeout handling and small cleanup (#3591) 
* Added debugger attachment utilities to the engine, fixed crash when showing console variables

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unused variables

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unneded check

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Small fix for crashes/timeouts

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unused variable, fixed compile error

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix compile

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Addressed esteban comments

* Addressed tom comments

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-08-31 10:27:14 +02:00
jckand-amzn a3868068d5 Merge branch 'development' of https://github.com/o3de/o3de into jckand/EditorAutomationOptimization 2021-08-25 11:33:17 -05:00
Esteban Papp f94043dc83 Adds functions so targets can define install directories/files 2021-08-24 15:12:02 -07:00
jckand-amzn b466788cc4 Updating editor_test.py to allow for per-test null_renderer overrides 
Signed-off-by: jckand-amzn <jckand@amazon.com>
 2021-08-24 16:10:36 -05:00
AMZN-AlexOteiza 426ba2f4a6 Added conversion of physics tests using new optimizations. Fixed issue on editor test framework to close the AP correctly (#3145) 
* Commit

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed xfail

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix for ap not closing for optimized tests

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* renamed tests to _Optimized

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Added xfail so the test will run in jenkins without affecting outcomes

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-08-24 20:54:48 +02:00
Esteban Papp b609d5e2cb supporting multiple directories 
automatically excluding obvious things
cleanup and verification

Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-08-23 19:41:57 -07:00
Esteban Papp 8bc9ed3d01 removing some rad leftovers (#3366) 
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-08-20 13:39:51 -07:00
evanchia 8d6df19592 fixes a flaky lytesttools unit test 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-08-20 09:15:14 -07:00
Esteban Papp a1b59e5e5e install reorg/cleanup 
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-08-19 08:51:29 -07:00
AMZN-AlexOteiza 4b68e6c766 Added support for pytest marks, including skipping of tests (#2353) 
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-08-10 10:08:16 +02:00
Cynthia Lin c1a0b5c686 performance benchmarks: Aggregate and report CPU frame times. (#2939) 
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* performance benchmarks: Aggregate and report CPU frame times based on JSON data.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-08-09 14:57:52 -07:00
Cynthia Lin b21b0e12e4 fix: Switch local environment detection to depend on BUILD_NUMBER instead of CI (#2962) 
CI is only available on Jenkins v2.289.1, nightly builds are still run on Jenkins 2.277.4

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-08-09 10:32:31 -07:00
Cynthia Lin 72cecfaaae performance metrics: Upload benchmark results to local index for locally-run builds. (#2816) 
Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-08-05 14:59:09 -07:00
sharmajs-amzn 69bde80de3 Nighly build test fixes (#2727) 
Signed-off-by: sharmajs-amzn <82233357+sharmajs-amzn@users.noreply.github.com>
 2021-08-03 11:15:23 -07:00
Cynthia Lin 61f91d4a9a Move benchmark data aggregation from ASV into ly_test_tools module. (#2335) 
* fix: Correct typo in profiling capture system.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* Move benchmark data aggregation from ASV into ly_test_tools module.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-07-26 12:25:50 -07:00
AMZN-AlexOteiza b815c203da (Continuation) Implemented automation paralellization & standarization (#1718) 
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-07-22 12:57:23 +02:00
Steve Pham 38261d0800 Shorten copyright headers by splitting into 2 lines (#2213) 
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
 2021-07-16 15:25:48 -07:00
Royal OBrien 1061e17b36 Merge pull request #2112 from AMZN-scspaldi/scspaldi_cleanupLuaWindow 
Added Lua Editor window to kill process list.
 2021-07-15 19:03:36 -04:00