birkeh/o3de
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,658 Commits 3 Branches 3 Tags
75d7c61ba1070cc167ef9fe01bf73eadcbf3a20f
Commit Graph

81 Commits

Author SHA1 Message Date
chiyenteng ab76254b43 Make prefab system enabled as default for automated tests (#5670) 
* Make prefab system enabled as default for automated tests

Signed-off-by: chiyenteng <82238204+chiyenteng@users.noreply.github.com>

* Modify auto tests after preventing regset saved into disk after editor main window closed

Signed-off-by: chiyenteng <82238204+chiyenteng@users.noreply.github.com>

* Uncomment xfail

Signed-off-by: chiyenteng <82238204+chiyenteng@users.noreply.github.com>

* Use --regset for editor tests

Signed-off-by: chiyenteng <82238204+chiyenteng@users.noreply.github.com>
 2021-11-22 10:45:18 -08:00
sweeneys 3ae8f8b199 merge from development 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-11-12 14:47:08 -08:00
AMZN-AlexOteiza cb93bafc4f Fixed physics tests on linux (#5579) 
* Fixed physics tests on linux

* Fixed unit tests because of new implementation

* Fixed bug in lock, fixed unit tests

Co-authored-by: aljanru <aljanru@uc5564ff5a5ee55.ant.amazon.com>
 2021-11-12 16:09:09 +00:00
AMZN-AlexOteiza f861ab622e Fixed AP timeout on linux due to zombie AP process (#5550) 
* Fixed AP timeout on linux due to zombie AP process

* Fixed reversed check

Co-authored-by: aljanru <aljanru@uc5564ff5a5ee55.ant.amazon.com>
 2021-11-11 22:36:26 +00:00
AMZN-AlexOteiza eafb2fdce5 Fixed editor log path and improved editor log not found error string (#5357) 
* Fixed editor log path and improved editor log not found error string

* Renamed any lowercase editor.log to Editor.log

* Fix unit test failures

Signed-off-by: AMZN-AlexOteiza <aljanru@amazon.co.uk>

Co-authored-by: aljanru <aljanru@uc5564ff5a5ee55.ant.amazon.com>
 2021-11-11 22:15:44 +00:00
sweeneys c29ca07d54 Enable python-based tests in Linux AR 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-11-10 15:34:08 -08:00
Allen Jackson 815c2d1986 {lyn5868} fixing the asset_processor_batch_tests.py auto tests (#5247) 
Signed-off-by: Allen Jackson <23512001+jackalbe@users.noreply.github.com>
 2021-11-03 13:19:22 -05:00
Mike Balfour 576ebada70 Merge commit '8b5a0350b57486bbfa04f1233abfd3a086c25ea1' into mbalfour/gitflow_211102_o3de 2021-11-02 09:38:35 -05:00
Allen Jackson 8b5a0350b5 {lyn7621} adding more time via ap_max_activate_time (#5180) 
* adding more time via ap_max_activate_time so that the Debug
  version of AP-GUI can load all the builder DLLs

Signed-off-by: jackalbe <23512001+jackalbe@users.noreply.github.com>
 2021-11-01 17:27:17 -05:00
Sean Sweeney ea4bc31b38 Merge pull request #4675 from aws-lumberyard-dev/editor_test_tools_cleanup 
Editor test tools cleanup
 2021-10-29 15:47:26 -07:00
evanchia 4e2de0170c reverting typehints 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-28 19:33:59 -07:00
evanchia 7c25cb6d5a addressing minor details in feedback 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-26 10:37:39 -07:00
evanchia 670e9a1fa1 merge with development 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-21 14:56:16 -07:00
sweeneys ea325d356c updated defaults in all launchers, with additional unit test 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-21 12:07:43 -07:00
sweeneys a1edb2c4ac Update platform defaults to return a launcher instead of a string 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-21 11:51:47 -07:00
evanchia 64a20c45b5 adding editor integ tests to AR 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-19 15:51:44 -07:00
evanchia 62a5aa1874 fixing test breaking changes 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-18 18:15:46 -07:00
evanchia 84493760ca addressing PR feedback 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-18 13:27:40 -07:00
evanchia a53e0e8124 Merging development into editor_test_tools_cleanup 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-13 12:50:17 -07:00
evanchia 8ab9f89b46 Adding unit tests and docstrings for editor test files 
Signed-off-by: evanchia <evanchia@amazon.com>
 2021-10-13 12:43:54 -07:00
sweeneys f1fa0acbb4 Stabilize asset processor immediately exiting 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-13 11:44:15 -07:00
Sean Sweeney 1ea472bdeb Merge pull request #4589 from aws-lumberyard-dev/lytt_integ_linux 
Platform manager and sanity tests for Linux
 2021-10-12 15:11:12 -07:00
Artur K 80db67e90a Remove many unused variables and unused setting files (#4607) 
* Remove many unused variables and unused setting files

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>

* Remove a few more dead config vars

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>

* fix android test_ConfigureSettings_DefaultValues_SetsValues

Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com>
 2021-10-12 17:06:15 -05:00
sweeneys 45def74409 Fix extension ignoring between Windows and Linux 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-11 11:11:40 -07:00
sweeneys 2034cd3053 Platform manager and sanity tests for Linux 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-10-08 15:36:52 -07:00
sweeneys f6585a741c docstring updates 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-09-28 14:55:16 -07:00
sweeneys 09ce73aa44 Initial update for this module's unit tests on Linux 
Signed-off-by: sweeneys <sweeneys@amazon.com>
 2021-09-22 17:50:38 -07:00
AMZN-AlexOteiza d784ff8c57 Added debugger attachment utilities to the engine, fixed crash when showing console variables, improvements to timeout handling and small cleanup (#3591) 
* Added debugger attachment utilities to the engine, fixed crash when showing console variables

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unused variables

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unneded check

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Small fix for crashes/timeouts

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed unused variable, fixed compile error

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix compile

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Addressed esteban comments

* Addressed tom comments

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-08-31 10:27:14 +02:00
jckand-amzn b466788cc4 Updating editor_test.py to allow for per-test null_renderer overrides 
Signed-off-by: jckand-amzn <jckand@amazon.com>
 2021-08-24 16:10:36 -05:00
AMZN-AlexOteiza 426ba2f4a6 Added conversion of physics tests using new optimizations. Fixed issue on editor test framework to close the AP correctly (#3145) 
* Commit

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Removed xfail

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Fix for ap not closing for optimized tests

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* renamed tests to _Optimized

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

* Added xfail so the test will run in jenkins without affecting outcomes

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-08-24 20:54:48 +02:00
Esteban Papp 8bc9ed3d01 removing some rad leftovers (#3366) 
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-08-20 13:39:51 -07:00
AMZN-AlexOteiza 4b68e6c766 Added support for pytest marks, including skipping of tests (#2353) 
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-08-10 10:08:16 +02:00
Cynthia Lin c1a0b5c686 performance benchmarks: Aggregate and report CPU frame times. (#2939) 
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* performance benchmarks: Aggregate and report CPU frame times based on JSON data.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-08-09 14:57:52 -07:00
Cynthia Lin b21b0e12e4 fix: Switch local environment detection to depend on BUILD_NUMBER instead of CI (#2962) 
CI is only available on Jenkins v2.289.1, nightly builds are still run on Jenkins 2.277.4

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-08-09 10:32:31 -07:00
Cynthia Lin 72cecfaaae performance metrics: Upload benchmark results to local index for locally-run builds. (#2816) 
Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-08-05 14:59:09 -07:00
sharmajs-amzn 69bde80de3 Nighly build test fixes (#2727) 
Signed-off-by: sharmajs-amzn <82233357+sharmajs-amzn@users.noreply.github.com>
 2021-08-03 11:15:23 -07:00
Cynthia Lin 61f91d4a9a Move benchmark data aggregation from ASV into ly_test_tools module. (#2335) 
* fix: Correct typo in profiling capture system.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* Move benchmark data aggregation from ASV into ly_test_tools module.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-07-26 12:25:50 -07:00
AMZN-AlexOteiza b815c203da (Continuation) Implemented automation paralellization & standarization (#1718) 
Engine improvements/fixes

Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:

Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility

Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk>

Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk>
 2021-07-22 12:57:23 +02:00
Steve Pham 38261d0800 Shorten copyright headers by splitting into 2 lines (#2213) 
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines

Signed-off-by: Steve Pham <spham@amazon.com>
 2021-07-16 15:25:48 -07:00
scspaldi 6d2fbacda5 Added Lua Editor window to kill process list. 
Signed-off-by: scspaldi <scspaldi@amazon.com>
 2021-07-12 13:43:41 -07:00
Cynthia Lin eb9304c28d Preparation for automated benchmarks (#1923) 
* ly_test_tools: Add filebeat_client module from o3de-mars.

Slightly modified with default parameters and exceptions in order to act as an individual component.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>

* scripts: Remove timestamp_aggregator.py to prepare for moving into ASV automated test repository.

Signed-off-by: Cynthia Lin <cyntlin@amazon.com>
 2021-07-09 11:28:18 -07:00
nvsickle dee591921e Fix exception bubble-up 
Signed-off-by: nvsickle <nvsickle@amazon.com>
 2021-07-07 11:51:25 -07:00
nvsickle 3549e5b946 More fussing with logs 
Signed-off-by: nvsickle <nvsickle@amazon.com>
 2021-07-07 11:51:24 -07:00
nvsickle 3ee15f1912 Try to get some actual log output out of this 
Signed-off-by: nvsickle <nvsickle@amazon.com>
 2021-07-07 11:51:22 -07:00
Steve Pham b4a2edec6a Final update copyright headers to reference license files at the repo root (#1693) 
* Final update copyright headers to reference license files at the repo root

Signed-off-by: spham <spham@amazon.com>

* Fix copyright validator unit tests to support the stale O3DE header scenario

Signed-off-by: spham <spham@amazon.com>
 2021-06-30 19:51:55 -07:00
amzn-hdoke be519bb36a Allow overriding of AWSAttribution settings to skip consent dialog for automated testing (#1650) 
Signed-off-by: dhrudesh <dhrudesh@amazon.com>
 2021-06-30 12:17:45 -07:00
Esteban Papp d14229c67e some replacements and fixes that were referring Sandbox/Editor 
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com>
 2021-06-29 13:55:32 -07:00
Terry Michaels 149863c527 Removed Amazon as Company for QSettings (#1649) 
* Removed Amazon as Company for QSettings

Signed-off-by: Terry Michaels <miterenc@amazon.com>
 2021-06-29 14:00:11 -05:00
Terry Michaels 7a2a2dc0d7 Updated branding for application names (#1617) 2021-06-28 11:35:13 -05:00
evanchia-ly-sdets e9e740e355 Merge pull request #1527 from aws-lumberyard-dev/linux_sanity_fix 
fixing linux sanity tests
 2021-06-23 14:11:16 -07:00