f1fa0acbb4
Stabilize asset processor immediately exiting
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-10-13 11:44:15 -07:00
1ea472bdeb
Merge pull request #4589 from aws-lumberyard-dev/lytt_integ_linux
...
Platform manager and sanity tests for Linux
2021-10-12 15:11:12 -07:00
80db67e90a
Remove many unused variables and unused setting files ( #4607 )
...
* Remove many unused variables and unused setting files
Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com >
* Remove a few more dead config vars
Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com >
* fix android test_ConfigureSettings_DefaultValues_SetsValues
Signed-off-by: nemerle <96597+nemerle@users.noreply.github.com >
2021-10-12 17:06:15 -05:00
45def74409
Fix extension ignoring between Windows and Linux
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-10-11 11:11:40 -07:00
2034cd3053
Platform manager and sanity tests for Linux
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-10-08 15:36:52 -07:00
f6585a741c
docstring updates
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-09-28 14:55:16 -07:00
09ce73aa44
Initial update for this module's unit tests on Linux
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-09-22 17:50:38 -07:00
d784ff8c57
Added debugger attachment utilities to the engine, fixed crash when showing console variables, improvements to timeout handling and small cleanup ( #3591 )
...
* Added debugger attachment utilities to the engine, fixed crash when showing console variables
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed unused variables
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed unneded check
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Small fix for crashes/timeouts
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed unused variable, fixed compile error
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Fix compile
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Addressed esteban comments
* Addressed tom comments
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-08-31 10:27:14 +02:00
b466788cc4
Updating editor_test.py to allow for per-test null_renderer overrides
...
Signed-off-by: jckand-amzn <jckand@amazon.com >
2021-08-24 16:10:36 -05:00
426ba2f4a6
Added conversion of physics tests using new optimizations. Fixed issue on editor test framework to close the AP correctly ( #3145 )
...
* Commit
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed xfail
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Fix for ap not closing for optimized tests
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* renamed tests to _Optimized
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Added xfail so the test will run in jenkins without affecting outcomes
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-08-24 20:54:48 +02:00
8bc9ed3d01
removing some rad leftovers ( #3366 )
...
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com >
2021-08-20 13:39:51 -07:00
4b68e6c766
Added support for pytest marks, including skipping of tests ( #2353 )
...
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-08-10 10:08:16 +02:00
c1a0b5c686
performance benchmarks: Aggregate and report CPU frame times. ( #2939 )
...
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* performance benchmarks: Aggregate and report CPU frame times based on JSON data.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-08-09 14:57:52 -07:00
b21b0e12e4
fix: Switch local environment detection to depend on BUILD_NUMBER instead of CI ( #2962 )
...
CI is only available on Jenkins v2.289.1, nightly builds are still run on Jenkins 2.277.4
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-08-09 10:32:31 -07:00
72cecfaaae
performance metrics: Upload benchmark results to local index for locally-run builds. ( #2816 )
...
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-08-05 14:59:09 -07:00
69bde80de3
Nighly build test fixes ( #2727 )
...
Signed-off-by: sharmajs-amzn <82233357+sharmajs-amzn@users.noreply.github.com >
2021-08-03 11:15:23 -07:00
61f91d4a9a
Move benchmark data aggregation from ASV into ly_test_tools module. ( #2335 )
...
* fix: Correct typo in profiling capture system.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* Move benchmark data aggregation from ASV into ly_test_tools module.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-07-26 12:25:50 -07:00
b815c203da
(Continuation) Implemented automation paralellization & standarization ( #1718 )
...
Engine improvements/fixes
Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:
Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-07-22 12:57:23 +02:00
38261d0800
Shorten copyright headers by splitting into 2 lines ( #2213 )
...
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines
Signed-off-by: Steve Pham <spham@amazon.com >
2021-07-16 15:25:48 -07:00
6d2fbacda5
Added Lua Editor window to kill process list.
...
Signed-off-by: scspaldi <scspaldi@amazon.com >
2021-07-12 13:43:41 -07:00
eb9304c28d
Preparation for automated benchmarks ( #1923 )
...
* ly_test_tools: Add filebeat_client module from o3de-mars.
Slightly modified with default parameters and exceptions in order to act as an individual component.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* scripts: Remove timestamp_aggregator.py to prepare for moving into ASV automated test repository.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-07-09 11:28:18 -07:00
dee591921e
Fix exception bubble-up
...
Signed-off-by: nvsickle <nvsickle@amazon.com >
2021-07-07 11:51:25 -07:00
3549e5b946
More fussing with logs
...
Signed-off-by: nvsickle <nvsickle@amazon.com >
2021-07-07 11:51:24 -07:00
3ee15f1912
Try to get some actual log output out of this
...
Signed-off-by: nvsickle <nvsickle@amazon.com >
2021-07-07 11:51:22 -07:00
b4a2edec6a
Final update copyright headers to reference license files at the repo root ( #1693 )
...
* Final update copyright headers to reference license files at the repo root
Signed-off-by: spham <spham@amazon.com >
* Fix copyright validator unit tests to support the stale O3DE header scenario
Signed-off-by: spham <spham@amazon.com >
2021-06-30 19:51:55 -07:00
be519bb36a
Allow overriding of AWSAttribution settings to skip consent dialog for automated testing ( #1650 )
...
Signed-off-by: dhrudesh <dhrudesh@amazon.com >
2021-06-30 12:17:45 -07:00
d14229c67e
some replacements and fixes that were referring Sandbox/Editor
...
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com >
2021-06-29 13:55:32 -07:00
149863c527
Removed Amazon as Company for QSettings ( #1649 )
...
* Removed Amazon as Company for QSettings
Signed-off-by: Terry Michaels <miterenc@amazon.com >
2021-06-29 14:00:11 -05:00
7a2a2dc0d7
Updated branding for application names ( #1617 )
2021-06-28 11:35:13 -05:00
e9e740e355
Merge pull request #1527 from aws-lumberyard-dev/linux_sanity_fix
...
fixing linux sanity tests
2021-06-23 14:11:16 -07:00
70042fcdcd
O3DE Copyright Updates for Linux Foundation ( #1504 )
2021-06-23 10:55:22 -07:00
cf7f1defeb
added warning message
2021-06-16 14:45:11 -07:00
017845e285
fixing project() func to read project.json
2021-06-16 11:29:14 -07:00
009e96d601
fixing ly_test_tools function and unit tests
2021-06-16 10:02:36 -07:00
1f31bac640
fixing linux sanity tests
2021-06-14 20:19:19 -07:00
b24c83122e
fixes for missing dependency tests ( #1141 )
2021-06-08 09:52:17 -07:00
371a2f71ca
Merge pull request #972 from aws-lumberyard-dev/LyttFindExternal
...
Tests search for external project definition relative to build directory
2021-05-27 12:05:53 -07:00
9b1be43367
Renamed osx_gl to mac and es3 to android for cache folders ( #949 )
2021-05-26 19:17:17 -05:00
79d66dd492
Search for external project definition before searching for internal projects
2021-05-26 16:22:32 -07:00
d369912727
Merge branch 'main' into LYN-2461
2021-05-21 16:41:46 -07:00
44ec0211a0
fixes for missing dependency test ( #850 )
2021-05-21 12:28:51 -07:00
b63f2449c9
Remove reference to deleted function
2021-05-19 16:47:40 -07:00
268fd8b714
Remove bootstrap.cfg and references to it.
2021-05-19 13:57:35 -07:00
9141221843
Reduce AP race conditions and fix minor bugs
2021-05-13 14:43:30 -07:00
67c3801d73
Log monitor encoding fix ( #729 )
...
Fixed log monitor encoding bug.
2021-05-12 16:15:18 -07:00
a1b4844f6a
Merge branch 'main' into Atom/jromnoa/SPEC-6728-fix-material-editor-launcher
2021-05-10 16:30:47 -07:00
757a26825a
adds new HOST_OS_GENERIC_EXECUTABLE constant and adds error handling if the executable doesn't exist in the path provided
2021-05-10 16:27:30 -07:00
5885899497
fix tabbing, add WinGenericLauncher class import to ly_test_tools.launchers.__init__
2021-05-10 14:44:47 -07:00
8766790f48
re-add WinGenericLauncher for custom .exe launchers instead of the hard-coded ones (i.e. able to use 'MaterialEditor.exe' instead of 'Editor.exe' for a WinLauncher class)
2021-05-10 14:28:02 -07:00
b6890eef5c
removed debugging text
2021-05-10 13:36:05 -07:00
sweeneys
Artur K
AMZN-AlexOteiza
jckand-amzn
Esteban Papp
Cynthia Lin
sharmajs-amzn
Steve Pham
scspaldi
nvsickle
amzn-hdoke
Terry Michaels
evanchia-ly-sdets
evanchia
Terry Michaels
amzn-sj
SSpalding
jromnoa