a8559c4000
Merge pull request #4374 from aws-lumberyard-dev/lytt_linux_tests
...
Lytt linux tests
2021-09-29 09:31:44 -07:00
f6585a741c
docstring updates
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-09-28 14:55:16 -07:00
bcf024edf9
registering linux integ test to cmake
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-09-27 14:33:08 -07:00
4998f44246
adding process_utils linux integ test
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-09-27 14:25:43 -07:00
09ce73aa44
Initial update for this module's unit tests on Linux
...
Signed-off-by: sweeneys <sweeneys@amazon.com >
2021-09-22 17:50:38 -07:00
d784ff8c57
Added debugger attachment utilities to the engine, fixed crash when showing console variables, improvements to timeout handling and small cleanup ( #3591 )
...
* Added debugger attachment utilities to the engine, fixed crash when showing console variables
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed unused variables
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed unneded check
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Small fix for crashes/timeouts
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed unused variable, fixed compile error
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Fix compile
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Addressed esteban comments
* Addressed tom comments
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-08-31 10:27:14 +02:00
a3868068d5
Merge branch 'development' of https://github.com/o3de/o3de into jckand/EditorAutomationOptimization
2021-08-25 11:33:17 -05:00
f94043dc83
Adds functions so targets can define install directories/files
2021-08-24 15:12:02 -07:00
b466788cc4
Updating editor_test.py to allow for per-test null_renderer overrides
...
Signed-off-by: jckand-amzn <jckand@amazon.com >
2021-08-24 16:10:36 -05:00
426ba2f4a6
Added conversion of physics tests using new optimizations. Fixed issue on editor test framework to close the AP correctly ( #3145 )
...
* Commit
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Removed xfail
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Fix for ap not closing for optimized tests
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* renamed tests to _Optimized
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
* Added xfail so the test will run in jenkins without affecting outcomes
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-08-24 20:54:48 +02:00
b609d5e2cb
supporting multiple directories
...
automatically excluding obvious things
cleanup and verification
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com >
2021-08-23 19:41:57 -07:00
8bc9ed3d01
removing some rad leftovers ( #3366 )
...
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com >
2021-08-20 13:39:51 -07:00
8d6df19592
fixes a flaky lytesttools unit test
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-08-20 09:15:14 -07:00
a1b59e5e5e
install reorg/cleanup
...
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com >
2021-08-19 08:51:29 -07:00
4b68e6c766
Added support for pytest marks, including skipping of tests ( #2353 )
...
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-08-10 10:08:16 +02:00
c1a0b5c686
performance benchmarks: Aggregate and report CPU frame times. ( #2939 )
...
* Add CaptureCpuFrameTime method to ProfilingCaptureSystemComponent for monitoring CPU performance.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* ly_test_tools: Refactor benchmark data aggregator in preparation for CPU frame times.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* performance benchmarks: Aggregate and report CPU frame times based on JSON data.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* AutomatedTesting: Capture CPU frame time in AtomFeatureIntegrationBenchmark.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-08-09 14:57:52 -07:00
b21b0e12e4
fix: Switch local environment detection to depend on BUILD_NUMBER instead of CI ( #2962 )
...
CI is only available on Jenkins v2.289.1, nightly builds are still run on Jenkins 2.277.4
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-08-09 10:32:31 -07:00
72cecfaaae
performance metrics: Upload benchmark results to local index for locally-run builds. ( #2816 )
...
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-08-05 14:59:09 -07:00
69bde80de3
Nighly build test fixes ( #2727 )
...
Signed-off-by: sharmajs-amzn <82233357+sharmajs-amzn@users.noreply.github.com >
2021-08-03 11:15:23 -07:00
61f91d4a9a
Move benchmark data aggregation from ASV into ly_test_tools module. ( #2335 )
...
* fix: Correct typo in profiling capture system.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* Move benchmark data aggregation from ASV into ly_test_tools module.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-07-26 12:25:50 -07:00
b815c203da
(Continuation) Implemented automation paralellization & standarization ( #1718 )
...
Engine improvements/fixes
Fixed behavior that made the editor automated test to be sometimes stuck if lost the focus is lost.
Added support for specifying multiple tests to in batch to the editor, this is achieved by passing --runpythontest with the tests separated by ';'
Added new cmdline argument --project-user-path for overriding the user path. This allows to have multiple editors running writing logs and crash logs in different locations.
Moved responsability of exiting after a test finishes/passes out of ExecuteByFilenameAsTest, callers will use the bool return to know if the test passed.
Editor test batch and parallelization implementation:
Now the external python portion of the editor tests will be specified via test specs which will generate the test. Requiring no code. This is almost a data-driven approach.
Tests can be specified as single tests, parallel, batchable or batchable+parallel
Command line arguments for pytest to override the maximum number of editors, disable parallelization or batching.
Automated tests for testing this new editor testing utility
Signed-off-by: Garcia Ruiz <aljanru@amazon.co.uk >
Co-authored-by: Garcia Ruiz <aljanru@amazon.co.uk >
2021-07-22 12:57:23 +02:00
38261d0800
Shorten copyright headers by splitting into 2 lines ( #2213 )
...
* Updated all copyright headers to split the longer original copyright line into 2 shorter lines
Signed-off-by: Steve Pham <spham@amazon.com >
2021-07-16 15:25:48 -07:00
1061e17b36
Merge pull request #2112 from AMZN-scspaldi/scspaldi_cleanupLuaWindow
...
Added Lua Editor window to kill process list.
2021-07-15 19:03:36 -04:00
9e81cedf80
Merge pull request #1979 from aws-lumberyard-dev/system_test_example_update
...
System test example update
2021-07-14 16:59:01 -07:00
12a8cc7cd7
Removing deleted test from CMakeLists and updated in line comments for sample test
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-07-12 15:31:09 -07:00
6d2fbacda5
Added Lua Editor window to kill process list.
...
Signed-off-by: scspaldi <scspaldi@amazon.com >
2021-07-12 13:43:41 -07:00
eb9304c28d
Preparation for automated benchmarks ( #1923 )
...
* ly_test_tools: Add filebeat_client module from o3de-mars.
Slightly modified with default parameters and exceptions in order to act as an individual component.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
* scripts: Remove timestamp_aggregator.py to prepare for moving into ASV automated test repository.
Signed-off-by: Cynthia Lin <cyntlin@amazon.com >
2021-07-09 11:28:18 -07:00
ca29b95371
Merge branch 'development' into system_test_example_update
2021-07-09 10:17:15 -07:00
bc7e12278c
changed nullrenderer arg for sanity test
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-07-08 15:55:06 -07:00
3b1873b045
Merged stabilization/2106 -> development (resolved merge conflicts).
...
Signed-off-by: Chris Galvan <chgalvan@amazon.com >
2021-07-08 13:56:47 -05:00
9067fc3b99
Updating/Removing LyTestTools sample tests
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-07-08 11:55:46 -07:00
6308d01456
Minor changes to system example test to match docs
...
Signed-off-by: evanchia <evanchia@amazon.com >
2021-07-08 11:53:03 -07:00
dee591921e
Fix exception bubble-up
...
Signed-off-by: nvsickle <nvsickle@amazon.com >
2021-07-07 11:51:25 -07:00
3549e5b946
More fussing with logs
...
Signed-off-by: nvsickle <nvsickle@amazon.com >
2021-07-07 11:51:24 -07:00
3ee15f1912
Try to get some actual log output out of this
...
Signed-off-by: nvsickle <nvsickle@amazon.com >
2021-07-07 11:51:22 -07:00
d7574777a8
Resolved merge conflicts
...
Signed-off-by: Chris Galvan <chgalvan@amazon.com >
2021-07-02 12:42:44 -05:00
b4a2edec6a
Final update copyright headers to reference license files at the repo root ( #1693 )
...
* Final update copyright headers to reference license files at the repo root
Signed-off-by: spham <spham@amazon.com >
* Fix copyright validator unit tests to support the stale O3DE header scenario
Signed-off-by: spham <spham@amazon.com >
2021-06-30 19:51:55 -07:00
be519bb36a
Allow overriding of AWSAttribution settings to skip consent dialog for automated testing ( #1650 )
...
Signed-off-by: dhrudesh <dhrudesh@amazon.com >
2021-06-30 12:17:45 -07:00
d14229c67e
some replacements and fixes that were referring Sandbox/Editor
...
Signed-off-by: Esteban Papp <81431996+amznestebanpapp@users.noreply.github.com >
2021-06-29 13:55:32 -07:00
149863c527
Removed Amazon as Company for QSettings ( #1649 )
...
* Removed Amazon as Company for QSettings
Signed-off-by: Terry Michaels <miterenc@amazon.com >
2021-06-29 14:00:11 -05:00
4e14c0069b
Merge branch 'upstream/stabilization/2106' into genewalt/gitflow_210628
2021-06-28 19:09:20 -07:00
7a2a2dc0d7
Updated branding for application names ( #1617 )
2021-06-28 11:35:13 -05:00
e9e740e355
Merge pull request #1527 from aws-lumberyard-dev/linux_sanity_fix
...
fixing linux sanity tests
2021-06-23 14:11:16 -07:00
70042fcdcd
O3DE Copyright Updates for Linux Foundation ( #1504 )
2021-06-23 10:55:22 -07:00
b032177418
Merge pull request #1443 from aws-lumberyard-dev/nvsickle/MergeStabilizationJun18
...
Merge stabilization/2106 into development
2021-06-21 10:58:07 -07:00
989178d285
Merge pull request #1377 from aws-lumberyard-dev/test_tools_example_test
...
Fixing test tools example test
2021-06-21 09:34:25 -07:00
e55580af57
Merge remote-tracking branch 'upstream/stabilization/2106' into nvsickle/MergeStabilizationJun18
2021-06-18 13:25:53 -07:00
3310110b9a
Fixing test tools example test
2021-06-16 15:08:54 -07:00
cf7f1defeb
added warning message
2021-06-16 14:45:11 -07:00
017845e285
fixing project() func to read project.json
2021-06-16 11:29:14 -07:00
Sean Sweeney
evanchia
AMZN-AlexOteiza
jckand-amzn
Esteban Papp
Cynthia Lin
sharmajs-amzn
Steve Pham
Royal OBrien
scspaldi
Chris Galvan
nvsickle
amzn-hdoke
Terry Michaels
Gene Walters
evanchia-ly-sdets